Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate f-divergence to DPO (Follow up) #1610

Merged
merged 25 commits into from
Jun 19, 2024
Merged

Integrate f-divergence to DPO (Follow up) #1610

merged 25 commits into from
Jun 19, 2024
+176 −12

Commits on Jan 11, 2024

  1. Step 1: update ppo_trainer and hello_world example

    @1485840691
    1485840691 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    0f6aafa View commit details
    Browse the repository at this point in the history

  2. Step 2: Refine comments and add parameter type

    @1485840691
    1485840691 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    afa1526 View commit details
    Browse the repository at this point in the history

  3. Step 2: Add missing parameter comments

    @1485840691
    1485840691 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    fc1d75f View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Step 1: Organize ptx loss into a function and add ptx_loss to train_s… 

    …tats
    @1485840691
    1485840691 committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    99c8e6e View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2024

  1. Step 1 updates: add comment to ptx_loss function, fix a bug and add w… 

    …arning message
    @1485840691
    1485840691 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    635a647 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. Step 2: 1) Add ppo_ptx trainig example as ppo; 2) separate pretrain d… 

    …ata fetch and iterate
    @1485840691
    1485840691 committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    e947bea View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2024

  1. Step 2: Remove loss from columns_to_log in ppo_ptx example

    @1485840691
    1485840691 committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    201bc91 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. Remove data set revision in load imbd dataset

    @1485840691
    1485840691 committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    b0773e5 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. Run pre-commit and fix format issues

    @1485840691
    1485840691 committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    8fdb770 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. Initial draft of f-divergence fn

    @1485840691
    1485840691 committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    7715dbf View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. Update f-divergence to avoid overflow

    @1485840691
    1485840691 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    18ec6a1 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2024

  1. Merge branch 'main' into dpo

    @1485840691
    1485840691 committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    d47fc79 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. fix test errors and comments

    @1485840691
    1485840691 committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    f3403f7 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. Add Unit tests for dpo loss with alpha and js div f

    @1485840691
    1485840691 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    211c935 View commit details
    Browse the repository at this point in the history

  2. Adjust format

    @1485840691
    1485840691 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    9afcec9 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Fix test error

    @1485840691
    1485840691 committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    f77a83b View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Merge branch 'main' of https://github.com/1485840691/trl

    @1485840691
    1485840691 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    5400f63 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into dpo

    @1485840691
    1485840691 committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    e77b38e View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. Reverse this update

    @1485840691
    1485840691 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    5064e79 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Add test cases

    @1485840691
    1485840691 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    2aa29b7 View commit details
    Browse the repository at this point in the history

  2. Reverse un-needed updates

    @1485840691
    1485840691 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    c30eda9 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2024

  1. Update code style

    @1485840691
    1485840691 committed May 4, 2024
    Configuration menu
    Copy the full SHA
    b672720 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Merge branch 'main' into dpo

    @kashif
    kashif committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    2363c21 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Try to fix code fmt error

    @1485840691
    1485840691 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    13d18d4 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. remove extra end line

    @1485840691
    1485840691 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    36bdc73 View commit details
    Browse the repository at this point in the history