Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Offline agent eval #2607

Merged
merged 28 commits into from
May 13, 2024
Merged

Offline agent eval #2607

merged 28 commits into from
May 13, 2024

Commits on Mar 26, 2024

  1. first pass at offline agent eval integration

    @jluey1
    jluey1 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    23adac1 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Integrating AgentEval for offline scenarios

    @jluey1
    jluey1 committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    ece7a24 View commit details
    Browse the repository at this point in the history

  2. removing old changes

    @jluey1
    jluey1 committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    3d58536 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. fixing notebook, updating docs

    @jluey1
    jluey1 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    d604f46 View commit details
    Browse the repository at this point in the history

  2. fixing subcriteria bug

    @jluey1
    jluey1 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    e3cee1f View commit details
    Browse the repository at this point in the history

  3. updating class comment

    @jluey1
    jluey1 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    04f0938 View commit details
    Browse the repository at this point in the history

  4. cleaning up agent constructors

    @jluey1
    jluey1 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    c98054e View commit details
    Browse the repository at this point in the history

  5. moving AgentEval agents to separate folder and adding a brief README

    @jluey1
    jluey1 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    2c1dd84 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. fixing build breaks

    @jluey1
    jluey1 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    a2a5d0a View commit details
    Browse the repository at this point in the history

  2. fixing formatting break

    @jluey1
    jluey1 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    2d6658a View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2024

  1. Merge branch 'main' into offlineAgentEval

    @BeibinLi
    BeibinLi committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    5a3969a View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. fixing comments

    @jluey1
    jluey1 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    de2ae18 View commit details
    Browse the repository at this point in the history

  2. consolidating files in the agenteval folder under contrib and cleanin… 

    …g up imports
    @jluey1
    jluey1 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    489ccb2 View commit details
    Browse the repository at this point in the history

  3. :Merge branch 'offlineAgentEval' of github.com:jluey1/autogen into of… 

    …flineAgentEval
    @jluey1
    jluey1 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    9a6ecfa View commit details
    Browse the repository at this point in the history

  4. fixing import ordering

    @jluey1
    jluey1 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    be35fbc View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. adding basic agenteval tests and fixing criteria parsing bug

    @jluey1
    jluey1 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    e8d1f59 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Merge branch 'main' into offlineAgentEval

    @sonichi
    sonichi committed May 2, 2024
    Configuration menu
    Copy the full SHA
    7e64a96 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. first try at adding openai agenteval tests to build process

    @jluey1
    jluey1 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    2300ea6 View commit details
    Browse the repository at this point in the history

  2. merging upstream and first try at adding openai agenteval tests to bu… 

    …ild process
    @jluey1
    jluey1 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    0e26a9e View commit details
    Browse the repository at this point in the history

  3. adding non-openai agenteval tests to build process

    @jluey1
    jluey1 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    50cf0c7 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. updating test settings

    @jluey1
    jluey1 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    72bd361 View commit details
    Browse the repository at this point in the history

  2. updating openai test

    @jluey1
    jluey1 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e8e9eb6 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Update test/agentchat/contrib/agent_eval/test_agent_eval.py 

    Co-authored-by: Wael Karkoub <[email protected]>
    @jluey1 @WaelKarkoub
    jluey1 and WaelKarkoub committed May 7, 2024
    Configuration menu
    Copy the full SHA
    289d9ed View commit details
    Browse the repository at this point in the history

  2. Update .github/workflows/contrib-openai.yml 

    Co-authored-by: Wael Karkoub <[email protected]>
    @jluey1 @WaelKarkoub
    jluey1 and WaelKarkoub committed May 7, 2024
    Configuration menu
    Copy the full SHA
    6b4de8c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:jluey1/autogen

    @jluey1
    jluey1 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    efe9351 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into offlineAgentEval

    @jluey1
    jluey1 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    71284e4 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. updating typing and converting to pydantic objects

    @jluey1
    jluey1 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    fdc1811 View commit details
    Browse the repository at this point in the history

  2. fixing test file

    @jluey1
    jluey1 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1aa8cee View commit details
    Browse the repository at this point in the history