Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Roadmap] Reproduce more SOTA LLM agents #186

Open
3 of 14 tasks
lightaime opened this issue Jun 28, 2023 · 8 comments · Fixed by #210
Open
3 of 14 tasks

[Roadmap] Reproduce more SOTA LLM agents #186

lightaime opened this issue Jun 28, 2023 · 8 comments · Fixed by #210
Assignees
Labels
enhancement New feature or request Roadmap

Comments

@lightaime
Copy link
Member

lightaime commented Jun 28, 2023

Required prerequisites

Motivation

CAMEL is a framework to implement and organize different agents. We would like to use it to implement more SOTA LLM agents for people to easier use, build and compare. Here is a list of agents that we are interested in implementing. Please add your favorite ones:

Solution

No response

Alternatives

No response

Additional context

No response

@lightaime lightaime added the enhancement New feature or request label Jun 28, 2023
@lightaime lightaime self-assigned this Jun 28, 2023
@markf278
Copy link

These are the most useful ones I have found other than Camel:

  • Cursor.so (agent builtin to vscodium)
  • Smol-developer
  • GPTEngineer

These are all kinda similar, AutoGPT and BabyAGI were first but honestly I have never been able to get them to produce anything, Cursor.so is probably ahead of everyone tbh.

Further investigation required on the below:

  • SmartGPT
  • Ecoute (very basic but could be a super powerful assistant)
  • Agent-LLM
  • Agent-Mimir
  • IX
  • SuperAGI
  • AgentForge

@lightaime
Copy link
Member Author

These are the most useful ones I have found other than Camel:

  • Cursor.so (agent builtin to vscodium)
  • Smol-developer
  • GPTEngineer

These are all kinda similar, AutoGPT and BabyAGI were first but honestly I have never been able to get them to produce anything, Cursor.so is probably ahead of everyone tbh.

Further investigation required on the below:

  • SmartGPT
  • Ecoute (very basic but could be a super powerful assistant)
  • Agent-LLM
  • Agent-Mimir
  • IX
  • SuperAGI
  • AgentForge

Thanks @markf278. That is very useful! We will look into it.

@Benjamin-eecs Benjamin-eecs self-assigned this Jun 30, 2023
@markf278
Copy link

This might be more appropriate, list of known Agent Architectures:
ReACT (AutoGPT)
Reflexion
ReWOO
SwiftSage
ADEPT (SmartGPT)

For the individual agent apps, after looking at 20+ ...we have come to the conclusion that the best thing to do is to read the prompts, if some new agent comes out just check its prompts.

Some other very interesting agents/prompts you should check out:

@lightaime
Copy link
Member Author

This might be more appropriate, list of known Agent Architectures: ReACT (AutoGPT) Reflexion ReWOO SwiftSage ADEPT (SmartGPT)

For the individual agent apps, after looking at 20+ ...we have come to the conclusion that the best thing to do is to read the prompts, if some new agent comes out just check its prompts.

Some other very interesting agents/prompts you should check out:

Thanks @markf278! We will look into it.

@markf278
Copy link

markf278 commented Jul 1, 2023

Here is a huge list of agents that is being kept up to date:

https://github.com/e2b-dev/awesome-ai-agents

@markf278
Copy link

markf278 commented Jul 1, 2023

What I would really like Camel to do is to take an existing project and improve it, it could also have options for Refactor or Debug.

For example: If you had the initial loop save the code snippets from the chat history into appropriate files, the above could be options at the end of each run, continue/improve, refactor, generate_tests/debug.

@hychen-naza
Copy link
Contributor

hychen-naza commented Jul 21, 2023

I briefly go through these papers and notice they share a lot in common, for example:
BabyAGI: chat agent + task agent (for creating and prioritizing tasks)
NegotiationAgent: chat agent + critic agent (for improving chat agents)
RepeatedGamesAgent: chat agent + predict agent (for predicting other player’s actions before making a choice)
I believe we have discussed in zoom before, just want to confirm the idea: we may fulfill each single functionality in task agent, critic agent and more, then build Babyagi or NegotiationAgent through composition. If you think it's good, I will go ahead and implement in this way. @lightaime @Benjamin-eecs

@lightaime
Copy link
Member Author

lightaime commented Jul 21, 2023

Hi, @hychen-naza this is exactly what we want to do. A good first step will be to decompose the BabyAGIAgent. Some of the task-related task agents like the task_creation_agent and task_prioritization_agent can be implemented as separate task agents like TaskSpecifyAgent.

class TaskSpecifyAgent(ChatAgent):

@lightaime lightaime reopened this Aug 1, 2023
@lightaime lightaime changed the title [Feature Request] Reproduce more SOTA LLM agents [Roadmap] Reproduce more SOTA LLM agents Sep 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Roadmap
Projects
Status: 🚀 Roadmap
Development

Successfully merging a pull request may close this issue.

5 participants