Auto-GPT In Action!

[Torantulino]

Share your screen recordings (or screenshots) of Auto-GPT in action here! 📽️🤖

Whether you're trying out a new idea, or laughing at a funny output, please share your results!

How can I record Auto-GPT in action?

Windows

You can easily screen record (with audio) on windows with ShareX
How to record system audio with Share X

I look forward to seeing what you're up to!

[Torantulino]

It did it! Completed a task on v.3.5!
Here's a screencast if anybody is curious: https://www.loom.com/share/9bf888d9c925474899257d072f1a562f

Originally posted by @stan-voo in #12 (comment)

[positonic]

haha, well done!

[Torantulino]

Here is the first demo of Auto-GPT speaking:

Joke-GPT 🤡

Auto-GPT-Demo-3_Speech.mp4

I first shared this on twitter.

[mrharrison007]

Possible for knock knock jokes between two agents?

[Torantulino]

Auto-GPT now has full file I/O, here it is showing off it's new capabilities.

Auto_GPT_File_IO_Demo.mp4

I've included some security features to this system so that it is (hopefully) not able to access outside of it's own workspace.
Would anyone like to security audit that? 🛡️
Commit: a608d8d

[Dartterious]

This doesn't seem to work on the most current commit? I tried to copy the instructions exactly but it's not working. Has something changed recently?

[Torantulino]

The BIG One: Programming and Code Execution is here:

Auto-GPT-Code-Improvement-Execution.mp4

Security 🛡️

I could do with some experts weighing in.
All code is executed by running all code using docker in an attempt to sandbox it.

Please let me know what you think!

[rkeshwani]

This can get a bit expensive but it's literally self-improving code. This is awesome and frightening at the same time. My only suggestion would be to put in some guardrails against it creating things that can do major harm. Maybe make sure each command has a system directive so that it can't do really bad things (or at least I hope open-ai has things that prevent it from doing these things)? It seems like it's only cognitive limitations will be large codebases and contextual limits.

[maxxflyer]

avoid virus injections to third parties is the first thing coming to my mind

[cometbus]

how do I set this up the way you have it with docker? I saw you just added the docker file, that's amazing!

[Torantulino]

Do you have docker installed?
Where exactly are you running into problems? 😊

[aodrasa]

Do you have docker installed? Where exactly are you running into problems? 😊

Same question as @cometbus! I've got Docker installed, just unsure of the next steps to take to set it up so Auto-GPT has access to the file. Would appreciate any guidance :) Still very new to the coding/dev side of things.

[stefangrotz]

I had this interesting situation where google did not respond and it switched to Bing:

EDIT: its quite interesting, that this doesn't happen always. Right now I am in a loop during another run, where it never switches to Bing

[Danny1218]

Doesnt work for me set it up exactly as in the example video;

Executing file 'test_agent_manager.py' in workspace 'auto_gpt_workspace'
SYSTEM: Command execute_python_file returned: Error: Error while fetching server API version: (2, 'CreateFile', 'The system cannot find the file specified.')
SELF IMPROVEMENT GPT THOUGHTS: Initiate the execution of the tests we wrote for agent_manager.py with pytest.
REASONING: As the previous command encountered an error, we need to ensure that the file path is correct before we run the tests again using 'execute_python_file' command. We'll add a './' prefix to the 'file' argument to run the fi
le in the current directory.

[DataOnDaRox]

Hey, so this is so scary good i had to try it. Got everything installed and running, but seems to hang after I enter the AI name. Nothing happens. Tried several times, no juice. Any thoughts?

[redhousc]

Did you input your api key from openAI to the .env?

[DataOnDaRox]

Yes

[severinv42]

Initializing the index in Pinecone on the first run might take some time. It hung for several minutes for me, and then everything worked fine. You can check the index status on the indexes page in Pinecone

[parinphatw]

I have tried to make it writing a simple test, and it worked just like the demo.
However, I went further by letting it generate a simple React application.
The result was it cannot even create the React app (also tried CRUD application with Express.js).

Also, I have tried a lot of prompt formats. None seems to work.
Has anyone tried on this? Or it is just not supposed to work.

[redhousc]

I haven't gotten it to write working code yet but I have gotten it to create and write to, python and text files. I haven't tried react but I would suggest trying to stretch your goal to fill all 5 slots. For example my 5th goal with often be "shutdown" by itself.

[parinphatw]

Right...it works fine with a single Python file.
But here it could not finish Goal 1. So...shouldn't adding more goals help here, should it?

[parinphatw]

I am not sure if the "change directory" command is available here. If not, maybe it cannot work with a complex-structured app.