How to use AutoGPT with login-only websites?

[meadow-kun]

For a particular pipeline I would like to use my personal LinkedIn account. It's not for stupid crazy scraping or so, just automating a task which is typically automated by other plugins. How can I setup and instruct AutoGPT to make use of this data source?

[pietrosperoni]

Same problem here. I asked it to handle a portfolio telling me what to do. Then I suggested it might have access to my account on The Economist and it answered me that as a LLM it did not have access to it. I have written a .py software to download the articles from the economist before. I am thinking that I might give it the program, by placing it inside its working directory, and then it might copy it, modify it, and run it. I have not done it yet, though.

[JonathanAmdahl]

this is neat, keep us posted @jsmith-dev

[wsbertrand]

please keep me posted on that as well boss @jsmith-dev

[bjornfix]

Automation would get the project in trouble. User prompt is a much cleaner solution.

[Sunishchal]

@jsmith-dev do you have a fork available with this code? I'd be happy to help complete the feature if needed

[Alex-Rudnicki]

@jsmith-dev +1 for looking forward to your updates here, I'm a nontechnical user who ran into this exact same issue trying to automate some of my tasks

[fire17]

I think a good next question is when new capabilities could showed or taught to it on the fly assisted by us and learned, while keeping the record of the new capability and or improving it based on experience.
This could be from learning to login into a specific website, to learning to login into any website, to even more, unpreviously anticipated requests and abilitys

Dynamic expansion of the commands shouldn't be out of the question, on the contrary, go to GPT can probably create new integrations for itself. It's already capable of research, just needs to be able to append or change it's available command inventory.

The key thing is that we are all test pilots of this and this main project should be the hub and center for all tested, verified, and effective capabilities and integrations.

[anonhostpi]

I believe this may be possible with Chromedriver. Selenium has a few awaiters that could be useful here.

I had a selenium workflow that would open Chrome and wait for a specific element identifier to show in any of the pages I was browsing before executing.

If AutoGPT can await a scrapeable element in the same way, it may allow for the user to login and navigate manually before scraping.

[matthuo333]

I have already tested about the searching on a website using headless broswer and selenium. Unfortunately， Autogpt have a feedback with the following infomation.

Attempting to fix JSON by finding outermost brackets
Error: Invalid JSON, setting it to empty JSON now.

THOUGHTS: None
REASONING: None
CRITICISM: None
Attempting to fix JSON by finding outermost brackets
Error: Invalid JSON, setting it to empty JSON now.

I do not know why...

[zhongli1990]

I am slightly new to AutoGPT. I am exploring how to use AutoGPT to access internal knowledge repos which are basically internal websites that need authentications via SSOs etc. Is this approach feasible by using from selenium's webdriver? https://openaimaster.com/autogpt-login/ and if yes, what's the best entry point to add in these Python code? (I am using docker-compose to run auto-gpt on Mac M1. Command-lines working so far)

What are the options here?

[Boostrix]

the backend used by selenium (aka firefox or chrome) can be told to use an existing browser profile, which would mean that it could log you in automatically, which would make your social media accessible (not saying that it's a good idea, but on the other hand probably harmless compared to executing scripts and commands locally - just don't let it access your bank account. ...)

[anonhostpi]

Additionally, Selenium allows AutoGPT to prompt the user for browser interaction via Selenium Awaiters (functions that wait for a specific web element to show).

This would give an opportunity to the user to be able to manually login to their account during AutoGPT runs

[matthuo333]

Do you have specific sample via Selenium Awaiters to execute?

Actually, I have already tested about the searching on a website using headless broswer and selenium. Unfortunately， Autogpt have a feedback with the following infomation.

Attempting to fix JSON by finding outermost brackets
Error: Invalid JSON, setting it to empty JSON now.

THOUGHTS: None
REASONING: None
CRITICISM: None
Attempting to fix JSON by finding outermost brackets
Error: Invalid JSON, setting it to empty JSON now.

[Drlordbasil]

with chrome you can change settings to cache even on those windows IE: itll still be logged in.

[vulcan4d]

I'm curious about this one too. I tried to give AutoGPT access to my Tradingview account but it couldn't figure out how to login to the site. I keep reading stories of people having it login to their accounts but after that experience I'm thinking bs.

[Drlordbasil]

ask it to make a python script

[Boostrix]

this should also be revisited in the light of multi-modality support that's recently been discussed in several issues

[GPTVersion]

I'm also facing same problem with AutoGPT, but Chat GPT Login is very easy. I keep reading stories of people having it login to their accounts but after that experience I'm thinking bs.

[Charlotte-br560]

To use AutoGPT with login-only websites like LinkedIn, you can follow these steps:

You can go ahead and install and set up AutoGPT on your local machine.
Use a web scraping tool like Crawlbase to scrape the necessary data from LinkedIn. Crawlbase provides a convenient interface for setting up web scraping tasks and handling login-only websites.
Set up your LinkedIn account credentials within Crawlbase to authenticate and access the required data.
Could you configure AutoGPT to use the data collected by Crawlbase for your particular pipeline? This may involve parsing the scraped data and feeding it into AutoGPT for processing and automating tasks.
By combining AutoGPT's capabilities with Crawlbase's web scraping functionality, you can automate tasks on login-only websites like LinkedIn while ensuring that the content appears natural and human-written.