Replies: 19 comments 33 replies
-
|
I am uncertain if it is technically possible, but maybe you could implement a web search, so the bot can browse the internet. |
Beta Was this translation helpful? Give feedback.
-
|
Hey @Jake-double-one, thanks for your feedback. That's definitely one of the main use cases for plugins and I'm planning on adding it! Do you know how much do these APIs cost? I need to look into this, there are also alternatives like https://serpapi.com, Brave Search API and so on... |
Beta Was this translation helpful? Give feedback.
-
|
Sry for my late reply. I was a bit busy. When starting with an account in the Google cloud (https://console.cloud.google.com/), I received €280 trial balance. I'm using SuperAGI sporadically, and currently I'm still on €0 costs. |
Beta Was this translation helpful? Give feedback.
-
|
I wanted to add few ideas of function and realized the implem was requesting to add I added a small demo with crypto rate lookup: |
Beta Was this translation helpful? Give feedback.
-
|
Hi @stumpyfr that's neat! Thanks for your contribution! While this plugin system looks great, what is the advantage of using it instead of an abstract interface? |
Beta Was this translation helpful? Give feedback.
-
|
The real value is to be able to register plugins from other packages, like we are doing with pytest. so we can imagine to do And this package will install a plugin for the bot. |
Beta Was this translation helpful? Give feedback.
-
|
Alright thanks, I'll keep this in consideration! |
Beta Was this translation helpful? Give feedback.
-
With expected growth in the number of available functions, I think something like this will be a necessity. Perhaps functions could be dynamically loaded based on natural keywords? Function developers could list activation words, which (if found in user input) trigger the inclusion of the function in the system message. I imagine such word lists would be relatively short (weather, sunny, rain, umbrella, temperature, etc. for the original example) while enabling freeform requests without unnecessary token use. This could be combined with custom word-list overrides and a function-level white/blacklist system (include function: always / if keyword present / never) that allows for individual customization through environmental variables. Great thanks for the development work so far 👍 |
Beta Was this translation helpful? Give feedback.
-
|
Hey @jnaskali thanks for your feedback!
This is not feasible imo. Imagine a plugin that integrates Wolfram Alpha, the list of keywords would be endless. Or a follow up questions about the weather in a city: The current model is great at detecting the need of function calling in these kind of contexts, and we should not aim to replace it, imo. |
Beta Was this translation helpful? Give feedback.
-
|
For some reason, I thought it would be more interesting if the plugins will be dynamic. What I'm getting at, for example - I would like to connect some of my service to GPT, while using the original branch of the bot, what would update to new versions, and so on. Make some class that will have basic functionality, from this class will be created "function call plugins". And then it will be possible to make 2 classes divided by convention: I believe that this approach will have more features and be more understandable. How do you look at it? |
Beta Was this translation helpful? Give feedback.
-
|
Hey @stanislavlysenko0912 thanks for sharing your thoughts!
I agree this would be great. The bot should be able to directly send text/photos/videos/audios/files after a function call |
Beta Was this translation helpful? Give feedback.
-
If I understood you correctly, the second category would be custom bot commands. You can already add these in using these instructions: #334 |
Beta Was this translation helpful? Give feedback.
-
|
That's a little different from what I was talking about. In my opinion it would expand the functionality of such "plugins", conventionally downloading some files or something else. |
Beta Was this translation helpful? Give feedback.
-
|
A simple example, the first thing that came to mind and that I was able to quickly implement This is just my suggestion, but the idea that at least move the plugins to dynamic loading from a folder I would definitely like 
|
Beta Was this translation helpful? Give feedback.
-
|
That's actually a nice idea! Could you share the snippet you used to create the screenshot of the web page? |
Beta Was this translation helpful? Give feedback.
-
|
This was done quickly with Selenium as a little test, sure you want to add his addiction to the bot? Although there probably isn't any other way to do it if you only make do with Python dependencies. |
Beta Was this translation helpful? Give feedback.
-
|
June 17th update: Improved various things and added more PoC plugins (web search, wolfram alpha, crypto rates).
|
Beta Was this translation helpful? Give feedback.
-
|
Yes! Works pretty well (assuming the top results are correct) |
Beta Was this translation helpful? Give feedback.
-
|
im testing it rn, when you don't use a plugin in PLUGINS, it will still look for the required plugin fields which causes error |
Beta Was this translation helpful? Give feedback.
-
|
@bentacos sorry I don't get it, could you elaborate? |
Beta Was this translation helpful? Give feedback.
-
|
for example, i used this: PLUGINS=weather,crypto,wolfram,web_search when i run the script, it will show errors looking for the spotify credentials |
Beta Was this translation helpful? Give feedback.
-
|
@bentacos Fixed! Thanks for reporting |
Beta Was this translation helpful? Give feedback.
-
|
June 19th update: Various improvments and added a PoC Spotify plugin. Demo: 
Uses spotipy. Requires |
Beta Was this translation helpful? Give feedback.
-
|
so, if a user asks "what is the song currently playing?" will they get a result from the admin's Spotify account? |
Beta Was this translation helpful? Give feedback.
-
|
as of right now, yeah |
Beta Was this translation helpful? Give feedback.
-
|
When I use spotify, it prompts "Paste that url you were directed to to complete the authorization", but it doesn't give me a chance to paste that url and then throw an error directly. How to fix this problem? |
Beta Was this translation helpful? Give feedback.
-
|
June 22nd update:
|
Beta Was this translation helpful? Give feedback.
-
|
is the interpreter included in the branch? i would like to test it. |
Beta Was this translation helpful? Give feedback.
-
|
@noriellecruz it's not, but here's the plugin I originally wrote: class PythonPlugin(Plugin):
"""
A plugin to act as a python interpreter
"""
def get_source_name(self) -> str:
return "Python"
def get_spec(self) -> [Dict]:
return [{
"name": "python",
"description": "Run python code. Refuse to run any dangerous code that touches the filesystem.",
"parameters": {
"type": "object",
"properties": {
"code": {"type": "string", "description": "Code to run. Should end with a print statement"}
},
"required": ["code"],
},
}]
async def execute(self, function_name, **kwargs) -> Dict:
code = kwargs['code']
try:
sys.stdout = StringIO()
exec(code, globals())
output = sys.stdout.getvalue().strip()
if not output:
lines = code.strip().splitlines()
last_line = lines[-1]
last_expression = eval(last_line, globals(), locals())
output = str(last_expression)
return {"output": output}
except Exception as e:
return {"error": str(e)}
finally:
sys.stdout = sys.__stdout__ |
Beta Was this translation helpful? Give feedback.
-
|
Excelente work @n3d1117! May I ask if we provide a link to a PDF on the prompt, its possible that the bot read it a response with information about the PDF? |
Beta Was this translation helpful? Give feedback.
-
|
Yes, I was planning on building this! The hardest part is finding some free time 😃 |
Beta Was this translation helpful? Give feedback.
-
|
I would like to help you, but i dont know python right now :c , im going to study this months, maybe i can help later. Thanks for the great job |
Beta Was this translation helpful? Give feedback.
-
|
i added a plugin to get time based on location or timezone #360
requires |
Beta Was this translation helpful? Give feedback.
-
|
July 2nd update:
|
Beta Was this translation helpful? Give feedback.
-
|
July 3rd update:
Known limitations:
Example of direct response: # In your plugin
async def execute(self, function_name, **kwargs) -> Dict:
# do your stuff here
return {
'direct_result': {
'kind': 'photo', # currently supported: photo, gif, file, dice
'format': 'url', # currently supported: url, path
'value': 'http://...' # the actual value for the content. can be a string, a url or a path to a local file
}
}Currently supported direct responses:
Check out the Demo: |
Beta Was this translation helpful? Give feedback.
-
|
Audio extractor doesnt work sometimes because the titles of some videos use symbols that are invalid as a filename. |
Beta Was this translation helpful? Give feedback.
-
|
Fixed! Thanks @Celegans12 |
Beta Was this translation helpful? Give feedback.
-
|
July 5th update:
|
Beta Was this translation helpful? Give feedback.
-
|
Hello! I just admire you! Thank you for your work! Please tell me how I can change the following things in the bot: 1. i cannot change the first prompt. I enter my own version in the env file, but for some reason it doesn't work. and 2 question: how can I remove the initial message that lists the commands? I need so that a person starts the bot, and the answer to the given prompt immediately comes out? |
Beta Was this translation helpful? Give feedback.
-
|
hire someone to do that for you |
Beta Was this translation helpful? Give feedback.
-
|
Hi @Annagrenadin apologies for the late reply.
async def help(self, update: Update, _: ContextTypes.DEFAULT_TYPE) -> None:
with update.message._unfrozen() as message:
message.text = "Hello" # or anything, really
await self.prompt(update=update, context=context) |
Beta Was this translation helpful? Give feedback.
-
|
Thank you very much!❤️❤️❤️ |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
Sure, just run |
Beta Was this translation helpful? Give feedback.
-
|
Great job @n3d1117. I like it. Is it possible to add and train a chatbot on your own thematic knowledge base (for example: text files, websites, FAQs). Maybe there is a script for such a specific bot? |
Beta Was this translation helpful? Give feedback.
-
|
It's definitely possible! Check out https://www.chatpdf.com and https://vault.pash.city |
Beta Was this translation helpful? Give feedback.
-
|
July 28th update:
|
Beta Was this translation helpful? Give feedback.
-
|
Are you planning to add the ability to retrain the bot based on data from the Internet or downloaded files? |
Beta Was this translation helpful? Give feedback.
-
|
It's possible, but not planned for the upcoming release |
Beta Was this translation helpful? Give feedback.
-
|
Seems to work well. Only the default voice in German sounds very artificial. Is there a possibility to use a different gtts voice? |
Beta Was this translation helpful? Give feedback.
-
|
It does not, as far as I know. Here's the gtts repo |
Beta Was this translation helpful? Give feedback.
-
Help me in adding useful functions to the bot!
What are functions?
Check out the blog post announcing the feature. TLDR:
Current implementation
PoC of a few plugins:
Check out the
feature/support-functionsbranch containing initial support for functions and some initial functions:WOLFRAM_APP_ID)SPOTIFY_CLIENT_ID,SPOTIFY_REDIRECT_URI,SPOTIFY_CLIENT_SECRETSee the full list in the README.
To enable any of these plugins, set them in the
PLUGINSvariable as a comma separated list (e.g:PLUGINS=weather,crypto,wolfram,spotify,ddg_web_search,ddg_image_search,ddg_translate).Set
SHOW_PLUGINS_USEDtotrueto show which plugins were used in generating a response, if any.Some key points:
gpt-3.5-turbo-0613,gpt-3.5-turbo-16k,gpt-3.5-turbo-16k-0613,gpt-4-0613,gpt-4-32k-0613). Stable models (gpt-3.5-turbo,gpt-4,gpt-4-32k) will be updated to support functions on June 27, 2023. If you want to try out functions right now, specify one of the new models (e.g.OPENAI_MODEL=gpt-3.5-turbo-0613)FUNCTIONS_MAX_CONSECUTIVE_CALLSto control the maximum number of consecutive calls to be made across all functions when generating a single response. It currently defaults to 10.plugins/crypto.pyfile for a quick example. If you want to add your own function, simply create a .py file in thepluginsfolder subclassing thePluginabstract class, and update thefunctions.pyfile accordingly by registering your own plugin. Don't forget to enable it in your .env file, e.gPLUGINS=your-own-pluginGoing forward
The plan is to add many more useful functions to the bot before drafting a new release. Your help is appreciated!
If you have any questions, cool ideas, utilities, services or APIs that you'd like to see integrated, please comment here or open a PR to the
feature/support-functionsbranch!I'm also looking for feedback regarding token usage. Since functions count as input tokens, the more we add the more requests become more expensive. Should functions be loaded on-demand only (i.e. user first selects a function and then uses it)?
Beta Was this translation helpful? Give feedback.
All reactions