v0.2.21

Highlights

• New feature from research: AgentOptimizer
  • Blog
  • Notebook
• New feature in code execution: Support user defined functions in local CLI executor - similar functionality to the "skills" in AutoGen Studio.
• New agent capability: Vision Capability for ConversableAgents allows them to "see" images.
• New IOStream protocol and support for web sockets!
• New custom model: Mistral AI API with native tool call support. conversational chess game powered by mistral
• New benchmarking tool: WebArena. Run agents in the WebArena benchmark.
• Doc improvement
  • Tutorial about tool use
  • Simplified quick start
  • Link to notebook rendering
• Other improvements such as silencing pip install messages, parsing HTML style tags, getting list of actors from directory service.

Thanks to @skzhang1 @jackgerrits @BeibinLi @davorrunje @ekzhu @olgavrou @WaelKarkoub @rajan-chari @eltociear @jamesliu @shouldnotappearcalm and all the other contributors!

What's Changed

• Fix link in non-openai model doc by @ekzhu in #2106
• mypy in pre-commit fixed by @davorrunje in #2117
• Silences Pip Install Messages in Code Executors by @WaelKarkoub in #2105
• Update agentchat_nestedchat_optiguide.ipynb by @eltociear in #2122
• Removing tool use from Use-Cases/agent_chat by @ekzhu in #2120
• Update docs for new executors by @ekzhu in #2119
• missing jupyter when import JupyterCodeExecutor by @jamesliu in #2132
• Add vision capability by @BeibinLi in #2025
• Native tool call support for Mistral AI API and topic notebook. by @ekzhu in #2135
• New conversational chess notebook using nested chats and tool use by @ekzhu in #2137
• add webarena in samples by @olgavrou in #2114
• context to kwargs by @qingyun-wu in #2064
• Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /website by @dependabot in #2131
• Parse Any HTML-esh Style Tags by @WaelKarkoub in #2046
• Integrate AgentOptimizer by @skzhang1 in #1767
• Introducing IOStream protocol and adding support for websockets by @davorrunje in #1551
• [CAP] [Feature] Get list of actors from directory service. by @rajan-chari in #2073
• Mark cache as a protocol and update type hints to reflect by @jackgerrits in #2168
• fix(): fix word spelling errors by @shouldnotappearcalm in #2171
• Implement User Defined Functions for Local CLI Executor by @jackgerrits in #2102
• simplify getting-started; update news by @sonichi in #2175
• update AgentOptimizer docs by @skzhang1 in #2178
• Fix formatting of admonitions in udf docs by @jackgerrits in #2188
• Fix iostream on new thread by @davorrunje in #2181
• Add link for rendering notebooks docs on website by @jackgerrits in #2191

New Contributors

• @jamesliu made their first contribution in #2132
• @shouldnotappearcalm made their first contribution in #2171

Full Changelog: v0.2.20...v0.2.21