Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ray模式是否支持自定义工具调用? #448

Open
2 tasks done
supercocoa opened this issue May 20, 2024 · 2 comments
Open
2 tasks done

ray模式是否支持自定义工具调用? #448

supercocoa opened this issue May 20, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@supercocoa
Copy link

Initial Checks

  • I have searched Google & GitHub for similar requests and couldn't find anything
  • I have read and followed the docs & demos and still think this feature is missing

Description

看register_tool的代码 TOOL_REGISTRY = ToolRegistry() 里好像没有用ray去构建,那用ray去构建agent是否或者如何支持自定义工具调用?

Use case

No response

@supercocoa supercocoa added the enhancement New feature or request label May 20, 2024
@zzhangpurdue
Copy link
Collaborator

tool暂时还不支持在ray中执行,目前有multi-agent场景让多agent在ray中执行,以及tool在docker service中执行的支持(modelscope-agent-servers),后续看具体场景中是否有一定用ray执行tool的必要行。
感谢提供意见,用ray执行tool的优势具体有哪些,能否提供一些思路,我们也好做调研。

@supercocoa
Copy link
Author

就是正常的agent调tool的需求,multi-agent每个agent也会有自己的tool,场景比如tool是动态注册到TOOL_REGISTRY,目前agent在ray里跑可能和TOOL_REGISTRY元数据不在一个进程,那agent可能就用不了tool了吧

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants