Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assistant message generation error #98

Open
luolin-ai opened this issue Apr 7, 2024 · 3 comments
Open

Assistant message generation error #98

luolin-ai opened this issue Apr 7, 2024 · 3 comments
Assignees
Labels
question Further information is requested

Comments

@luolin-ai
Copy link

image

@jameszyao jameszyao changed the title { "object": "Error", "code": "GENERATION_ERROR", "message": "Error on calling provider model API: {'error': {'message': \"Invalid parameter: 'tool_calls' cannot be used when 'functions' are present. Please use 'tools' instead of 'functions'. (request id: 2024040800503063673392944022805)\", 'type': 'invalid_request_error', 'param': 'messages.[1].tool_calls', 'code': None}}" } Assistant message generation error Apr 7, 2024
@jameszyao jameszyao added the question Further information is requested label Apr 7, 2024
@SimsonW
Copy link
Contributor

SimsonW commented Apr 8, 2024

Can you provide the steps to reproduce the issue?

@tungnkhust
Copy link

tungnkhust commented Apr 8, 2024

I have the same error when i integrate model with litellm: https://litellm.ai/
Screenshot from 2024-04-08 09-42-08

@SimsonW
Copy link
Contributor

SimsonW commented Apr 8, 2024

image
I think this error might have occurred due to selecting the wrong type when choosing a custom host model. Because currently, some LLMs use the 'tool_calls' mode for utility invocation, while others use 'function_call'. Did you select the correct type when creating your custom host model?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants