-
Notifications
You must be signed in to change notification settings - Fork 34
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
(Feature Request) Assistant prefill for Anthropic models #216
Labels
enhancement
New feature or request
Comments
Thanks for bringing this up @maeeeeee! It looks like this might be possible to implement across all LLMs so I will aim to include this in the next release |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Per Anthropic docs, Claude models support adding a prefill that allows you to determine the beginning of the model's response. Adding support for this in Mantella would go a huge way in being able to reduce rejections and filtering; in my experience, something as simple as "Certainly, here's my response: " does wonders.
The text was updated successfully, but these errors were encountered: