Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Feature Request) Assistant prefill for Anthropic models #216

Open
maeeeeee opened this issue Apr 6, 2024 · 1 comment · May be fixed by #223
Open

(Feature Request) Assistant prefill for Anthropic models #216

maeeeeee opened this issue Apr 6, 2024 · 1 comment · May be fixed by #223
Assignees
Labels
enhancement New feature or request

Comments

@maeeeeee
Copy link

maeeeeee commented Apr 6, 2024

Per Anthropic docs, Claude models support adding a prefill that allows you to determine the beginning of the model's response. Adding support for this in Mantella would go a huge way in being able to reduce rejections and filtering; in my experience, something as simple as "Certainly, here's my response: " does wonders.

@art-from-the-machine art-from-the-machine self-assigned this Apr 9, 2024
@art-from-the-machine
Copy link
Owner

Thanks for bringing this up @maeeeeee! It looks like this might be possible to implement across all LLMs so I will aim to include this in the next release

@art-from-the-machine art-from-the-machine linked a pull request Apr 9, 2024 that will close this issue
@art-from-the-machine art-from-the-machine linked a pull request Apr 9, 2024 that will close this issue
@art-from-the-machine art-from-the-machine added the enhancement New feature or request label Apr 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants