-
Notifications
You must be signed in to change notification settings - Fork 904
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Min P generation parameter #1885
Comments
How have you implemented this locally? I'm seeking to do the same , would appreciate some guidance :) @LawrenceGrigoryan |
@avacaondata Then go over a ton of files and add the After you done that, just build the image with the default If you have any further questions, feel free to ask :) |
Feature request
Hey! I've noticed that
min_p
parameter is now available in transformers but haven't found it in TGI. Are you planning to add it in the nearest future?The parameter itself is very well described here
I have implemented it in TGI for myself locally and I would be glad to contribute by submitting a PR :)
The text was updated successfully, but these errors were encountered: