-
-
Notifications
You must be signed in to change notification settings - Fork 681
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to change output behaivor? #86
Comments
你可以考虑使用 RWKV 的 pip 包。
from rwkv.model import RWKV
from rwkv.utils import PIPELINE
model = RWKV("path_to_your_model", "cuda fp16i8")
pipeline = PIPELINE(model, "20B_tokenizer.json")
output = pipeline.generate("your_text") |
类似于这样可以吗? 多轮对话:
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Great work!
I want to make a api server of these, any way to change output behaivor from output char one by one to output all char when generate done? thanks.
The text was updated successfully, but these errors were encountered: