-
Notifications
You must be signed in to change notification settings - Fork 959
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
本地部署后,运行很慢啊 #1245
Comments
你模型使用的是哪个?可以看一下GPU的显存使用情况。感觉你部署的使用的是CPU.所以感觉很慢。 |
直接 git clone https://github.com/QwenLM/Qwen-7B.git 。不知道是哪个版本,我的显卡是rtx3060 ,没被使用。磁盘io非常高 |
我是使用的docker部署的。没有直接clone代码。可以使用Ollama部署Qwen模型,挺方便的 |
As Qwen1.0 is no longer actively maintained, we kindly ask to you migrate to Qwen1.5 and direct your related question there. Thanks for you cooperation. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?
当前行为 | Current Behavior
本地部署后,cpu和磁盘占用率过高。chatbot聊天 1分钟出一个字。什么原因啊?
The text was updated successfully, but these errors were encountered: