Skip to content

日志显示llm device和embedding device为cuda,但实际跑的时候显卡没吃到,全由cpu在运行。 #1022

Closed Unanswered
moy-xz asked this question in Q&A
Discussion options

You must be logged in to vote

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
3 participants