New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Low CPU, Low Memory, Low GPU usage via Docker #452
Comments
ugmqu
changed the title
Low CPU, Low Memory, Low GPU using Docker
Low CPU, Low Memory, Low GPU usage via Docker
May 22, 2023
Can yu confirm that project via docker is working? if yes what step you take to solve that issue |
Same here on my MacBook Pro (Apple M1 Pro) with Mac OS Monterey (12.6.3). I selected "ai-dialog" template from web ui and clicked "Go". Now it's running for hours. With
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I installed the project via docker.
An simnple prompt does not compute after an hour. Tried Alpaca 7B and 13B on both Windows and Ubuntu via Docker.
I have the assumption the project runs on super low resources for some reason.
"docker stats" gives me the following output with the container running and an active prompt beeing processed:
The text was updated successfully, but these errors were encountered: