New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GPU is not available #3972
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello everyone.
First of all, I'm very new to training and fine-tuning LLMs, so my problem could be very straight forward (or not). Also forgive me in andvance for not knowing stuff.
System:
Windows 11
Python 3.10
Ludwig 0.10
I created a virtual environment locally and then pip installed ludwig. My propertys.yaml file also seems to cause no issue, as the model loads just fine.
I tried to model.generate() on a locally downloaded model from HF, just to see if it generates some kind of output. But I only get this error:
Do I have a problem with bitsandbytes? Or is it torch?
torch.cuda.is_available()
also returns false.Or do I have to create an Anaconda3 environment? I tested it there and installed pytorch via conda install and then
torch.cuda.is_available()
returns true. But Ludwig seems to not work in this environment.(?)I am thankfull for any help. My goal is to get this thing at least running.
The text was updated successfully, but these errors were encountered: