LocalAI do not support GPU

[kewaike]

First of all, thank you very much for this great product.

I used docker-compose ，Build with CUDA，The compilation process is normal，but when LocalAI loads models ，Issue happend :
CUDA：false

Nvidia Driver and tookit are installed correctly，
.env file：

docker-compose.yaml file：

in container ：

docker-compose.yaml file：

System Information：
OS：CentOS7.9

I also installed stablediffusion （build，not docker），it works well with gpu .

thanks

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

Sources:

• https://localai.io/basics/build/index.html
• https://localai.io/basics/getting_started/index.html
• https://localai.io/howtos/easy-setup-docker-gpu/index.html

[Aisuko]

Thanks for your feedback. We have been created an issue for you. #1218. And I will close this discussion.

[saket424]

@kewaike @Aisuko Any resolution on this issue?