AMD GPU issues

[QwertyITA]

When trying to use this with an AMD GPU it doesn't work, as it says that it is trying to search for an NVIDIA GPU

[superintendent2521]

yes. You could try with zluda, no idea if it works. on the otherhand, depending on how much vram you have you could host a llm for the horde on koboldccps rocm fork