Skip to content

Commit

Permalink
Merge pull request #684 from dpresbit/patch-1
Browse files Browse the repository at this point in the history
Update README.md
  • Loading branch information
PromtEngineer committed Dec 19, 2023
2 parents d30aaef + f2c7409 commit 77488a4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Expand Up @@ -85,7 +85,7 @@ For more details, please refer to [llama-cpp](https://github.com/abetlen/llama-c
Installing the required packages for GPU inference on NVIDIA GPUs, like gcc 11 and CUDA 11, may cause conflicts with other packages in your system.
As an alternative to Conda, you can use Docker with the provided Dockerfile.
It includes CUDA, your system just needs Docker, BuildKit, your NVIDIA GPU driver and the NVIDIA container toolkit.
Build as `docker build . -t localgpt`, requires BuildKit.
Build as `docker build -t localgpt .`, requires BuildKit.
Docker BuildKit does not support GPU during *docker build* time right now, only during *docker run*.
Run as `docker run -it --mount src="$HOME/.cache",target=/root/.cache,type=bind --gpus=all localgpt`.

Expand Down

0 comments on commit 77488a4

Please sign in to comment.