Skip to content

Commit

Permalink
add docker info
Browse files Browse the repository at this point in the history
  • Loading branch information
bigsk1 committed Jun 21, 2024
1 parent 2218481 commit 6abad21
Show file tree
Hide file tree
Showing 2 changed files with 24 additions and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Use the official NVIDIA CUDA base image
# Use the official NVIDIA CUDA base image - This total image is huge 40 gb when completly built - use at your own risk!
FROM nvidia/cuda:12.4.1-cudnn-devel-ubuntu22.04

# Set environment variables
Expand Down
23 changes: 23 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -117,6 +117,29 @@ wget https://github.com/bigsk1/voice-chat-ai/releases/download/models/XTTS-v2.zi
unzip XTTS-v2.zip -d .
```

## Docker - Experimental

This image is huge when built because of all the checkpoints, base image, build tools and audio tools - 40gb - there maybe a way to get it smaller I haven't tried yet

Docker run command allows you to use microphone in docker container

```bash
docker build -t voice-chat-ai .
```
On windows docker desktop using wsl - run in windows

```bash
wsl docker run -d --gpus all -e "PULSE_SERVER=/mnt/wslg/PulseServer" -v /mnt/wslg/:/mnt/wslg/ --env-file .env --name voice-chat-ai -p 8000:8000 voice-chat-ai:latest
```

Running from wsl

```bash
docker run -d --gpus all -e "PULSE_SERVER=/mnt/wslg/PulseServer" -v \\wsl$\Ubuntu\mnt\wslg:/mnt/wslg/ --env-file .env --name voice-chat-ai -p 8000:8000 voice-chat-ai:latest
```

In the docker folder there is also some scripts to update the model and tts provider into the container, so you can change from openai to ollama and back again if you like, instead of exec into the container and making changes manually.

## Configuration

1. Rename the .env.sample to `.env` in the root directory of the project and configure it with the necessary environment variables: - The app is controlled based on the variables you add.
Expand Down

0 comments on commit 6abad21

Please sign in to comment.