Skip to content

Commit

Permalink
Update readme regarding locally running model servers
Browse files Browse the repository at this point in the history
  • Loading branch information
ad-si committed Apr 14, 2024
1 parent 361b75b commit 991192e
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,9 +36,11 @@ Cai supports the following APIs:
- **OpenAI** - [Create new API key](https://platform.openai.com/api-keys).
- **Anthropic** -
[Create new API key](https://console.anthropic.com/settings/keys).
- **localhost:8080** - Any OpenAI API compatible local server (E.g. [llamafile])
- **Llamafile** - Local [Llamafile] server running at http://localhost:8080.
- **Ollama** - Local [Ollama] server running at http://localhost:11434.

[llamafile]: https://github.com/Mozilla-Ocho/llamafile
[Llamafile]: https://github.com/Mozilla-Ocho/llamafile
[Ollama]: https://github.com/ollama/ollama

Afterwards, you can use `cai` to run prompts directly from the terminal:

Expand Down

0 comments on commit 991192e

Please sign in to comment.