Skip to content

Latest commit

 

History

History
27 lines (22 loc) · 640 Bytes

README.md

File metadata and controls

27 lines (22 loc) · 640 Bytes
Raw

llamash

RESTful API Bridge for Ollama.

Build and Run

$ go build .
$ ./llamash

Setup

Before starting the bridge server, you need a running Ollama server which the address is http://127.0.0.1:11434 in default.

$ podman run --network host ollama serve
$ ./llamash -p 11444 -i 'http://127.0.0.1:11434'

Enjoy it!

$ curl 'http://127.0.0.1:11444/generate?model=codellama&prompt=sayhi'

GET Form:

  • generate Generate content.
    • model The LLaMA model you gonna use.
    • prompt The content will send to the model.

Responds in pure text.