⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

High-level, optionally asynchronous Rust bindings to llama.cpp

Rust bindings for whisper.cpp

Query CPU and GPU memory information in a portable way.

Edgen client library for node / typescript

Python client for the Edgen API