A generalized information-seeking agent system with Large Language Models (LLMs).

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Use your locally running AI models to assist you in your web browsing

Run MemGPT-AutoGEN-Local LLM Together

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

A nifty little library for working with Ollama in Elixir.

Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.

Run gguf LLM models in Latest Version TextGen-webui

This started out as a POC for chatting over my documents, but has turned into a whole framework for using LLMs.

Read your local files and answer your queries

Local, customizable, open-sourced role-play app.

Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

This projects build a local retrieval augmented generation (pipeline) from scratch, connects it to a local llm, and is deployed as a chatbot via Gradio.

Slack bot that integrates local LLM into your workflows

ScrAIbe Assistant is designed to leverage Whisper for precise audio processing and local LLMs via Ollama for efficient summarization. This tool is perfect for tasks such as taking notes from team meetings or lectures, offering a secure environment where no data—be it text, audio, or otherwise—leaves your local machine.

An experimental local web search engine assistant frontend and CLI for ollama and llama.cpp with a focus on being extremely lightweight and easy to run. The goal is to provide something along the lines of a minimalist Perplexity.

Tiny Starcoder LLM Implementation, added to commands

BgGPT for Jan 👋