A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

This is an AI-Gemini Chatbot LLM And Large Image Model Application. You can use this project run into local and ask you images like your talking with in realtime

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

A high-throughput and memory-efficient inference and serving engine for LLMs

Evaluation and Tracking for LLM Experiments

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

Build AI Assistants with memory, knowledge and tools.

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

AI_Research_Junction@Aditi_Khare - Research Papers Summaries Capturing Latest advancements in Generative AI, Quantum AI and Computer Vision

Empower Your Productivity with Local AI Assistants

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.

Stateful load balancer custom-tailored for llama.cpp

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

AI Observability & Evaluation

An open-source visual programming environment for battle-testing prompts to LLMs.