-
Updated
Jun 14, 2023 - Jupyter Notebook
llm-serving
Here are 52 public repositories matching this topic...
Deploy and Scale LLM-based applications
-
Updated
Jun 15, 2023 - Jupyter Notebook
Ray and Anyscale for UC Berkeley AI Hackathon!
-
Updated
Jun 17, 2023 - Jupyter Notebook
-
Updated
Jul 5, 2023 - Python
Hinglish Chatbot powered by Azure Cognitive Services, Google Translate and Open AI
-
Updated
Jul 11, 2023 - Jupyter Notebook
An Easy-to-use Knowledge Editing Framework for LLMs.
-
Updated
Aug 24, 2023 - Jupyter Notebook
A framework for few-shot evaluation of autoregressive language models.
-
Updated
Sep 30, 2023 - Python
Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization
-
Updated
Oct 10, 2023
Finetune LLMs on K8s by using Runbooks
-
Updated
Nov 21, 2023 - Go
This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.
-
Updated
Dec 4, 2023 - Jupyter Notebook
You can run any large language model on your local machine with this repository.
-
Updated
Dec 19, 2023 - Python
internet llm - access your ollama (or any other local llm) instance from across the internet
-
Updated
Dec 31, 2023 - Go
Efficient AI Inference & Serving
-
Updated
Jan 8, 2024 - Python
A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App
-
Updated
Jan 8, 2024 - Python
Automating the deployment of the Takeoff Server on AWS for LLMs
-
Updated
Jan 16, 2024 - Python
Streaming of LLM responses in realtime using Fastapi and Streamlit.
-
Updated
Jan 21, 2024 - Python
A guide on how to run LLMs on intel CPUs
-
Updated
Jan 23, 2024 - Python
Deep learning environment setups
-
Updated
Jan 24, 2024 - Shell
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
-
Updated
Feb 5, 2024 - Python
-
Updated
Apr 3, 2024 - Astro
Improve this page
Add a description, image, and links to the llm-serving topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-serving topic, visit your repo's landing page and select "manage topics."