Awesome-RAG

• Topics
  • General
    • Patterns
  • Routing
  • LLM Models
    • Finetuning and Pretraining
  • Retrieval
    • Chunking
    • Search
  • Prompts
    • Prompting strategies
      • Multi-Modal RAG
      • Multi-index RAG
      • Multi-Document
      • FLARE
      • Chain-of-Verification
    • Automated prompt optimization
    • Context
      • Long context RAG
      • Knowledge and Knowledge Graphs
  • Generation
    • Hallucination
    • Guardrails
  • Evaluation
  • Performance and cost
  • Privacy
  • Security
    • Overloading context
    • Injections
• Series
• Sandbox
• Tools
• Vendor-specific examples
  • Elastcisearch + OpenAI
  • Vespa
  • Qdrant

Topics

General

• Retrieval Augmented Generation — Intuitively and Exhaustively Explained

Patterns

• Generative AI Lifecycle Patterns
• Why do RAG pipelines fail? Advanced RAG Patterns — Part1 Ozgur Guler
• How to improve RAG peformance — Advanced RAG Patterns — Part2
• Patterns for Building LLM-based Systems & Products
• AI Engineer Summit - Building Blocks for LLM Systems & Products
• Technical Considerations for Complex RAG

Routing

• Routing in RAG-Driven Applications

LLM Models

Finetuning and Pretraining

• Fine-Tuning Llama 2.0 with Single GPU Magic
• Practitioners guide to fine-tune LLMs for domain-specific use case
• Are You Pre-training your RAG Models on Your Raw Text?
• Combine Multiple LoRA Adapters for Llama 2

Retrieval

• Boosting RAG: Picking the Best Embedding & Reranker models
• Improving RAG (Retrieval Augmented Generation) Answer Quality with Re-ranker
• From Search to Synthesis: Enhancing RAG with BM25 and Reciprocal Rank Fusion
• Build a search engine, not a vector DB

Chunking

• Chunking Strategies for LLM Applications
• Evaluating the Ideal Chunk Size for a RAG System using LlamaIndex
• How to Chunk Text Data — A Comparative Analysis

Search

• Awesome Search
• Advanced RAG Retrieval Strategies: Sentence Window Retrieval

Prompts

• Emerging RAG & Prompt Engineering Architectures for LLMs
• How to Cut RAG Costs by 80% Using Prompt Compression

Prompting strategies

Multi-Modal RAG

• Multi-Modal RAG

Multi-index RAG

• Having all of your data stored in one collection isn't always the best for RAG apps

Multi-Document

• Advanced RAG — Multi-Documents Agent with LlamaIndex

FLARE

• Better RAG with Active Retrieval Augmented Generation FLARE

Chain-of-Verification

• in-Of-Verification Reduces Hallucination in LLMs

Chain-Of-Thought

• Chain-Of-Thought Prompting In LLMs

Context

• The Needle In a Haystack Test
• Conversational Memory for LLMs with Langchain

Long context RAG

• The next generation of RAG: Long-Context RAG
• NVIDIA Research: RAG with Long Context LLMs

Knowledge and Knowledge Graphs

• Graph RAG: Unleashing the Power of Knowledge Graphs with LLM

• Embeddings + Knowledge Graphs: The Ultimate Tools for RAG Systems

• The Practical Benefits to Grounding an LLM in a Knowledge Graph Daniel Bukowski

• Implement RAG with Knowledge Graph and Llama-Index

• Awesome Knowledge Graphs

Generation

Hallucination

• How to Detect Hallucinations in LLMs
• Measuring Hallucinations in RAG Systems

Guardrails

• Safeguarding LLMs with Guardrails
• NeMo Guardrails: The Missing Manual

Evaluation

• RAG Evaluation
• Evaluating RAG: A journey through metrics

Performance and cost

• Secrets to Optimizing RAG LLM Apps for Better Performance, Accuracy and Lower Costs!

Various

• Vector Search Is Not All You Need
• Improve RAG Pipelines With These 3 Indexing Methods

Security

• Hijacking Chatbots: Dangerous Methods Manipulating GPTs

Series

Heiko Hotz

• RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application?

Kelvin Lu

• Compare PDF Question Answering Systems Build with OpenAI and Google VertexAI
• What We Need to Know Before Adopting a Vector Database
• Disadvantages of RAG

Wenqi Glantz

Building

• Building Production-Ready LLM Apps with LlamaIndex: Document Metadata for Higher Accuracy Retrieval
• Building Production-Ready LLM Apps With LlamaIndex: Recursive Document Agents for Dynamic Retrieval

Evaluation

• Exploring End-to-End Evaluation of RAG Pipelines
• Evaluation Driven Development, the Swiss Army Knife for RAG Pipelines

Privacy

• Masking PII Data in RAG Pipeline

Ravi Theja

Evaluation

• Evaluating the Ideal Chunk Size for a RAG System using LlamaIndex

Tools

• Langchain is NOT for production use. Here is why ..
• Three Open-Source RAG Tools You Need to Know About
• LlamaIndex
• Langchain

Vendor-specific examples

• RAG Pipeline with Mistral 7B Instruct Model in Colab: A Step-by-Step Guide Qendel AI GoPenAI
• Hands-On RAG guide for personal data with Vespa and LLamaIndex

Sandbox

• Innovations In Retrieval Augmented Generation
• Automating Hyperparameter Tuning with LlamaIndex. Exploring ParamTuner for RAG pipelines
• A Guide on 12 Tuning Strategies for Production-Ready RAG Applications
• Structured Knowledge Extraction: from DbPedia Queries to Llama Index Knowledge Graphs
• The Power of Retrieval Augmented Generation: A Comparison between Base and RAG LLMs with Llama2
• How to Build Long-term Corporate Memory for Your Organisation Using ChatGPT