3 Day RAG Roadmap: Understanding, Building and Evaluating RAG Systems 2024
Retrieval Augmented Generation (RAG) has become a popular application of LLMs recently, with significant progress made in just a few months. Its popularity stems from its lightweight nature and the ease with which it can be integrated with any LLM. To help you get acquainted with RAG, we have put together a 3-day learning plan.
This guide will introduce you to the fundamentals, show you how to develop applications, delve into advanced functionalities, and teach you how to assess RAG applications. Plan to spend about 2-3 hours each day on the provided materials.
Happy Learning!
Day 1: Introduction to RAG
Watch these videos:
- Explanation of RAG by
DeepLearning.AI
(
link
)
Read these resources:
- What is RAG by DataStax (
link
)
- Retrieval-Augmented Generation (RAG) from basics to advanced by Tejpal Kumawat (
link
)
Day 2: Advanced RAG + Build Your Own RAG System
Watch these videos:
- Advanced RAG series (6 videos) by Sam Witteveen (
link
)
- LangChain101: Question A 300 Page Book (w/ OpenAI + Pinecone) by Greg Kamradt (
link
)
Read these resources:
- Blog on advanced RAG techniques by Akash (
link
)
- RAG hands-on tutorials on GitHub(
link
)
Day 3: RAG Evaluation and Challenges
Watch these videos:
- LlamaIndex Sessions: 12 RAG Pain Points and Solutions (
link
)
- Building and Evaluating Advanced RAG Applications by
DeepLearning.AI
(
link
)
- Challenges with Naive RAG & How to Evaluate RAG Applications? by ActiveLoop (
link
)
Read these resources:
- 12 RAG Pain Points and Solutions article(
link
)
- RAGas core concepts for evaluating RAG(
link
)
Optional Resources to Read
- Week 4 content from Applied LLMs mastery course on RAG (
link
)
- “Seven Failure Points When Engineering a Retrieval Augmented
Generation System” paper(
link
)
- “Retrieval-Augmented Generation for Large Language Models: A Survey” paper(
link
)
- RAG description and available tools on Huggingface(
link
)
- Original RAG paper "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks” (
link
)
Latest RAG Research from 2023-2024