Week 7: Advanced RAG
Self-RAG, CRAG, RAPTOR, agentic retrieval
Week 7 of 12
Learning Objectives
- Implement Self-RAG with reflection
- Build corrective retrieval systems
- Compare RAG strategies
Topics Covered
- Self-RAG architecture
- Corrective RAG (CRAG)
- RAPTOR hierarchical retrieval
- Adaptive retrieval strategies
Resources
Jupyter Notebooks
Required Readings
| Paper | Authors | Year | Link |
|---|---|---|---|
| Self-RAG: Learning to Retrieve, Generate, and Critique | Asai et al. | 2023 | arXiv |
| Corrective Retrieval Augmented Generation | Yan et al. | 2024 | arXiv |
Reading Guide: Advanced RAG
Study of Self-RAG, CRAG, and adaptive retrieval strategies
Primary Paper
Self-RAG: Learning to Retrieve, Generate, and Critique
Asai, A., Wu, Z., Wang, Y., et al. (2023)
arXiv arXiv
Asai, A., Wu, Z., Wang, Y., et al. (2023)
arXiv arXiv
Secondary Papers
Exercise: RAG Pipeline
Implement advanced RAG strategies
Learning Objectives
- Create: Implement Self-RAG with reflection
- Apply: Build corrective retrieval systems
- Analyze: Compare RAG strategies
Tasks
| Task | Points | Description |
|---|---|---|
| Self-RAG Implementation | 40 | Implement Self-RAG with reflection tokens |
| CRAG Pipeline | 35 | Build corrective retrieval pipeline |
| Strategy Comparison | 25 | Benchmark RAG approaches |
Exercise
Build an adaptive RAG system that:
- Decides when retrieval is needed
- Evaluates retrieval quality
- Corrects poor retrievals
- Generates grounded responses
Discussion Questions
- How does Self-RAG decide when to retrieve?
- What makes CRAG’s corrective approach effective?
- When should you use hierarchical vs. flat retrieval?
Additional Resources
Discussion & Questions
Join the Conversation
Have questions about this week's material? Want to discuss concepts with fellow students?