Day 7

Day 7 of 1% Better

Today I learned about RAG (Retrieval-Augmented Generation)

AI + external knowledge = better, grounded answer.

Quick breakdown:

You ask a question
System fetches relevant info (docs, DBs, etc.)
Model answers using that context

Why does it matters?
Models have a knowledge cutoff
They don’t know your private/company data

RAG vs Fine-tuning:
Fine-tuning = train the model (slow, expensive)
RAG = give fresh info at runtime (fast, flexible)

In simple way,
Fine-tuning = Training a dog new commands
RAG = Giving the dog a cue card with the commands before it acts

Big takeaway:
Right data > bigger model