Skip to content
Cortexa ConsultingCortexa Consulting
Cortexa Ground Truth
Explainer5 min readBy Joe Coffman
0:00 / 3:36

Tip: once it’s playing, tap any line to jump the audio there.

RAG is just giving AI an open book.

RAG in simple terms: don't hope the AI remembers hand it the right documents and let it answer from the source, open-book style.


Every team serving tech clients eventually hears the same request: “can we train the AI on our own data?” Usually you don't need to train anything you need to let the AI look things up. That's Retrieval-Augmented Generation (RAG), and it's the single biggest lever for getting accurate, on-brand answers out of AI.

Closed-book exam vs. open-book exam

Picture two students taking the same test. The first has to take a closed-book exam: no notes, everything from memory. Confident and fast and when memory runs short, they can always guess. (That's the confident-guessing problem from last time.) The second student takes an open-book test: the reference material is right there on the desk, so the answer comes from the source/text, not from whatever they happen to remember.

A plain Large Language Model (LLM) is the closed-book student. RAG turns it into the open-book one: before the model answers, a retrieval step finds the passages in your documents that are actually relevant and pastes them into the prompt. The model then answers from that material and can point to exactly where each claim came from.

An open book with a jade cover; one line on the right page is highlighted in chartreuse and tagged “[1]”, while three source icons above — a document, a database, and a globe — feed lines down into it. The model answers from a retrieved, cited passage rather than from memory.An open book with a jade cover; one line on the right page is highlighted in chartreuse and tagged “[1]”, while three source icons above — a document, a database, and a globe — feed lines down into it. The model answers from a retrieved, cited passage rather than from memory.
How RAG works

What's actually real?

  • Grounding is the biggest, cheapest accuracy win. The foundational research on retrieval-augmented models1 showed that letting a model pull from an external source beats leaning on what it memorized especially for facts that change, and model-builders now put grounding at the top of the practical fix list2.
  • It attacks hallucination at the root. Because the model answers from supplied text instead of reconstructing from memory, there's far less room to invent the failure mode a major hallucination survey3 traces to predicting rather than remembering.
  • It is not magic. RAG is only as good as the documents you give it and the passage it actually retrieves: feed it the wrong page and you get a confident answer grounded in the wrong place. Retrieval quality is the whole game.

The “so what” for anyone serving tech clients

  • When a client asks to “train AI on our brand or products,” translate it into a grounding project first: which documents should it answer from? You'll scope something cheaper, faster, and more accurate than a training effort and you'll sound like the person who actually knows how this works.
  • Grounding plus citations is your trust story. An answer that links back to the source document is one a client can verify exactly what you want the moment AI gets anywhere near facts that carry risk.

Next Reads