RAG
Also: Retrieval-Augmented Generation, Retrieval Augmented Generation, Génération augmentée par récupération, Génération augmentée de récupération, Abrufgestützte Generierung, Retrieval-gestützte Generierung
A method that lets an AI model answer using your own documents, retrieving relevant passages before generating a response instead of relying only on training data.
What It Is
RAG (Retrieval-Augmented Generation) connects a large language model to a specific, trusted body of content: your product documentation, contracts, policies, past reports or knowledge base. Instead of answering only from what it learned during training, the model first retrieves relevant passages from your sources, then writes an answer grounded in them. A CMO asking an internal assistant "what claims are approved for this product in Germany?" gets a response built from the actual approved messaging file, not from the model's general memory.
Why it matters
A plain language model can sound confident while inventing facts, a problem known as hallucination. RAG reduces this by tying answers to documents you control, and it lets you update knowledge by changing files rather than retraining a model. For a leader, RAG is what turns a generic chatbot into an assistant that knows your business without exposing that knowledge to a public model. It also supports traceability: many RAG systems cite the source passage, so a CFO reviewing an AI-drafted summary can check the underlying figure against the original document. This makes AI outputs auditable, which matters for compliance, legal review and board reporting.
How it works
Your documents are split into chunks and converted into numerical representations (embeddings) stored in a vector database. When a question arrives, the system finds the chunks closest in meaning, hands them to the model as context, and the model composes the answer from that supplied material. The quality of the answer depends heavily on the quality and freshness of the source content: outdated or messy documents produce weak answers, so data governance and clean documentation directly shape the result. A practical decision for executives is scope: which sources to include, who may query them, and how often the underlying content is refreshed. RAG is often the first serious AI deployment in an enterprise because it delivers value on proprietary knowledge without the cost and risk of building a custom model.