# Data lineageData lineageData lineage maps how data moves and transforms across systems, from origin to consumption, showing where it came from, what changed it, and where it goes.View full definition → and governance for regulatory reporting
A number sits in cell D47 of a Solvency II QRT template: "Best Estimate Liabilities, Line of Business 12, EUR 340,662,000." An auditor asks: where did this come from? If nobody in the room can trace it, keystroke by keystroke, back to a policy record in the source administration system, that filing has a lineage gap. Lineage gaps are consistently the number one finding in regulatory data audits across European and US insurers, according to supervisory review reports from EIOPA (European Insurance and Occupational Pensions Authority) and state-level NAIC (National Association of Insurance Commissioners) examinations. This lesson is about closing that gap: what lineage is, how to build it, and how to measure whether your governance is actually working.
For an insurer, a single reported number typically passes through:
1. Source/operational systems: policy administration (premiums, coverage terms), claims systems (reserves, payments), reinsurance systems (ceded amounts).
2. Data warehouse or lake: where records are extracted, transformed, and loaded (ETLETLETL (Extract, Transform, Load) is a data integration process that pulls data from sources, reshapes it into a consistent format, and writes it into a target system.View full definition →).
3. Actuarial models: reserving engines, capital models (e.g., internal models or standard formula under Solvency II).
4. Reporting layer: the tool that populates QRTs (Quantitative Reporting Templates) or NAIC's Annual Statement schedules.
Lineage documentation answers three questions for every reported figure: where did it originate, what happened to it, and who touched it.
Two regulatory regimes anchor this lesson:
Both regimes converge on the same expectation: insurers must be able to demonstrate, on request, how a number was produced. This is often called "data traceability" or "auditability."
The EIOPA guidelines on internal governance explicitly list data lineagedata lineageData lineage maps how data moves and transforms across systems, from origin to consumption, showing where it came from, what changed it, and where it goes.View full definition → documentation as a supervisory expectation, not just a best practice.
A gap happens when any link in the chain is undocumented or unverifiable. Common real-world culprits:
A simplified lineage record for our example number might look like this:
Field: Best_Estimate_Liabilities_LoB12
Source: PolicyAdmin_System_EU (table: claims_reserve, field: reserve_amt)
Extract date: 2026-03-31
Transformation 1: currency conversion GBP->EUR, rate source = ECB daily rate
Transformation 2: aggregation by LoB per EIOPA LoB mapping table v4.2
Transformation 3: actuarial adjustment, model: Reserving_Model_v7.1, run_id: 20260405_02
Loaded to: QRT_S.17.01, cell D47
Approved by: Head of Actuarial Reporting, 2026-04-10That last line matters as much as the technical trail: governance is not just IT, it is accountability.
Governance frameworks assign responsibility so lineage doesn't rely on institutional memory. Standard structure:
Metrics that boards and regulators actually look for (figures below are illustrative industry benchmarks, treat as estimates, not universal thresholds):
| Metric | What it measures | Typical target (estimate) |
|---|---|---|
| Lineage coverage | % of critical data elements (CDEs) with documented end-to-end lineage | 90%+ for CDEs feeding regulatory reports |
| Data quality issue closure rate | % of identified DQDQThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → issues remediated within SLA | 85-95% within quarter |
| Manual adjustment ratio | % of reported figures touched by a manual (spreadsheet) step | Lower is better; many insurers target under 10% |
| Critical Data Element (CDE) count | Number of fields formally classified as regulatory-critical and under tightened control | Varies by firm; often several hundred to a few thousand |
Worked example: Suppose an insurer has 1,200 CDEs feeding its Solvency II QRTs. An internal audit finds full lineage documentation for 1,050 of them.
Lineage coverage = 1,050 / 1,200 = 87.5%
If the internal target is 90%, this insurer has a gap of 2.5 percentage points, roughly 30 fields, that must be remediated before the next filing cycle. That gap becomes the audit finding.
Though written for banks, the Basel Committee's BCBS 239 principles ("Principles for effective risk data aggregation and risk reporting," 2013) are widely used by insurance data teams as a governance template because they are more granular than Solvency II text itself. Key principles directly transferable: data must be accurate, complete, timely, and adaptable, and firms must be able to reproduce reports and trace them to source without material delay, generally interpreted by practitioners as being able to fulfill an ad hoc regulator request within days, not weeks.
Knowledge check
1. An auditor questions a figure in a Solvency II QRT template. What does a genuine 'lineage gap' mean in this context?
2. Why is documenting 'who touched it' considered as essential as documenting 'where did it originate' in data lineage?
3. A reported Best Estimate Liabilities figure passes through a policy admin system, a data warehouse ETL process, and an actuarial reserving model before reaching the QRT template. Which statement best describes why each stage matters for lineage?
4. Select ALL correct answers about why regulators like EIOPA and NAIC emphasize data lineage in regulatory reporting.
Select all the correct answers.
5. Select ALL correct answers describing systems/stages typically involved in the data lineage path for a regulatory reported figure at an insurer.
Select all the correct answers.
1. Classify CDEs first. Don't try to document lineage for every field in the warehouse. Start with fields that flow into QRTs, SFCR narrative figures, and RBC calculations.
2. Automate capture where possible. Modern ETLETLETL (Extract, Transform, Load) is a data integration process that pulls data from sources, reshapes it into a consistent format, and writes it into a target system.View full definition → and data catalogdata catalogA centralized inventory of an organization's data assets, enriched with metadata, that helps people find, understand, and trust the data they need.View full definition → tools (e.g., Collibra, Informatica, Apache Atlas) can auto-generate technical lineage from pipelinepipelineAll active sales opportunities across the stages of the sales process, together with their combined potential value and probability of closing.View full definition → metadata, reducing reliance on manual documentation that goes stale.
3. Log every manual touchpoint. If an actuary adjusts a number in Excel before it enters the model, that step needs a timestamp, a name, and a rationale.
4. Test lineage, don't just document it. Run periodic "trace-back" exercises: pick a random reported figure, and have someone outside the original team reconstruct its lineage using only the documentation. If they can't, the documentation has failed its real test.
5. Tie remediation to governance metrics, and report those metrics to the board risk committee, not just to IT.
🎬 [VIDEO: "What is Data LineageData LineageData lineage maps how data moves and transforms across systems, from origin to consumption, showing where it came from, what changed it, and where it goes.View full definition →?" - youtube.com - a short, accessible explainer on data lineagedata lineageData lineage maps how data moves and transforms across systems, from origin to consumption, showing where it came from, what changed it, and where it goes.View full definition → concepts applicable across regulated industries, useful for non-technical viewers before diving into insurance specifics]