IBM famously estimated that poor data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → costs the US economy $3.1 trillion per year. Gartner puts the average cost to an individual organization at $12.9 million annually.
These numbers sound abstract until you trace specific costs to specific data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → failures: a bank sending loan offers to deceased customers. A manufacturer shipping products to wrong addresses because of duplicate postal codes. A hospital administering the wrong medication dosage due to a unit conversion error in the EHR system. A retailer's demand forecast 40% off because historical sales data included returns.
Data qualityData qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → isn't a technical concern. It's a business risk with a measurable price tag.
The DAMA-DMBOK defines six dimensions of data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition →. Every data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → problem maps to at least one of them:
1. Accuracy, Does the data correctly represent the real-world entity or event it describes? A customer's address is accurate if it matches their actual address. Accuracy failures: "Paris" recorded as "Parsi" due to a typo; transaction amounts rounded incorrectly; product weight recorded in the wrong unit.
2. Completeness, Are all required data elements present? A customer record missing an email address is incomplete if email is required for the business process. Completeness failures are often systemic: optional fields that should be mandatory, APIAPIApplication Programming Interface: a standardised interface that lets applications communicate and exchange data without knowing each other's internal workings.View full definition → integrations that drop fields, migration scripts that don't transfer all attributes.
3. Consistency, Is the same data represented the same way across all systems? A customer's date of birth recorded as DD/MM/YYYY in the CRMCRMCustomer Relationship Management: software and strategy to manage and analyse customer interactions throughout their lifecycle.View full definition → but MM/DD/YYYY in the billing system is an inconsistency. Consistency failures are the most common root cause of "which system is right?" debates.
4. Timeliness, Is the data available when it's needed, and does it reflect the current state? A customer's credit score updated monthly is timely for annual mortgage reviews but not for real-time lending decisions. Timeliness failures often emerge as "we knew about the issue but the data hadn't refreshed yet."
5. Validity, Does the data conform to defined formats, ranges, and business rules? A phone number with 11 digits in a field defined for 10 is invalid. A transaction date in the future is invalid. Validity failures are the easiest to detect and fix at the point of entry.
6. Uniqueness, Is each real-world entity represented exactly once? Duplicate customer records are a uniqueness failure. Deduplication is one of the most common data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → initiatives, and one of the most underestimated in complexity.
Knowledge check
1. According to Gartner, what is the average annual cost of poor data quality to an individual organization?
2. In the lesson, which example illustrates a Timeliness failure rather than another data quality dimension?
3. The lesson references the DAMA-DMBOK framework. In professional practice, what does this framework primarily serve as?
4. Select ALL the examples from the lesson that illustrate an Accuracy failure:
Sélectionnez toutes les réponses correctes.
5. Select ALL correct statements about the six data quality dimensions as presented in the lesson:
Sélectionnez toutes les réponses correctes.
"Our data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → is pretty good" is not a measurement. "Our customer master data is 94% complete, 87% accurate, and 91% consistent across CRMCRMCustomer Relationship Management: software and strategy to manage and analyse customer interactions throughout their lifecycle.View full definition → and billing systems" is.
Data quality scoring: For each data domain, define a quality score as a weighted average of the six dimensions. Weight dimensions according to business importance. For customer data used in marketing, completeness and accuracy of contact information might weight heavily. For financial data used in reporting, consistency and timeliness matter most.
Profiling: Before you can score, you need to profile. Data profiling tools (Great Expectations, Informatica Data QualityData QualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition →, Ataccama) analyze datasets to reveal: null rates, value distributions, format violations, duplicate rates, referential integrity failures. Profiling a new dataset for the first time is almost always revealing, and often alarming.
Quality dashboards: The CDO should have a real-time data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → dashboard showing quality scores by domain, trending over time. This dashboard should be shared with domain data owners, making quality visible is the first step to making it accountable.
The ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → calculation for data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → is straightforward:
Current cost of poor quality: Quantify at least one measurable cost, rework time, error corrections, customer complaints, regulatory fines, missed opportunities from incomplete data.
Cost of quality initiative: Tool licensing + implementation + ongoing stewardship + profiling and monitoring.
Target state: What quality score will you achieve, and what business outcome does that enable?
A European telecom calculated that 12% of their marketing budget was wasted targeting inactive customers due to poor data completeness and accuracy. A €50K data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → initiative that reduced waste by 50% delivered a €3M annual saving on a €25M marketing budget, a 60x ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →. That's the language CFOs understand.