+50 XP

Data products: definition, design & lifecycle management

A data product is not a dashboard. It's not a report. It's not a raw dataset.

A data product is a curated, managed, and governed dataset that is treated with the same rigor as a software product: it has an owner, an SLA, documentation, versioning, and quality guarantees.

This distinction matters because it fundamentally changes the economics of data. Raw datasets are internal assets that disappear when the engineer who built them leaves. Data products are organizational assets that persist, scale, and accumulate value.

What makes a data product

A data product has five defining characteristics:

1. Clear ownership, A named individual or team is accountable for this data product's quality, availability, and evolution. Not "the data team" generically.

2. Defined consumers, The data product knows who uses it and why. Consumer requirements drive the product roadmap, not internal convenience.

3. Quality SLA, Committed freshness (data updated within X minutes), completeness (Y% non-null for critical fields), and validity (Z% of records pass business rules).

4. Documentation and discoverability, Consumers can find the product, understand its schema, and trust its definitions without asking the owner.

5. Versioning and stability guarantees, Breaking changes follow a deprecation process. Consumers aren't surprised by schema changes.

Data Products: From Theory to Practice

Watch on YouTube

Knowledge check

1. According to the lesson, what fundamentally distinguishes a data product from a raw dataset?

2. Why does treating data as a product rather than a raw dataset matter economically?

3. How does the Data Product Manager (DPM) role differ from a BI analyst and a data engineer?

MULTIPLE CHOICE

4. Select ALL characteristics that define a data product according to the lesson.

Select all the correct answers.

MULTIPLE CHOICE

5. Select ALL statements that correctly reflect the principle of 'defined consumers' and good data product practice.

Select all the correct answers.

The data product manager role

Building data products at scale requires a new role: the Data Product Manager (DPM). This role sits at the intersection of domain expertise, technical understanding, and product management discipline.

A DPM for the customer domain would own: the customer 360 data product, the churn prediction feature store, and the customer events stream. They work with data engineers to build and maintain these products, with domain stakeholders to understand requirements, and with governance teams to ensure compliance.

This is distinct from a traditional BI analyst (who consumes data products) and a data engineer (who builds the infrastructure). The DPM owns the product lifecycle.

Airbnb pioneered this model. Their "data product managers" own specific data domains and are accountable for the quality of data products those domains produce. The result: clearer accountability, faster delivery, and higher quality.

Data product design patterns

The Domain Event Stream, A real-time stream of everything that happens in a domain. Example: all checkout events with standard schema. Consumers build their specific views from this stream.

The Aggregate Entity, A curated view of a core business entity. Example: the "customer 360" that aggregates behavioral, transactional, and demographic data about each customer. High value, high maintenance.

The Feature Dataset, Precomputed ML features served to models in real-time or batch. Example: "customer purchase probability features" computed daily, served to the recommendation model. Managed by the ML platform team.

The Metric Dataset, Standardized, agreed-upon business metrics. Revenue, DAU, conversion rate, defined once, computed consistently, used everywhere. This eliminates the "why do the finance and marketing dashboards show different revenue numbers?" problem.

Measuring data product quality

Data product quality is not subjective. Define it with measurable SLAs:

  • Freshness: Data is updated within X minutes/hours of source event
  • Completeness: < Y% null values for required fields
  • Accuracy: Business rules validated by automated tests
  • Uptime: Product available Z% of the time
  • Schema stability: No breaking changes without 14-day notice

Publish these SLAs. Track them. Alert when violated. Report them to data consumers. This is product management applied to data.

Quiz Questions

  1. Quelle est la principale différence entre un data product et un dataset brut ?

A) Le data product est stocké dans un système différent

B) Le data product a un propriétaire, un SLA de qualité, de la documentation et un versioning, traité comme un produit logiciel

C) Le data product est uniquement pour les données en temps réel

D) Le data product est plus facile à maintenir

Réponse: B

  1. Quel est le rôle du Data Product Manager (DPM) ?

A) Il remplace le data engineer

B) Il consomme les data products pour créer des dashboards

C) Il possède le cycle de vie du data product, entre expertise domaine, technique et management produit

D) Il gère la sécurité des données

Réponse: C

  1. Quelle métrique de qualité mesure si les données sont mises à jour suffisamment rapidement ?

A) Completeness

B) Accuracy

C) Freshness

D) Uptime

Réponse: C

What to do, from this lesson

These actions are compiled in the role's Playbook.

  • Manage critical datasets as data products with owners, SLAs, versioning
See the full action playbook →

Related articles

Recent articles from the blog that build on this lesson.