# Internal Data Platforms as Products
In 2019, Airbnb's data platform team discovered something uncomfortable: they had built a beautiful, technically elegant data infrastructure that almost nobody trusted. Analysts were quietly maintaining shadow pipelines. Product teams pulled metrics from three different sources and got three different answers. The platform team measured success in tables ingested and queries served—but the people who mattered, the internal consumers, were routing around them. Airbnb's response was to treat the platform not as plumbing but as a product with users, a value propositionvalue propositionA clear statement of the benefits your product delivers, the problems it solves and why customers should choose you over alternatives.View full definition →, and a churn problem. That reframing—captured later in their "Data QualityData QualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition → at Airbnb" and Minerva metric-layer work—is the discipline this lesson is about.
The trap is seductive because it feels like progress. You ship a new lakehouselakehouseA hybrid architecture combining the flexibility of a data lake with the analytical capabilities of a data warehouse, on a single storage layer.View full definition →, a feature storefeature storeA centralised repository managing ML features, ensuring consistency between training and serving environments.View full definition →, a self-serve BIBITechnologies and processes that turn raw data into actionable insights via reporting, dashboards and analysis, so teams can decide based on facts rather than intuition.View full definition → layer. The infrastructure is real. But shipping infrastructure is not the same as creating value, and a CDO who confuses the two will fund a platform that gets built, admired in architecture reviews, and abandoned by the analysts and product managers it was meant to serve.
The core shift is who defines "done." When you own infrastructure, done means the system is up, the SLA is met, the pipelinepipelineAll active sales opportunities across the stages of the sales process, together with their combined potential value and probability of closing.View full definition → ran. When you own a product, done means an internal customer accomplished a job faster or better than they could before—and would be annoyed if you took the tool away.
This is not a semantic dressing-up of the same job. It changes four concrete things about how you run the platform team.
It changes what you fund. Infrastructure roadmaps are organized by component: "migrate the warehouse," "upgrade orchestration," "add streaming." Product roadmaps are organized by user job: "let a marketing analyst build an attribution modelattribution modelA framework for assigning credit to the touchpoints that contributed to a conversion, so you can measure which channels and interactions actually drive results.View full definition → without filing a ticket," "let a data scientist promote a feature to production in a day, not a sprint." Every technical initiative must ladder up to a named job for a named user segment. If it doesn't, it's cost, not investment.
It changes who you hire. Product-run platforms have product managers—people whose job is to talk to internal users, prioritize ruthlessly, and say no. The absence of a data platform PM is the single most reliable predictor that a platform is being run as infrastructure. Engineers optimize for the elegant general case; PMs optimize for the specific job that unblocks the most valuable users.
It changes your relationship with consumers. Infrastructure owners field tickets. Product owners run discovery. The difference shows up in a question: when a team asks for a new dataset, do you fulfill the request, or do you ask what decision they're trying to make? The second question routinely reveals that the requested dataset is the wrong solution—and that a curated metric or a self-serve template would serve ten teams instead of one.
It changes how you measure yourself, which is the heart of this lesson.
You would never build an external product for "everyone." Do not build your internal platform for "the business." Your users cluster into recognizable segmentssegmentsDividing a market into distinct groups of customers who share similar needs, characteristics or behaviours, so each group can be served with a tailored approach.View full definition → with sharply different needs:
Each segment has a different definition of a good day. Serving the platform builders with more primitives while starving the business power users of governed self-serve is a common and expensive misallocation—it feels like deep technical work while the largest user population churns to spreadsheets.
Here is the reframing made operational. Stop reporting infrastructure output metrics to your leadership peers—tables ingested, uptime, petabytes stored. Those are health metrics for your engineers, not value metrics for the business. Report a product scorecard.
1. Adoption. Who is actually using the platform, and are they coming back? Borrow the SaaS distinction between registered and active users. A team that provisioned access six months ago and hasn't run a query is not a user. Track:
2. Retention and stickiness. The most honest platform metric is whether people keep coming back voluntarily. Cohort retention curves—do the analysts onboarded in Q1 still active in Q3?—expose whether you built something valuable or merely mandated. A platform that survives only because usage is compulsory has a satisfaction problem it's hiding.
3. Time-to-value. How long from "a team wants to answer a question" to "they have a trustworthy answer"? This is your platform's core throughput metric. Two sub-measures matter enormously:
If onboarding a new analyst takes three weeks of access requests and environment setup, your adoption ceiling is set by that friction, not by your capabilities.
4. Satisfaction and trust. Run an internal NPSNPSNet Promoter Score (NPS) measures customer loyalty by asking how likely customers are to recommend a brand, then subtracting detractors from promoters.View full definition → or CSATCSATCustomer Satisfaction Score, a direct measure of satisfaction captured right after a specific interaction or experience, usually on a short rating scale.View full definition → on the platform, segmented by user type. But the more revealing metric is trust: when a number appears on your platform, do consumers act on it, or do they re-verify it elsewhere? The presence of shadow pipelines and reconciliation spreadsheets is a direct, measurable trust signal. Count them.
A useful synthesis is a single quarterly Platform Product Scorecard you present alongside the infrastructure health dashboard:
| Metric | Segment | Target | Trend |
|---|---|---|---|
| MAU / eligible teams | Analysts | 80% | ↑ |
| 90-day retention | Data scientists | 70% | ↓ |
| Time-to-first-insight | Business users | < 3 days | flat |
| Trust NPSNPSNet Promoter Score (NPS) measures customer loyalty by asking how likely customers are to recommend a brand, then subtracting detractors from promoters.View full definition → | All | > 30 | ↑ |
| Shadow pipelinepipelineAll active sales opportunities across the stages of the sales process, together with their combined potential value and probability of closing.View full definition → count | All | decreasing | ↓ |
The declining retention among data scientists in that example is the kind of signal an output-only dashboard would never surface—and it's exactly where a CDO should point the next quarter's investment.
You cannot report on adoption you don't measure. Treat the platform's own telemetry as a first-class product requirement, not an afterthought. Log usage events the way a SaaS company instruments its app—every query, dashboard load, model deployment, and dataset access, tied to a user and a team.
# Platform usage event schema — emitted on every meaningful interaction
event:
user_id: analyst_4471
team: growth-marketing
segment: business_power_user
action: dashboard_view # query_run | model_deploy | dataset_access
asset_id: attribution_v3
latency_ms: 820
success: true
timestamp: 2024-11-04T14:22:00ZThis event stream is what powers your cohort retention, your time-to-value measurement, and your ability to spot a segment quietly churning. It also lets you find your power users and your abandoned assets—the datasets nobody has touched in ninety days that you're still paying to maintain.
Metrics without operating rhythm are just dashboards. The product reframing has to change how the team actually works week to week.
The most powerful discipline is optionality. When internal teams *can* build their own pipelinepipelineAll active sales opportunities across the stages of the sales process, together with their combined potential value and probability of closing.View full definition → or buy a point solution, your platform has to earn its usage. Some CDOs resist this—they mandate the platform to guarantee adoption. But mandated adoption masks the very signal you need. The healthiest posture is: the platform should be so obviously better that teams choose it. Where you mandate (usually for governance or compliance reasons), acknowledge that you've suppressed the satisfaction signal and compensate by measuring it directly through interviews and trust metrics.
You will always have more requests than capacity. Prioritize by asking two questions of every candidate investment: how many users in how valuable a segment does this unlock (reachreachThe number of unique people exposed to your message in a given period. Unlike impressions, reach counts each person once, no matter how often they see it.View full definition →), and how much friction does it remove (value)? A self-serve semantic layer that unblocks 200 business users usually beats a bespoke streaming pipelinepipelineAll active sales opportunities across the stages of the sales process, together with their combined potential value and probability of closing.View full definition → for one high-status team—even though the streaming project is more technically interesting. The PM's job is to protect this discipline against the gravitational pull of the loudest internal stakeholder.
External products make promises. So should yours. Publish data SLAs (freshness, availability, quality thresholds) per critical dataset, and treat a breach as an incident with a postmortem. This is what converts trust from a hope into a commodity. A finance team that knows the revenue table is guaranteed fresh by 6 a.m. with a 99.5% reliability record will stop building their reconciliation spreadsheet. That abandoned spreadsheet is your ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →.
Sit your platform PMs with the analysts for a day a month. Watch a new hire onboard and time it. The teams that run great internal platforms know their users' workflows in visceral detail—they've felt the twenty-minute wait for a query and the confusion of three conflicting metrics. Discovery is not a survey; it's watching real work get done and finding the friction.
Knowledge check
1. According to the lesson, what fundamentally distinguishes owning a data platform as a 'product' rather than as 'infrastructure'?
2. The lesson warns that shipping a new lakehouse, feature store, or self-serve BI layer can be a 'seductive trap.' Why?
3. When platform consumers maintain shadow pipelines and pull the same metric from multiple sources that disagree, what does this signal to a product-minded CDO?
4. Select ALL correct answers. How does adopting a product-owner mindset concretely change how a platform roadmap is organized and funded?
Select all the correct answers.
5. Select ALL correct answers. Which of the following are valid indicators that a data platform is genuinely delivering value under a product lens?
Select all the correct answers.
The subtle failure mode for a product-minded CDO is the opposite of the infrastructure trap: over-optimizing for adoption and satisfaction while eroding governance. A platform that everyone loves because it lets them do anything is a compliance incident waiting to happen.
The resolution is to make the governed path the easy path. Governance should be embedded in the product experience, not bolted on as a gate. Concretely:
The judgment call for the CDO is calibrating the trade-off per segment. Data scientists need a permissive sandbox; business power users need guardrails so tight they can't accidentally publish a wrong number to the CEO. One-size governance either strangles the builders or endangers the consumers. Segment your governance the way you segment your product.
1. Reorganize the roadmap by user job, not by component. Every technical initiative must ladder up to a named job for a named internal segment; if it doesn't, it's cost, not investment. Hire a platform PM—its absence is the surest sign you're running infrastructure, not a product.
2. Replace output metrics with a product scorecard. Report adoption, retention, time-to-value, and trust—segmented by user type—to your leadership peers. Keep uptime and throughput as internal engineering health metrics, not value metrics.
3. Instrument the platform's own usage as a first-class requirement. You cannot manage adoption you don't measure; a per-event telemetry stream powers cohort retention, time-to-value, and early churn detection—and doubles as your governance observability.
4. Count the shadow pipelines and reconciliation spreadsheets. They are the most honest measure of platform trust. Killing them—by publishing and honoring dataset SLAs—is a concrete, defensible ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → story.
5. Make the governed path the easy path, and segment governance by user. Embed compliance in the default product experience, give builders a permissive sandbox and consumers tight guardrails, and use one telemetry stream for both product and governance decisions.