+180 XP

Designing a KPI tree

# Designing a KPI tree

When Airbnb's data team dug into why "bookings" as a north-star metric kept lying to them, they found the problem wasn't the metric, it was the absence of structure beneath it. Bookings moved for a dozen reasons no dashboard could disentangle: seasonal demand, a pricing test, a search-ranking change, a payments outage in one corridor. When bookings dipped, ten teams pointed at each other. The number was real. It was also useless for deciding what to do on Monday.

This is the failure mode a KPI tree exists to prevent. Most organizations don't suffer from too few metrics, they drown in them. Every team invents its own, every dashboard sprouts a new "engagement score," and the executive scorecard becomes a museum of numbers nobody can act on. A KPI tree is the discipline that says: there is exactly one top-line outcome, and every metric below it earns its place by mathematically or causally explaining how that outcome moves. Metrics stop multiplying and start cascading with meaning.

The anatomy of a KPI tree

A KPI tree is a directed decomposition. At the root sits the outcome the business is actually trying to change, revenue, contribution margin, lifetime value, retention. Below it, each layer answers the question: *what does this metric decompose into?* You descend until you reach metrics an individual team can move within a quarter without waiting on anyone else. Those leaf nodes are your operational drivers. Everything above them is a lagging aggregate.

The critical distinction the fundamentals module didn't stress: there are two kinds of edges in the tree, and confusing them destroys the whole structure.

Mathematical decomposition is an identity. Revenue *equals* customers × average order value × purchase frequency. This is true by definition; there is no causal claim, no lag, no debate. These edges are safe to aggregate and safe to attribute.

Causal (driver) linkage is a hypothesis. "Page load time drives conversion rate" is a belief about the world, supported by experiments, that may weaken or reverse over time. These edges are where your judgment, and your risk, live.

A well-built tree keeps these separated by layer. The upper layers are pure arithmetic; you can prove them. The lower layers are causal drivers; you must *test* them. When a CDO lets a causal guess masquerade as an identity, teams optimize a lever that turns out to be disconnected from the outcome, and by the time the tree "lies," trust in the entire metrics system is gone.

Here's the arithmetic backbone for a subscription business, expressed as the identity it actually is:

Net Revenue Retention
  = (Starting MRR + Expansion − Contraction − Churn) / Starting MRR

where:
  Expansion   = Σ(seat upgrades) + Σ(tier upgrades) + Σ(usage overages)
  Contraction = Σ(downgrades) + Σ(partial seat loss)
  Churn       = Σ(fully cancelled MRR)

Everything above the line is provable. The interesting work begins one level lower: *what operational driver moves seat upgrades?* That is a causal question, perhaps admin-invite friction, perhaps time-to-first-value for new seats, and it belongs in the driver layer where it can be tested, not asserted.

The four properties of a good leaf node

A driver metric is only worth putting in the tree if it satisfies four tests. Apply these ruthlessly; they are the difference between a tree that drives action and one that decorates a slide.

1. Ownable. Exactly one team can be held accountable for it. If two teams share a metric equally, neither owns it, and it will drift.

2. Movable within the horizon. A team can meaningfully change it in a quarter through their own decisions, not "wait for the market to recover."

3. Instrumented. You can measure it reliably today, or you have a funded plan to. An un-instrumented driver is a wish.

4. Causally credible. There is evidence, ideally experimental, that moving it moves its parent. Not just correlation over a period where everything trended together.

Notice that "important" is not on this list. Customer sentiment is important; if no single team can move it in a quarter, it is not a leaf node, it is an outcome that needs its own decomposition.

Building the tree: from root to levers

The most common construction error is building the tree bottom-up, collecting the metrics teams already report and trying to assemble them into a structure. This inverts the logic. Existing metrics reflect existing org charts and legacy dashboards, not the actual drivers of the outcome. You will end up with a tree whose root is whatever number happened to be measurable.

Build top-down, in four passes.

Pass one: name the single root. One outcome. If your executives insist on three "co-equal north stars," you don't have a metrics problem, you have a strategy problem, and the tree will expose it. Force the choice. For a marketplace it might be gross booking value; for enterprise SaaS, net revenue retention; for a media business, monetizable daily active users. The root must be a business outcome, not a proxy, "engagement" is a proxy, "revenue from engaged users" is an outcome.

Pass two: decompose arithmetically until you hit behavior. Break the root into its mathematical components, layer by layer, staying in pure-identity territory as long as you can. Revenue → (new customer revenue + existing customer revenue). New customer revenue → (traffic × signup rate × activation rate × first-purchase value). Keep going until the next decomposition would require a *causal* claim rather than an arithmetic one. That boundary is where your driver layer begins.

Pass three: hypothesize drivers for each behavioral node. For each behavioral metric, signup rate, activation rate, ask what operational levers plausibly move it, and demand evidence for each proposed edge. This is where you separate the drivers you *know* from the drivers you *believe*. Tag every causal edge with its evidence grade: experimentally validated, correlationally suggested, or purely hypothesized. Your tree should visibly show which edges are guesses.

Pass four: assign ownership and prune. Walk every leaf node against the four properties. Nodes that fail get either pushed down (decomposed further until something ownable appears) or cut. A tree with 200 leaves is not more complete than one with 30; it is less usable. Ruthless pruning is the act that makes the tree a decision tool rather than a data catalog.

A worked fragment for an e-commerce retailer:

Contribution Margin  [ROOT — outcome, CFO owns]
├── Revenue  [identity]
│   ├── Traffic × Conversion × AOV  [identity]
│   │   ├── Conversion  [behavioral — boundary]
│   │   │   ├── Search relevance    [DRIVER — Search team, A/B validated]
│   │   │   ├── Page load time       [DRIVER — Platform team, validated]
│   │   │   └── Checkout friction    [DRIVER — Payments team, validated]
│   │   └── AOV  [behavioral]
│   │       └── Recommendation CTR   [DRIVER — ML team, correlational only ⚠]
└── Cost to serve  [identity]
    └── Fulfillment cost / order      [DRIVER — Ops team, validated]

The ⚠ on recommendation CTR is deliberate and it should stay visible. You believe it drives AOV; you haven't proven it. The tree's honesty about its own weak edges is what keeps executives from over-crediting the ML team when AOV rises for unrelated reasons.

Sizing the edges: from structure to prioritization

A tree that only shows *structure* tells you how metrics connect. A tree that shows *sensitivity* tells you where to spend your quarter. For each edge, estimate the elasticity: if this driver improves by X%, how much does the parent move? A 10% improvement in checkout friction might lift conversion 2%; a 10% improvement in page load might lift it 0.3%. Same layer, wildly different leverage.

This turns the tree into a prioritization instrument. When two teams both want headcount, the one whose leaf node has ten times the elasticity to the root has the stronger claim, and now you can show it, not argue it. This is the single highest-value output of the exercise, and it's the one most organizations skip because it requires actual experimental data rather than a whiteboard.

The North Star Playbook

Watch on YouTube

Vérification des acquis

1. What is the primary purpose of a KPI tree, according to the lesson?

2. Why was 'bookings' described as a metric that 'kept lying' to Airbnb's data team?

3. In a well-built KPI tree, what are 'leaf nodes' (operational drivers)?

CHOIX MULTIPLES

4. Select ALL statements that correctly describe the difference between mathematical decomposition and causal linkage in a KPI tree.

Sélectionnez toutes les réponses correctes.

CHOIX MULTIPLES

5. Select ALL consequences the lesson associates with letting a causal guess masquerade as a mathematical identity.

Sélectionnez toutes les réponses correctes.

Governing the tree so it stays honest

A KPI tree is not a document; it is a living contract about how the business believes it works. It decays for three reasons, and the CDO's job is to manage the decay explicitly.

Drivers stop driving. The causal edges are hypotheses, and hypotheses expire. A driver that genuinely moved conversion two years ago may be fully saturated now, every customer's page already loads fast, so further gains do nothing. Schedule a re-validation cadence for every causal edge: quarterly for high-leverage drivers, annually for the rest. Re-run the experiment or the causal analysis. Edges that no longer validate get demoted or cut. Without this, the tree accumulates dead wood that teams keep dutifully optimizing.

Gaming and the surrogation trap. The moment a leaf metric becomes a target, people optimize the metric rather than the outcome it was meant to represent, the classic surrogation problem. A support team measured on "time to first response" answers instantly with a useless canned reply. The tree's defense is structural: because every leaf is tied by an explicit edge to a parent outcome, you can *audit whether the parent actually moved*. If first-response time improved but the parent metric (resolution rate, retention) didn't, the edge is either gamed or wrong. Pair every leaf with its parent in the review, never in isolation. This is why the tree is a governance tool, not just a modeling one.

Reorgs break ownership. Trees are built around ownable nodes, but org charts change every year. When a team splits or merges, orphaned leaf nodes appear, metrics nobody owns anymore. Build a standing rule into your metrics governance: no reorg is complete until every affected leaf node has a named owner reassigned. The CDO should own this checkpoint, because no one else has line of sight across the whole tree.

Where the tree meets the semantic layer

This is what separates a CDO's tree from a consultant's slide. The tree must be *instantiated in your semantic layer*, not maintained separately. Each node maps to a governed metric definition; each edge is a documented relationship. When "conversion rate" is defined once in the semantic layer and every node in the tree references that definition, the tree and the numbers can never diverge. When they live in separate artifacts, a PowerPoint tree and a Looker instance, they drift within a quarter, and the tree becomes fiction.

The practical mandate: your KPI tree's leaf and node names should be *exactly* the metric names in your semantic layer, one-to-one. If a node in the tree has no corresponding governed metric, either the metric needs defining or the node doesn't belong. This coupling is what lets an executive click from the scorecard's top-line number down through the tree to the specific driver a specific team owns, same definition, same number, all the way down. That traceability is the entire payoff.

Key Takeaways

  • Separate identities from hypotheses. Upper tree layers are pure arithmetic decompositions you can prove; lower layers are causal driver edges you must test. Tag every causal edge with its evidence grade and keep the weak ones visibly marked.
  • Leaf nodes must pass four tests, ownable, movable in a quarter, instrumented, causally credible. "Important but un-ownable" is not a leaf; it's an outcome that needs its own decomposition. Prune ruthlessly; 30 usable leaves beat 200 decorative ones.
  • Size the edges, don't just draw them. Estimate each driver's elasticity to its parent. This converts the tree from an org diagram into a prioritization engine that settles resource fights with evidence instead of volume.
  • Govern against decay. Re-validate causal edges on a cadence, audit every leaf against its parent to catch surrogation, and make owner-reassignment a mandatory step in every reorg.
  • Instantiate the tree in the semantic layer, one-to-one. Node names must equal governed metric definitions, or the tree and the dashboards will diverge within a quarter and the whole structure becomes fiction.

À faire, tiré de cette leçon

Ces actions sont compilées dans le plan d'action du rôle.

  • Structure north-star metrics into a KPI tree mapped one-to-one to semantic definitions
Voir le plan d'action complet