DataData Culture

Data literacy programs that change behavior: the concept CDOs get wrong

Most data literacy programs teach tools and terminology, then stop. The ones that move the needle on board-level ROI do something different: they change how people make decisions, and that difference is measurable.

Listen to the podcast

4 min

Chapters

Key takeaways

  • Pick ten recurring decisions, record whether each was made on gut, politics or evidence, then measure again six months later.
  • Require the person proposing a decision to write down what evidence would change their mind before the meeting.
  • Start the literacy program with the twelve executives who actually make the calls, not with five thousand employees.
  • Tie learning to the actual workflow, like a plant manager changing one reorder decision on a forecast, rather than a training calendar.
  • Treat vendor data such as DBT Labs' claims with care and cross-check against independent work like O'Reilly's annual surveys.
Read the full transcript

Host:Welcome to the Leaders Insights podcast. Today's episode, Data Literacy Programs that Change Behavior. The concept CDOs get wrong. Most data literacy programs are a waste of money. You've said that out loud in a room full of CDOs. Defend it.

Expert:Happy to. Walk into 90% of these programs and what are they doing? Teaching people what a median is, how to filter a dashboard, the difference between a bar chart and a line chart. Then everyone gets a certificate and goes back to running the business on gut feeling exactly like they did before.

Host:But surely people need to understand the tools before they can use them?

Expert:Understanding the tool isn't the goal. Changing the decision is the goal. I can teach you what a confidence interval is, the range where the true number probably sits. And you'll still approve a marketing budget because someone in the room sounded certain. Knowledge and behavior are different animals. Nobody measures the second one.

Host:So what does a program that actually changes behavior look like?

Expert:It's built around decisions, not concepts. You take a real recurring decision—pricing, hiring, inventory—and you rewire how it gets made. You require the person proposing it to show what evidence would change their mind before they walk in. That one question does more than a semester of Excel training.

Host:Give me a company that did it right.

Expert:Booking.com, comma, years back. They didn't run a literacy course. They made experimentation the default. Every product change had to go through a controlled test, and thousands of people were empowered to run those tests. The literacy came from doing, not from a slide deck. People learned what a P-value was because they needed it to ship, not because HR mandated it.

Host:That's a tech company, though. Easy for them. What about a bank? A manufacturer?

Expert:Fair jab. But the principal travels. MIT Sloan Management Review has been tracking this. The organizations that see returns tie learning to the actual workflow, not to a training calendar. The manufacturer doesn't need everyone to understand regression, fitting a line through messy data. They need the plant manager to change one reorder decision based on a forecast and see it pay off. Small, concrete, tied to their day.

Host:You're describing something slow and unglamorous. Teachers want a number. What number do you give them?

Expert:You give them a decision quality number, and yes, it's harder to fake. Pick 10 recurring decisions before the program. Track how they were made. Ciao. Gut. Politics. Or evidence. Six months later, track again. DBT Labs published data suggesting teams with mature data practices ship decisions faster, though they sell data tooling. So I'd cross-check that against O'Reilly's annual survey work, which is independent and

Host:less flattering.

Expert:Less flattering how? O'Reilly's radar research keeps finding the same thing. The bottleneck isn't skills. It's culture and trust in the data. You can train every analyst in the building and it changes nothing if the CFO, the finance chief, still overrides the model whenever it disagrees with him.

Host:The failure is at the top, and no literacy program touches the top.

Expert:So the CDO's own boss is the problem. Constantly. I've watched chief data officers roll out gorgeous training to 5,000 employees, while the executive committee makes every real call in a hallway conversation with zero data. You want to change the culture. Start the program with the 12 people who actually decide things.

Host:Uncomfortable, but that's where the ROI, the return, the money back, lives.

Expert:Isn't that just politics dressed up as data? All of it is politics. Anyone who tells you data culture is a technical problem is selling you a platform. The technology's been fine for a decade. What's broken is that showing evidence and being told you're wrong is socially expensive, and people avoid it.

Host:Fix the social cost, and the literacy follows for free.

Expert:One thing a listener can do Monday morning, go. Pick a decision you make every month. Before you make the next one, write down what evidence would change your mind. If the honest answer is, nothing would. You've just learned you don't need data. You need to admit you've already decided.

Host:That's more literacy than most programs deliver in a year. Sources for today's episode. The new stack, DBT Labs, vendor, data tooling, KD Nuggets, O'Reilly Radar, MIT Sloan Management Review. That's your five. The full CDO track, structure, no fluff, is at MBA-training.com.

The concept at the center of this article isbehavioral transfer: the degree to which learning from a data literacy program actually changes how someone behaves at work the next day, the next week, the next quarter. Most CDOs understand data literacy as a training problem. The better framing is that it is a behavior-change problem with a training component.

The confusion matters because boards are not confused. When a CFO asks "what did we get from the $2M we spent on data upskilling?", she is not asking about completion rates or quiz scores. She is asking whether her team makes better decisions faster, whether fewer reports go unquestioned, whether someone in operations caught a bad assumption before it became a bad quarter. If the CDO answers with headcount trained and hours delivered, the conversation ends badly.

Why do data literacy programs matter more for CDOs?

CDOs are the only C-suite role expected to build both the technical infrastructure and the human capability to use it. A CTO can ship a product without every employee becoming an engineer. A CDO cannot realize data value without distributed analytical judgment across the organization. That asymmetry puts enormous pressure on literacy programs to actually work.

The stakes have risen sharply in 2026. With AI-assisted analytics now embedded in tools most knowledge workers touch daily, the failure mode has shifted. The risk is not that employees cannot access data. The risk is that they accept AI-generated summaries without interrogating them, or that they act on a metric without understanding how it was defined. MIT Sloan Management Review published research this year showing that companies investing in reskilling programs are increasingly finding that their forecasts of which skills employees need are wrong by the time training is designed. The implication: programs built around static curricula fail because the capability gap moves faster than the syllabus.

That is the CDO's problem to solve, and behavioral transfer is the mechanism that determines whether she solves it or not.

Three conditions that drive behavioral transfer after training

Behavioral transfer from training has been studied in organizational psychology for decades. The core finding, consistent across industries, is that what happens after training matters more than what happens during it. Three conditions drive transfer: the learner has opportunity to apply the new skill immediately, their manager reinforces the behavior, and the surrounding environment makes the new behavior easier than the old one.

A concrete example from a mid-size European retailer illustrates this. The company ran a six-month data literacy program in 2025, covering SQL basics, dashboard interpretation, and statistical thinking. Completion rates were high, 87% across 400 participants. Three months later, an internal audit found that category managers were still forwarding data requests to the analytics team at the same rate as before the program. The training had not changed behavior because none of the three transfer conditions were in place. Managers had not been briefed on what to reinforce. The request-forwarding workflow was still the path of least resistance. And category managers had no immediate reason to apply their new skills because their KPIs did not reward doing so.

The fix was not more training. It was restructuring the workflow. The company gave category managers direct access to a simplified self-service environment, removed one step from the data request process so that self-service was now faster than asking the team, and ran a 30-minute manager briefing on what good data behavior looked like in their teams. Within two quarters, analyst request volume from that group dropped 34%.

This is whatbuilding a data literacy program that produces ROI actually requires: workflow design, manager enablement, and incentive alignment, alongside the training content itself.

When behavioral transfer design pays off for a CDO

Behavioral transfer design is worth the investment when the literacy gap is causing measurable, recurring friction: decisions delayed because someone cannot interpret a report, costly errors traced to metric misreads, or analytics team capacity consumed by requests that employees could handle themselves. In each case, you can define a before-and-after behavioral indicator and attach a number to it.

It is less appropriate when the organization's data environment is not stable enough to support self-service. If your data definitions are inconsistent, your dashboards are unreliable, or your governance is weak, you are asking people to change behavior based on a broken foundation. Training will produce confident misuse rather than confident use. Fix the infrastructure first.

There is also an honest tradeoff around scope. Full behavioral transfer design, including manager enablement, workflow redesign, and post-training reinforcement, costs roughly twice as much as a straight training deployment. For a pilot cohort of 50 people, that is manageable. Scaled to 2,000 employees across multiple business units, the coordination cost is substantial. CDOs should be selective: identify the two or three roles where improved data behavior would most directly affect a board-level metric, prove the model there, then expand.

When you bring this to the board, the argument is not "we trained 2,000 people." It is "we changed how category managers work, analyst request volume dropped by a third, and the team recovered 1,200 hours of capacity that was redirected to the pricing model project." That is the language that justifies the next program cycle. If you want to structure that argument rigorously before your next board presentation, the approach tocalculating ROI for this class of initiative is worth working through in detail.

One practical point to close on: the CDO who treats data literacy as an HR initiative will lose the budget argument every time. Framing it as workflow redesign with a training component, measured against operational outcomes, puts it in a category the board already funds. That reframe is not cosmetic. It determines whether the program gets a second year.

Frequently asked questions

How do you measure the ROI of a data literacy program?

Measure a data literacy program against operational behavior, not completion rates. Pick a before-and-after indicator tied to a board-level metric, such as analyst request volume or decision delays, and track it over two quarters. One European retailer reported a 34% drop in analyst requests from category managers and recovered analyst capacity for other projects.

Why do data literacy programs fail even with high completion rates?

High completion rates say nothing about behavior change. A European retailer hit 87% completion across 400 participants, yet category managers kept forwarding requests to the analytics team at the same rate, because managers were not briefed, the old workflow stayed faster, and KPIs did not reward using the new skills.

How much more does behavioral transfer design cost than standard training?

Full behavioral transfer design, including manager enablement, workflow redesign and post-training reinforcement, costs roughly twice a straight training deployment. That is manageable for a pilot cohort of 50 people, but coordination costs climb quickly at 2,000 employees across business units, so CDOs should prove the model on two or three roles first.

When should a company delay a data literacy program?

Delay the program when the data environment cannot support self-service. Inconsistent definitions, unreliable dashboards or weak governance turn training into confident misuse rather than confident use. Fix the infrastructure first, then ask people to change how they work.

Go deeper

The lessons that take this article further, free to read.

  1. 1Building a data literacy programData culture & organization
  2. 2Data literacy: building analytical capability across the organizationData culture & organization
  3. 3Calculating the ROI of data initiativesData strategy & the CDO role
  4. 4Communicating with the board and c-suiteCDO leadership & executive presence
  5. 5Driving cultural change to data-drivenData culture & organization

Finished reading?

Validate your read to earn XP and feed your radar.