# Sizing the prize: building AI business cases that survive scrutiny
A global carmaker runs a pilot: a model that predicts which vehicles will file warranty claims before they fail. Six weeks in, the team presents a slide claiming $40 million in annual savings. The CFO asks one question: "How much of that would we have saved anyway without AI?" The room goes quiet. The pilot dies.
This is how most automotive AI business cases fail. Not because the technology does not work, but because the ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → (return on investmentreturn on investmentReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →) model cannot survive scrutiny. Let us build one that does.
Warranty is a real cost center. Automakers set aside billions in warranty reserves each year. Estimates from industry warranty tracking (Warranty Week, historical data) put major automaker warranty spend in the range of 1.5 to 3 percent of product revenue, though this varies by manufacturer and year.
The AI use case is genuine: predict component failures earlier using sensor data, dealer repair records, and supplier batch information. Catch a failing part before it becomes a field failure, or spot a defective supplier batch before it spreads across 200,000 vehicles.
But "predict failures" is not a business case. A business case isolates what the AI specifically changes, over what timeline, at what cost.
The single biggest error is claiming credit for savings the company would capture anyway.
Warranty spend already trends down through normal engineering fixes, supplier negotiations, and quality programs. Your AI model does not get credit for that baseline improvement.
The isolation rule: AI-attributable savings = (outcome with AI) minus (outcome from the counterfactual baseline).
Concrete example. Suppose a vehicle line files $100 million in warranty claims annually. Existing quality programs are already reducing that by 4 percent per year. If the AI model reduces claims by 7 percent, the AI-attributable portion is only the incremental 3 percent, not the full 7.
$$\text{AI savings} = 100M \times (0.07, 0.04) = 3M$$
Not $7 million. This distinction is what separates a defensible model from a pilot that dies in the CFO's office.
The credible method is a holdout group: apply AI predictions to one set of vehicle lines or regions, withhold it from a comparable set, and measure the difference. This is the same logic as an A/B testA/B testA/B testing is a controlled experiment that compares two versions of something (A and B) by splitting traffic randomly to learn which performs better on a chosen metric.View full definition →.
If a full holdout is impossible, use a pre/post comparison with a control: track the AI-covered fleet against a similar non-covered fleet over the same period, so external factors (a harsh winter, a new model launch) hit both groups equally.
The second error is assuming full benefit from day one.
AI systems ramp. A warranty prediction model needs time to accumulate labeled failure data, tune thresholds, and earn dealer trust before technicians act on its alerts.
A realistic ramp for a warranty model might look like this (illustrative, not a benchmark):
| Quarter | % of steady-state benefit realized |
|---------|-----------------------------------|
| Q1 | 10% |
| Q2 | 30% |
| Q3 | 60% |
| Q4 | 85% |
| Year 2+ | 100% |
If steady-state annual savings are $3 million, Year 1 does not deliver $3 million. It delivers the weighted average across the ramp:
$$3M \times \frac{(0.10 + 0.30 + 0.60 + 0.85)}{4} = 3M \times 0.46 \approx 1.4M$$
Presenting $3 million as the Year 1 number, then missing it, destroys credibility for every future AI proposal. Show the ramp explicitly.
Everyone counts the model development cost. Almost no one counts the ongoing costs that make the model actually work.
A supervised warranty model learns from labeled examples: "this repair was a genuine defect," "this claim was fraudulent," "this part failed for reason X." Someone has to create those labels, and dealer repair notes are messy free text.
Labeling is not a one-time cost. Failure modes evolve with each model year, so labels need continuous refresh. Budget for it explicitly.
Illustrative cost structure for a warranty prediction model:
For a primer on the hidden costs and lifecycle of production models, Google's MLOps guide is a solid free resource.
Pulling it together for Year 1, illustrative figures:
| Line | Amount |
|------|--------|
| AI-attributable savings (ramped) | +$1.4M |
| Model development (one-time) | -$0.8M |
| Historical data labeling (one-time) | -$0.4M |
| Ongoing labeling + monitoring + MLOpsMLOpsMachine Learning Operations: combining ML and DevOps practices to industrialise, deploy, monitor, and retrain models reliably in production.View full definition → | -$0.5M |
| Year 1 net | -$0.3M |
Year 1 is negative. That is fine, and it is honest. Steady-state Year 2+ looks very different:
| Line | Amount |
|------|--------|
| AI-attributable savings (full) | +$3.0M |
| Ongoing labeling + monitoring + MLOpsMLOpsMachine Learning Operations: combining ML and DevOps practices to industrialise, deploy, monitor, and retrain models reliably in production.View full definition → | -$0.5M |
| Year 2 net | +$2.5M |
A model showing Year 1 loss and Year 2+ gain survives scrutiny far better than one claiming instant millions.
Knowledge check
1. When the CFO asks 'How much of that would we have saved anyway without AI?', what fundamental flaw in the business case is being exposed?
2. According to the isolation rule, how should AI-attributable savings be calculated?
3. Why does the lesson argue that 'predict failures' is not itself a business case?
4. Select ALL correct answers about why the counterfactual baseline matters in an AI business case.
Select all the correct answers.
5. Select ALL correct answers about what makes an AI business case survive scrutiny.
Select all the correct answers.
Before presenting, attack your own numbers the way a skeptical executive will.
Attribution challenge: "Prove the savings are AI, not our new supplier." Answer with your holdout or control group.
Precision challenge: A model that flags too many false positives wastes technician time and destroys trust. If the model predicts a failure and the part is fine, that is a false positive, and each one carries a real cost (unnecessary inspection, dealer frustration). Include false-positive handling cost in the model, and report precision (of the parts flagged, what fraction actually failed) alongside savings.
Adoption challenge: A prediction no one acts on saves nothing. If dealers ignore alerts, benefit is zero regardless of model accuracy. Adoption rate belongs inside the ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → model, not as an afterthought.
Data availability challenge: The model needs telematics or sensor data. In Europe, vehicle data use is governed by the GDPR (General Data Protection Regulation), and connected-vehicle data can include personal data tied to a driver. In the US, there is no single federal equivalent, but state laws such as the CCPA (California Consumer Privacy Act) apply. If your data pipelinedata pipelineETL (Extract, Transform, Load) is a data integration process that pulls data from sources, reshapes it into a consistent format, and writes it into a target system.View full definition → is not compliant, the savings are not real because the data cannot be used. Name the legal constraint in the business case.
The warranty case is a template. The same discipline applies to other genuine automotive AI uses:
In every case the structure holds: isolate the incremental AI effect, model the ramp, count the hidden operating costs, and put adoption inside the model.
Be equally clear about where AI does not yet deliver clean ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →. Fully autonomous driving remains capital-intensive with uncertain payback timelines. A warranty prediction model is a far more defensible near-term bet than a robotaxi program, and your business case should reflect that realism.