mapping AI across the SaaS value chain

The mistake most buyers and executives make is evaluating "AI" as one category. It isn't. A large language modellarge language modelA Large Language Model is an AI system trained on vast text data to predict and generate language, enabling tasks like writing, summarizing, and answering questions.View full definition → (LLMLLMA Large Language Model is an AI system trained on vast text data to predict and generate language, enabling tasks like writing, summarizing, and answering questions.View full definition →: an AI model trained on huge amounts of text to generate and understand language, e.g. GPT-4, Claude) drafting a sales email and a machine learning model predicting customer churncustomer churnChurn rate is the percentage of customers or revenue lost over a period. It measures how fast a business loses its existing customer base.View full definition → are different technologies, with different risk profiles and different payback periods. Judge them separately.

Checkpoint 1: marketing and acquisition

Where it works: Content drafting, ad copy variants, SEOSEOSearch Engine Optimization: the practice of improving your pages' natural (unpaid) rankings in search engine results pages to attract more organic traffic.View full definition → (search engine optimizationsearch engine optimizationSearch Engine Optimization: the practice of improving your pages' natural (unpaid) rankings in search engine results pages to attract more organic traffic.View full definition →) briefs, and lead scoring (ranking prospects by likelihood to convert, using historical conversion data). These are high-volume, low-stakes-per-item tasks where AI's inconsistency is cheap to catch.

Real example: HubSpot and Salesforce both embed generative AI (AI that creates new content: text, images, code) for email drafts and campaign summaries inside their own CRMCRMCustomer Relationship Management: software and strategy to manage and analyse customer interactions throughout their lifecycle.View full definition → (customer relationship managementcustomer relationship managementCustomer Relationship Management: software and strategy to manage and analyse customer interactions throughout their lifecycle.View full definition →) products. Adoption is high because the human stays in the loop reviewing before send.

Where it's theater: "AI-generated full campaign strategy" tools that replace market judgment. Lead scoring models also quietly decay: a model trained on 2023 buyer behavior can misfire by 2026 if the market or pricing shifted. This is called model drift (a model's accuracy degrading over time as real-world data diverges from training data), and it needs monitoring, not one-time deployment.

Simple ROI gut check: if a content team of 4 writers uses an AI drafting tool and cuts first-draft time by 30%, and drafting is 40% of their week, that's roughly a 12% capacity gain. At a fully loaded cost of, say, $90,000/year per writer (US estimate, varies widely), that's near $43,000/year in freed capacity across the team. Freed capacity is not automatically cash saved, it only becomes ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → if redeployed into revenue-generating work.

Checkpoint 2: Onboarding

Where it works: In-app guidance, automated setup checklists, and AI chat that answers "how do I connect Salesforce to this?" during the first session. Onboarding is repetitive and well-documented, exactly what AI handles well.

Userpilot and Pendo both offer AI-assisted onboarding flows as of 2025-2026. The measurable metric is time-to-first-value (how long until a new user experiences the product's core benefit), a standard SaaS KPIKPIKey Performance Indicator, a measurable value that shows how effectively you're achieving a specific objective, tracked over time against a target.View full definition → (key performance indicatorkey performance indicatorKey Performance Indicator, a measurable value that shows how effectively you're achieving a specific objective, tracked over time against a target.View full definition →).

Where it's theater: Fully "autonomous onboarding agents" that promise to replace customer success managers for complex, multi-stakeholder enterprise deals. Enterprise onboarding involves procurement, security review, and internal politics. No model handles that yet.

Checkpoint 3: product (core application)

This is where "AI-powered" gets slapped on features that barely use AI, and where genuinely useful applications hide in plain sight.

Genuinely useful:

• Anomaly detection (flagging unusual patterns automatically) in observability tools like Datadog
• Recommendation engines in tools like Notion or Figma suggesting templates or layouts
• Copilot-style features: GitHub Copilot for code, or Grammarly for writing, embedded directly in the workflow

Theater warning signs:

• A chatbot bolted onto a product with no clear task it solves better than a search bar
• "AI insights" dashboards that summarize data you could read in the same chart
• Marketing that says "powered by AI" without saying what the AI actually predicts or generates

A useful evaluation question for any product AI feature: what decision does this change, and what happens if it's wrong 10% of the time? If the answer is "nothing changes" or "nobody would notice," it's decoration.

Checkpoint 4: customer support

Where it works: Tier-1 ticket deflection (resolving simple, repetitive questions automatically before they reachreachThe number of unique people exposed to your message in a given period. Unlike impressions, reach counts each person once, no matter how often they see it.View full definition → a human agent). Intercom and Zendesk both report meaningful deflection rates from AI assistants on FAQ-style tickets as of 2024-2025 estimates. This is the clearest AI ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → story in SaaS because support tickets are high-volume, repetitive, and easy to measure against.

Worked example:

A company handles 10,000 tickets/month. An AI assistant resolves 25% without human involvement (a plausible, commonly cited deflection rate for mature implementations, estimate). At an average fully loaded cost of $6 per human-handled ticket (US estimate):

• Tickets deflected: 10,000 × 0.25 = 2,500
• Monthly savings: 2,500 × $6 = $15,000
• Annual savings: ~$180,000

Compare that to the tool's annual license cost and implementation time. If the tool costs $60,000/year and took two months to properly tune (a realistic timeline, not a demo-day fantasy), the payback is fast and defensible.

Where it's theater: AI handling complex, emotionally charged, or contractually sensitive tickets (refunds, security incidents, churn saves) without human escalation. Deflecting these badly damages retention more than it saves cost.

Checkpoint 5: engineering and R&D

Where it works: Code completion and code review assistance. GitHub Copilot (built on OpenAI models) and Amazon's CodeWhisperer/Q Developer are widely adopted; independent studies and vendor-reported estimates suggest meaningful productivity gains on routine coding tasks, though gains vary heavily by task type and codebase complexity. Test generation and documentation drafting are similarly strong use cases: bounded, verifiable output.

Where it's theater: "AI will replace your engineering team" claims. Complex architecture decisions, security-critical code, and legacy system integration still require human engineering judgment. AI-generated code also needs review, so the time saved on writing can be partly offset by time spent reviewing, especially with less experienced engineers who trust output too readily.

A relevant technical concept: hallucinationhallucinationA hallucination is when an AI model generates output that is fluent and confident but factually wrong, fabricated, or unsupported by its source data.View full definition → (when an AI model generates plausible-sounding but false or fabricated output). In coding, this shows up as invented library functions or APIs that don't exist. Any engineering AI evaluation should include a hallucinationhallucinationA hallucination is when an AI model generates output that is fluent and confident but factually wrong, fabricated, or unsupported by its source data.View full definition → rate check on your actual codebase, not the vendor's demo repo.

# Simple pattern for evaluating an AI coding suggestion
# before merging: never trust, always verify against tests

def evaluate_ai_suggestion(code_snippet, existing_test_suite):
    passes_tests = run_tests(code_snippet, existing_test_suite)
    uses_real_apis = verify_imports_exist(code_snippet)
    return passes_tests and uses_real_apis

A simple framework for judging any AI claim

Before adopting an AI feature or vendor pitch, ask:

1. What specific task does it replace or accelerate? (vague answers are a red flag)

2. What's the error cost? Low-stakes (draft email) vs high-stakes (financial reporting, security)

3. Is there a measurable baseline before AI, and a metric to track after?

4. What's the review burden? Time saved minus time spent verifying output

5. Does it degrade over time? (model drift, especially in prediction and scoring tools)

For a rigorous, vendor-neutral framework on evaluating AI system risk and reliability, the NIST AI Risk Management Framework (US National Institute of Standards and Technology) is a solid free reference, built for enterprise use but applicable to SaaS buyers evaluating vendor claims.

🎬 [VIDEO: "How Companies Are Actually Using AI (Not the Hype)" - youtube.com/@a16z - a16z's practitioner interviews on real enterprise AI deployment patterns versus marketing claims]

Key Takeaways

• AI ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition → in SaaS is highest where tasks are high-volume, repetitive, and low-stakes-per-error: support ticket deflection, code completion, onboarding guidance, content drafting.
• AI is weakest, and most often theater, where it claims to replace judgment in complex, low-volume, high-stakes situations: enterprise sales, security-critical code, emotionally sensitive support.
• Always separate "AI" into its actual mechanism (generative drafting, classification, prediction, anomaly detection) before evaluating ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →; they behave completely differently.
• Watch for model drift in any predictive or scoring tool (churn models, lead scoring); a model that worked at launch can degrade silently within a year.
• Use a concrete framework (task replaced, error cost, review burden, measurable baseline) rather than vendor demos to judge any AI feature before adoption.