# Mapping the FMCG data landscape beyond the checkout scanner
A single tub of ice cream generates data before it's even frozen. A flavor scientist logs sensory panel scores in a lab system. A demand planner forecasts summer volume in an ERP (Enterprise Resource Planning) module. A trade marketer negotiates a promotional slot with a retailer, tracked in a TPM (Trade Promotion Management) tool. A shopper scrolls past it on Instacart, generating a clickstream event. By the time that tub hits a Walmart scanner, it has already passed through five or six data systems that most category managers never look at together.
That's the problem this lesson solves: knowing which dataset actually answers your question, instead of defaulting to point-of-sale (POS) data because it's the most familiar.
POS scanner data (from Nielsen, Circana, or retailer-direct feeds) tells you what sold, at what price, in which store. It does not tell you:
A common failure mode: a brand sees a volume decline in POS and assumes it's a demand problem, when it's actually an out-of-stock (OOS) problem upstream. Estimates commonly cited in retail literature put average OOS rates at 5 to 8% of SKUs at any given time in US and European grocery (this is a long-standing industry estimate, not a single fresh study, so treat it as directional).
Lives in ERP systems (SAP, Oracle) and warehouse management systems. Key datasets: production volumes, inventory levels, fill rates, on-time-in-full (OTIF) delivery rates, and OSA (on-shelf availability).
OTIF is the workhorse metric here: percentage of orders delivered complete and on time to the retailer's DC (distribution center). Retailers like Walmart and Carrefour set OTIF targets (often cited around 95%) and can fine suppliers for missing them.
Held in TPM platforms (e.g., SAP TPM, Blacksmith, Vistex) plus retailer scorecards. Key datasets: promotional calendars, trade spend by mechanic (price cut, display, feature ad), promotional ROIROIReturn on Investment: the ratio of net profit to the cost of an investment. A 300% ROI means each dollar invested returns $3.View full definition →, and baseline vs. incremental volume.
This is where "data qualitydata qualityThe degree to which data is fit for purpose: accurate, complete, consistent, timely, valid and unique. Poor quality data undermines analytics, reporting and AI.View full definition →" gets political: trade spend is often the second-largest cost line after cost of goods for a consumer brand, yet many companies still reconcile it in spreadsheets, causing chronic mismatches between what finance books and what sales teams claim they spent.
From Nielsen (NielsenIQ), Circana (formerly IRI), and retailer-direct APIs (Kroger 84.51°, Walmart Luminate, Target Roundel). Key datasets: unit sales, ACV (All Commodity Volume, meaning % of total retail dollars in stores carrying your product), market sharemarket shareThe percentage of total industry sales your company captures in a given period. It measures competitive position relative to rivals in a defined market.View full definition →, and price/promotion elasticity.
From retailer.com sites, Amazon, Instacart, and owned DTC (direct-to-consumer) platforms. Key datasets: search sharesearch shareThe proportion of searches in your category that mention your brand, a leading indicator of market share.View full definition → (how often your brand appears in top results for a category search), conversion rateconversion rateThe percentage of visitors or prospects who complete a desired action (purchase, sign-up, contact form), calculated as conversions divided by total opportunities.View full definition →, add-to-cart rate, and digital shelf content compliance (correct images, claims, ingredient lists).
This is the newest and fastest-growing data family. Unlike POS, it captures shopper *intent*, not just outcome, which is why brands increasingly buy retail media data alongside sales data.
Lives in LIMS (Laboratory Information Management Systems) and sensory panel software. Key datasets: hedonic scores (how much panelists like a product, typically on a 9-point scale), shelf-life stability tests, and consumer concept-test results.
This data rarely talks to commercial systems, which is exactly why reformulations sometimes ship without anyone connecting a sensory red flag to a later sales dip.
Think of it as a chain, not a pile:
R&D/Sensory --> Supply Chain/ERP --> Trade Promotion --> Retail POS --> E-commerce/Clickstream
(what) (how much) (at what price) (what sold) (why/intent)A category question like "why did our yogurt brand lose share in Q3" needs at least three of these five families. Pulling only POS data gives you the *what*, never the *why*.
Three governance concepts show up constantly in FMCG data teams:
Master data quality: Product hierarchies (SKU, brand, category, subcategory) must match across ERP, TPM, and POS systems. A common real-world issue: the same SKU has different GTINs (Global Trade Item Numbers, the barcode standard managed by GS1) or product descriptions across US and European systems after an acquisition, breaking cross-market reporting.
Data completeness and latency: Retailer POS feeds can lag by 1 to 7 days depending on the retailer and integration method (EDI vs. APIAPIApplication Programming Interface: a standardised interface that lets applications communicate and exchange data without knowing each other's internal workings.View full definition →). Clickstream data is near real-time. Mixing timeframes without adjusting for lag is a frequent analyst error.
Reconciliation accuracy: Trade spend booked in TPM should tie to finance's general ledger. A tolerance of under 2 to 3% variance is a reasonable working target many CPG finance/controlling teams use informally, though there's no universal regulatory standard for this (it's an internal control benchmark, not a law).
Say Nielsen POS shows your brand's dollar share fell from 18% to 16% in a category over one quarter.
This is why one metric in isolation (share) misleads, and why the lesson's core habit, tracing back through supply chain and trade data, matters.
Knowledge check
1. A brand sees a volume decline in POS data and immediately concludes shopper demand is weakening. What is the key analytical risk in this conclusion?
2. Why is it misleading to rely on POS data as the default source for answering any FMCG business question?
3. A category manager wants to know whether a promotion was executed and funded as agreed with a retailer. Which data family is most directly relevant?
4. Select ALL correct answers about why category managers should look beyond POS data alone.
Select all the correct answers.
5. Select ALL correct answers about the multi-system nature of FMCG data before a product reaches the checkout scanner.
Select all the correct answers.
Most FMCG companies don't have one "data owner." Ownership is typically split:
In regulated categories (food safety, cosmetics), R&D and quality data also feed compliance reporting to bodies like the FDA (US Food and Drug Administration) or EFSA (European Food Safety Authority), which adds retention and traceability requirements distinct from commercial data governancedata governanceData governance is the set of policies, roles, and processes that ensure data is accurate, secure, well-defined, and used responsibly across an organization.View full definition →. Traceability rules (e.g., under EU General Food Law, Regulation (EC) No 178/2002) require companies to track ingredients one step back and one step forward in the supply chain, a very different data discipline from a Nielsen share report.
For a practical primer on retail data standards, GS1's own documentation is a solid free resource: GS1 barcode and traceability standards.
🎬 [VIDEO: "How Barcodes Work (and Why Retail Data Depends on Them)" - https://www.youtube.com/results?search_query=how+barcodes+and+gtin+work+retail - a plain-language explainer on GTINs and scanning, the invisible backbone under every POS dataset]