+150 XP

How a single transaction becomes bankable data

# How a single transaction becomes bankable data

You tap your card at a coffee shop. The payment clears in under two seconds. In that blink, a chain of systems has captured, checked, enriched, and routed your transaction across at least four institutions. By the time you pocket your card, the event exists as structured data in multiple databases, each version serving a different purpose.

That single swipe is the atomic unit of banking data. Understand its journey and you understand where every fraud model, spending report, and regulatory filing gets its raw material.

The two lives of a transaction: authorization and settlement

A card payment happens twice. This surprises most people.

Authorization is the real-time check. When you tap, the merchant's system asks your bank a question: "Is this card valid, and is there enough money or credit?" Your bank answers yes or no in milliseconds. No money moves yet. A hold is placed.

Settlement is the actual movement of money, usually hours or a day later, in batches. This is when funds leave your account and reach the merchant.

Why split them? Speed and reliability. The merchant needs an instant yes to hand you the coffee. Moving real money instantly across banks is slower and riskier, so it happens later in bulk.

For data teams, this matters enormously. The authorization record and the settlement record are two separate data events describing the same purchase. Reconciling them (matching auth to settlement) is a core banking data problem, because they can differ. A $50 authorization at a gas pump might settle at $47.32.

Who touches the data: the four-party model

A typical card transaction involves four players, each generating and storing their own copy of the data.

  • Cardholder's bank (issuer): the bank that gave you the card.
  • Merchant's bank (acquirer): the bank that processes payments for the coffee shop.
  • Card network (scheme): Visa, Mastercard, and similar. They route messages between issuer and acquirer.
  • Merchant: the coffee shop and its point-of-sale system.

The card network defines the data format everyone must speak. For decades that format has been based on the ISO 8583 message standard, a compact, field-based structure for financial transaction messages. The industry is migrating toward the richer ISO 20022 standard, which carries far more structured detail (see the ISO 20022 resource centre).

What data the swipe actually creates

An authorization message is not just "amount and card number." It is a packed set of fields. A simplified view of the core data captured at tap:

json
{
  "pan_token": "tok_4f9a...c21",       // tokenized card number, not the real PAN
  "amount": 5.40,
  "currency": "USD",
  "merchant_id": "MID_00874512",
  "merchant_category_code": "5814",    // MCC: fast food restaurants
  "terminal_id": "TERM_39",
  "timestamp": "2026-03-14T08:12:44Z",
  "auth_response": "00",               // 00 = approved
  "entry_mode": "contactless"
}

A few of these fields do heavy lifting downstream:

  • PAN token: The real card number (Primary Account Number) is almost never stored raw. It is replaced by a token, a stand-in value, to reduce risk. This is a requirement under the PCI DSS (Payment Card Industry Data Security Standard), the security rulebook for handling card data.
  • MCC (Merchant Category Code): A four-digit code classifying the merchant type. MCC 5814 means fast food. This one field powers spending categorization, rewards ("3% on dining"), and risk rules.
  • Entry mode: Contactless, chip, or online. Feeds fraud scoring, because card-not-present transactions carry different risk.

The transaction is born structured. That is the key insight. Unlike a customer email or a call transcript, a card swipe arrives as clean, typed fields ready for a database.

Enrichment: turning a code into meaning

Raw fields are terse. A merchant name might arrive as "SQ *BLUE BOTTLE 4471" with no location. Enrichment is the step where the bank adds context.

Common enrichment steps:

  • Merchant clean-up: Turning "SQ *BLUE BOTTLE 4471" into "Blue Bottle Coffee, San Francisco." Banks either build this themselves or buy it from data vendors.
  • Geolocation: Attaching coordinates or a city from the terminal ID.
  • Category mapping: Translating the MCC into a human label and a bank-specific category ("Dining out").
  • Currency conversion: Recording both original and account currency for cross-border spend.

Enriched data is what you see in a mobile banking app, with a logo, a clean name, and a category. That polish is the product of a pipeline, not the raw swipe.

🎬 [VIDEO: "How Credit Card Processing Works" - youtube.com - a clear walkthrough of the authorization and settlement flow between issuer, acquirer, and network]

Where the data lands: from live systems to the warehouse

The transaction now lives in several places, each tuned for a different job.

The core banking system

The core banking system is the bank's system of record for accounts and balances. It holds the authoritative version: your balance changed, this posting is final. Core systems prioritize accuracy and durability over analytics. You do not run marketing queries against the core.

The operational data store

A near-real-time copy feeds fraud detection and the mobile app. Fraud models need transactions within seconds, so this layer is optimized for fast lookups and streaming.

The data warehouse and lakehouse

For analytics, transactions are copied (usually in nightly or streaming batches) into a data warehouse, a system built for large-scale querying and reporting. Increasingly banks use a lakehouse, which combines a low-cost data lake (raw storage for any format) with warehouse-style query power.

Here the transaction joins years of history. It becomes one row among billions, feeding:

  • Fraud and financial crime models (is this pattern unusual for this customer?).
  • Credit risk scoring (spending behaviour as a repayment signal).
  • Regulatory reports (aggregated transaction data for capital and liquidity reporting).
  • Customer analytics (segmentation, product recommendations).

Lineage and governance

Regulators expect banks to explain where a number came from. Data lineage is the documented trail showing how a figure in a report traces back to source transactions. After the financial crisis, the Basel Committee issued principles known as BCBS 239 on risk data aggregation, pushing banks to prove their data is accurate and traceable. That is why a single swipe carries metadata about its origin all the way through the pipeline.

Knowledge check

1. Why do card payment systems separate authorization from settlement rather than moving money instantly?

2. A gas pump authorizes $50 but the transaction later settles at $47.32. What core banking data challenge does this illustrate?

3. During the authorization step of a card payment, what actually happens?

MULTIPLE CHOICE

4. Select ALL correct answers about why a single transaction produces multiple versions of data across institutions.

Select all the correct answers.

MULTIPLE CHOICE

5. Select ALL correct answers describing roles in the four-party card model.

Select all the correct answers.

Why the same swipe produces different numbers

A recurring headache: two reports show different totals for "yesterday's spend." Usually neither is wrong. They are measuring different versions of the same transaction.

  • The authorization total includes holds that may never settle.
  • The settlement total reflects final amounts, which can be lower or reversed.
  • A posted total is what actually hit the account after adjustments.

Add timing. A transaction authorized at 11:58pm might settle the next day, so it lands in a different reporting period. Cross-border transactions add currency conversion timing.

This is why banking data teams obsess over definitions. "Number of transactions" is meaningless until you specify: authorized or settled? Approved only or including declines? Gross or net of reversals? A good data model captures every state a transaction passes through, so any question can be answered consistently.

The lifecycle in one line

Tap, authorize, enrich, settle, post, reconcile, warehouse, model. Each step writes or updates data, and each downstream system reads a version suited to its purpose. The coffee you bought is now a permanent, queryable, governed record that will help score the next transaction for fraud and feed a report a regulator reads next quarter.

Key Takeaways

  • A transaction happens twice. Authorization is the instant check with no money movement; settlement is the actual, later transfer. They are separate data events that must be reconciled and can differ in amount.
  • The swipe is born structured. Card data arrives as clean, typed fields (amount, MCC, entry mode, tokenized card number), which is why banking transaction data is unusually analysis-ready compared with most business data.
  • Enrichment creates the product. The clean merchant name, logo, and category you see in an app are added in a pipeline, not present in the raw message.
  • The same transaction lives in many systems. Core banking (system of record), operational stores (real-time fraud and app), and the warehouse or lakehouse (analytics) each hold a version tuned for its job.
  • Definitions decide the number. Authorized, settled, and posted totals differ legitimately. Regulatory expectations like BCBS 239 mean banks must trace every reported figure back to its source transactions.