# Mapping the regulatory landscape for hospital AI
A sepsis-prediction tool flags a patient in Bed 12 as high-risk. That single alert just touched four different regulatory regimes. The FDA cares whether the algorithm is a cleared medical device. HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. cares how the patient's data moved to train and run it. ONC transparency rules care whether the clinician can see how the score was built. And the Joint Commission cares whether your hospital governed the whole thing responsibly.
Nobody hands you a mapmapUsing software to automate repetitive marketing tasks and campaigns, enabling personalisation at scale across channels like email, web, and social.Voir la définition complète → showing which rule binds which part. This lesson draws it.
Think of four overlapping circles, each owned by a different body.
They overlap. A single deployment can trigger all four. The trick is knowing which trigger fires when.
The FDA's domain is SaMD (Software as a Medical Device): software that performs a medical function without being part of a hardware device.
The key question: does the software diagnose, treat, or drive a clinical decision? A sepsis model that outputs a risk score to guide treatment is very likely SaMD. A tool that only summarizes existing chart notes for a clinician to read may not be.
Most predictive clinical tools clear the FDA through the 510(k) pathway, which shows the device is "substantially equivalent" to one already on the market. Higher-risk tools may need the stricter De Novo or PMA (Premarket Approval) routes.
Two traps for hospitals:
1. Home-grown models. If your data science team builds a sepsis model in-house and uses it only inside your own hospital, FDA has historically exercised enforcement discretion, meaning it often does not require clearance. Buy the same capability from a vendor and it usually needs clearance. Same math, different rule, because the trigger is commercial distribution.
2. The model that keeps learning. Traditional clearance assumes a frozen algorithm. For models that update over time, the FDA introduced the Predetermined Change Control Plan (PCCP): you pre-declare what the model is allowed to change and how you will validate it, so retraining does not require a new submission each time.
You can search cleared AI devices in the FDA's public list of AI-enabled medical devices.
HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. does not care whether your model is clever. It cares about PHI (Protected Health Information): identifiable patient data.
Where HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. bites in an AI project:
A common failure: a data scientist pipes live records into a general-purpose large language modellarge language modelA Large Language Model is an AI system trained on vast text data to predict and generate language, enabling tasks like writing, summarizing, and answering questions.Voir la définition complète → with no BAA to "test an idea." That is a reportable breach waiting to happen.
ONC regulates certified health IT, which is the EHR software (Epic, Oracle Health, and others) that hospitals rely on for Medicare and Medicaid programs.
Under the HTI-1 rule (Health Data, Technology, and Interoperability, finalized 2024), certified EHRs that surface predictive decision support interventions (DSIs), meaning AI or algorithmic recommendations, must expose a set of "source attributes." In plain terms, the clinician (or the hospital) must be able to see a kind of nutrition label for the algorithm:
So if your sepsis score shows up inside Epic, HTI-1 governs whether users can pull up that label. This is transparency, not approval. ONC does not say the model is good. It says you must be able to see what it is.
The Joint Commission accredits hospitals and, as of 2025, published responsible use of AI guidance for healthcare organizations. Its focus is not the algorithm, it is your process around it:
This is where the other three regimes get operationalized. The FDA clears the tool, HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. protects the data, ONC exposes the label, and the Joint Commission checks that your hospital actually runs the guardrails.
Here is the sepsis model, mapped:
| Regime | What it governs | Trigger |
|---|---|---|
| FDA | The algorithm as a device | Sold by a vendor, drives clinical decisions |
| HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. | Patient data used and moved | Any use of identifiable PHI |
| ONC HTI-1 | Transparency label in the EHR | Surfaced through certified health IT |
| Joint Commission | Hospital governance and monitoring | Any AI used in accredited operations |
Notice: an in-house model skipping the EHR might dodge FDA clearance and ONC labeling, but it still faces HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. and the Joint Commission. Regimes overlap, they do not substitute.
A minimal pre-deployment checklist as pseudocode:
for tool in ai_deployments:
if tool.drives_clinical_decision and tool.is_vendor_supplied:
require FDA_clearance(pathway in [510k, DeNovo, PMA])
if tool.uses_PHI:
require de_identification OR (BAA_signed and encryption_enabled)
if tool.surfaced_in_certified_EHR:
require HTI1_source_attributes_available
require JointCommission.governance(monitoring, bias_check, staff_disclosure)Vérification des acquis
1. A hospital deploys a tool that only compiles and summarizes existing chart notes for a clinician to read, without producing risk scores or treatment guidance. Why is this tool less likely to be regulated as SaMD by the FDA?
2. The lesson notes that the Joint Commission is 'not a government agency, but hospitals treat it as binding.' What is the best explanation for this apparent contradiction?
3. A single sepsis-prediction alert can implicate four regulatory regimes at once. What is the core conceptual point the lesson makes about these regimes?
4. Select ALL correct answers. Which regulatory concerns would be triggered by a sepsis model that produces a risk score inside a certified EHR using patient data?
Sélectionnez toutes les réponses correctes.
5. Select ALL correct answers. Which statements correctly describe the FDA's role and the 510(k) pathway as presented in the lesson?
Sélectionnez toutes les réponses correctes.
"It's just decision support, so FDA doesn't apply." Sometimes true, but if the tool nudges treatment and comes from a vendor, assume SaMD until proven otherwise. The intended-use language in your marketing matters as much as the code.
"We de-identified, so HIPAA is done." De-identification must meet the HIPAAHIPAAHealth Insurance Portability and Accountability Act, loi américaine imposant la protection des données de santé (PHI). Violations : amendes jusqu'à 1,9M$ par catégorie de violation. standard (Safe Harbor removal of 18 identifiers, or Expert Determination). Dropping only the patient name is not enough.
"The vendor is FDA-cleared, so we're covered." Clearance covers the device. It does not cover your monitoring, your BAA, or your EHR transparency. Those are yours.
"HTI-1 means the model is approved." No. ONC transparency is about visibility, not endorsement. A poorly performing model can still show its label.
For readers deploying across the Atlantic: the EU AI Act (in force from 2024, with obligations phasing in through 2026 and 2027) classifies most clinical AI as high-risk, layering conformity assessment on top of existing MDR (Medical Device Regulation) device rules. The structure differs, but the instinct is the same: prove the tool is safe, keep the data lawful, and govern the deployment.