# Writing an AI governance charter that survives an audit
In 2024, New York City's Automated Decision Systems task force and later the NYC Comptroller's office found that several city agencies were using algorithmic tools (from fraud detection to hiring screens) with no consistent inventory, no documented risk review, and no clear owner if something went wrong. A city inspector general reviewing an agency's chatbot deployment found nobody could produce a record of who approved it, what data trained it, or how complaints were handled. That gap, not the technology itself, is what auditors flag first.
This lesson builds the internal document that closes that gap: an AI governance charter. Not a policy poster. A working file that an auditor, an inspector general (IG, the independent office that investigates waste, fraud, and mismanagement inside a government body), or a city council oversight committee can pick up and follow line by line.
A policy states principles ("we will use AI responsibly"). A charter assigns accountability: who decides, who checks, who signs off, and what happens when a system fails a check. Auditors do not audit intentions. They audit paper trails and decision rights.
The US Government Accountability Office (GAO) and agency inspectors general consistently cite the same failure pattern in AI oversight reviews: tools acquired without a formal risk assessment, no named accountable official, and no incident log (GAO AI Accountability Framework, 2021, still the reference standard for public sector reviews). Your charter exists to prevent exactly that finding.
Every AI system used by or on behalf of the agency (including vendor tools embedded in procurement software) must be logged before deployment. Minimum fields:
This mirrors the tiering logic in the EU AI Act (Regulation (EU) 2024/1689, entered into force August 2024), which bans certain uses outright and classifies systems used in law enforcement, migration, employment, and essential public services as "high-risk," triggering mandatory conformity assessments before deployment. US agencies increasingly use similar tiering voluntarily, referencing the White House Office of Management and Budget's OMB Memo M-24-10 (2024), which requires federal agencies to designate a Chief AI Officer and complete risk assessments for "safety-impacting" and "rights-impacting" AI use cases.
Charter clause language:
> "No AI system may move from pilot to production status without an entry in the AI System Inventory and an assigned risk tier, reviewed at minimum annually or upon material model update."
The single most common audit finding is a responsibility vacuum. Fix it with named roles, not "the IT department":
Before deployment, define a mandatory hold point: any system scoring "medium" or "high" risk cannot go live without written sign-off from the Model Risk Reviewer and Accountable Official.
After deployment, define the incident ladder:
1. Frontline staff or citizen flags an anomaly (wrong benefit denial, biased flagging).
2. Logged within 48 hours to the Data StewardData StewardA business-side owner responsible for the quality, consistency and appropriate use of data in their domain.Voir la définition complète →.
3. Model Risk Reviewer assesses within 5 business days: is this a one-off error or a systemic pattern?
4. If systemic, Accountable Official decides: suspend, patch, or retrain, with the decision documented and dated.
5. Any suspension affecting public-facing service triggers notice to the oversight body (city council committee, state legislature AI task force, or IG office, depending on jurisdiction).
This ladder is what an IG audit actually tests: not "did you have a policy" but "did you follow your own escalation path the last time something broke."
Auditors want artifacts, not narratives. Minimum documentation per system:
/ai-system-record/
01_intake_form.pdf (purpose, vendor, data sources)
02_risk_assessment.pdf (tier, bias testing results, sign-off dates)
03_human_review_log.csv (every override of an AI recommendation)
04_incident_log.csv (date, description, resolution, owner)
05_annual_review.pdf (re-certification or retirement decision)Retention period should match your jurisdiction's public records law, typically the same schedule applied to the underlying government function (benefits records, procurement records, personnel records). This is not optional archiving; several city and state IG reports have specifically cited missing retention schedules as an audit failure, since incomplete records prevent reconstruction of how a contested decision was made.
Before a system clears Clause 1's hold point, run these checks:
1. Bias and disparate impact test: compare outcomes across demographic groups where data allows, using established fairness metrics (e.g., demographic parity, equalized odds).
2. Data provenance check: confirm training and input data sources are lawfully obtained and appropriately scoped (no unauthorized personal data).
3. Human-in-the-loop confirmation: for any high-risk tier, a human must be able to review and override before the decision takes effect on a person, not after.
4. Vendor transparency check: does the contract give the agency audit rights over the model's logic and update history? Many procurement failures trace back to vendor contracts that block this.
5. Public notice check: does the jurisdiction require public disclosure of automated decision system use (as NYC's Local Law 144 requires for automated employment decision tools)?
Vérification des acquis
1. What is the key functional difference between an AI 'policy' and an AI 'governance charter' from an auditor's perspective?
2. Based on the recurring failure pattern cited by GAO and inspectors general, what is the most fundamental gap auditors flag first in AI oversight reviews?
3. Why does the lesson specify that vendor tools 'embedded in procurement software' must also be logged in the system inventory?
4. Select ALL correct answers about what an effective AI governance charter must be able to demonstrate to an inspector general or auditor.
Sélectionnez toutes les réponses correctes.
5. Select ALL correct answers about the purpose of system inventory and risk tiering as a core charter clause.
Sélectionnez toutes les réponses correctes.
Picture a mid-size city deploying an AI tool to triage 311 service requests (non-emergency citizen complaints) by urgency. Under the charter: it enters the inventory as medium risk (it affects service order but not eligibility or rights). The Model Risk Reviewer tests it for neighborhood-level bias, since urgency scoring could systematically deprioritize lower-income areas. The Accountable Official signs off with a human dispatcher retaining override authority. Three months in, a council member's office flags a pattern: complaints from one district are consistently deprioritized. The incident ladder triggers, the pattern is confirmed, and the model is retrained with logged justification. When the city comptroller's office later audits the program, every step has a timestamp and a name attached.
🎬 [VIDEO: "How Government Agencies Are Regulating AI" - youtube.com - search for GAO or Brookings Institution explainers on federal AI oversight frameworks and agency accountability structures]