AI Governance 101
A self-paced course (~2.5 hours) on how AI governance works in practice — the global principles behind it, the frameworks that structure it, the risks it manages, and the engineering controls and operating practices that make AI systems safer before and after deployment.
By the end of this course, you will be able to:
- Describe the OECD AI Principles and UNESCO's ethics-of-AI principles, and recognize how the same core themes recur across global principle sets — including India's 7 Sutras.
- Compare the common Responsible AI principles and processes used across frontier AI companies — evaluations, red-teaming, model cards, frontier safety policies, and staged releases.
- Identify core Responsible AI risks in engineering contexts, including safety, bias, privacy, security, and misuse.
- Interpret major Responsible AI frameworks — NIST AI RMF, ISO/IEC 42001, and the EU AI Act — and connect their requirements to day-to-day engineering practice.
- Evaluate AI use cases for potential harm, failure modes, and risk severity before deployment.
- Apply practical controls for data-, model-, and system-level risk mitigation during development.
- Design monitoring and escalation practices that support safer AI behavior in production.
How to take this course
Work through the modules in order — later modules build on earlier ones. Each module ends with either an interactive exercise or a knowledge check; do them, they are where the learning sticks. Budget around 2.5 hours in total, or take it in three sittings: Part I — Concepts & principles (Modules 1–8), Part II — Industry & risk (Modules 9–10), Part III — Practice (Modules 11–14 + quiz). Turn on Auto-voice in the top bar to have every screen read aloud with your browser's built-in text-to-speech.
Meet your course designer — Sakthi Thangavelu
Sakthi Thangavelu
AI GOVERNANCE CONSULTANT · ISO 42001 LEAD AUDITOR, TRAINER & IMPLEMENTATION EXPERT
A governance, risk and compliance professional with 24 years in the IT industry, practicing across AI governance, privacy, and information security. Sakthi audits and trains on ISO/IEC 42001 with multiple certification bodies, and serves as lead consultant working with AI governance startups — bringing this course the perspective of someone who implements and audits these frameworks in the field, not just reads about them.
Field experience behind this course
- Contractor auditor & trainer for ISO 42001 with multiple certification bodies; Stage 1 & Stage 2 AIMS audits completed.
- AI Management System (AIMS) implementation for multiple AI startups; AIMS internal audits for enterprises.
- Senior leadership roles in global data privacy and privacy office functions at leading IT services organizations; ISMS committee member.
- Led a 3-year information security & data de-identification program safeguarding 15M individuals' personal data in the healthcare sector.
- 15+ batches of ISO 42001 Lead Implementer / Lead Auditor training delivered to corporate and professional audiences.
Certifications
- Certified Lead Auditor — ISO/IEC 42001:2023, ISO/IEC 27001:2022, ISO/IEC 27701:2019
- Certified Lead Implementer — ISO/IEC 42001:2023
- Certified Information & Privacy Manager (IAPP)
- Certified Responsible AI Professional & Fellow of Privacy Technology (OneTrust)
CONNECT: linkedin.com/in/sakthithangavelu
Register to begin — and to receive your completion certificate
Enter your name and email ID before starting the modules. Your name appears on the completion certificate at the end of the course. Both fields are required to continue.
Your details are used only to personalize your completion certificate. They stay in your browser for this session and are not transmitted or stored anywhere.
AI Ethics, Responsible AI, Trustworthy AI, AI Governance — what's the difference?
These four terms are often used interchangeably, but they sit at different layers. AI Ethics provides the moral compass, Responsible AI provides the roadmap and journey, Trustworthy AI is the destination, and AI Governance is the structure that implements and enforces the whole climb.
Start with an everyday story: the Ola cab driver analogy
Think of a single Ola ride. The same four layers appear — beliefs, behavior, experience, and enforcement:
AI Ethics = what the driver believes
"Passengers should be safe, treated with respect, and charged honestly." These are moral principles — statements of what should happen. On their own, they change nothing; a driver can hold them and still drive badly.
Responsible AI = what the driver actually does
Follows traffic rules, takes the shortest sensible route, drives sober, doesn't share the passenger's number. Principles applied in practice, trip after trip. For AI teams: bias testing, privacy safeguards, documentation — done, not declared.
Trustworthy AI = what the passenger experiences
Rides that are consistently safe, on time, and fairly priced — earning a 5-star rating and repeat bookings. Trust is a property earned as an outcome, not an action you take. For AI: a system users find reliable, fair, explainable, and secure.
AI Governance = what Ola the platform runs
Driver background checks, GPS route tracking, metered fares, ratings and reviews, an SOS button, and deactivation for violations. Structures that implement and enforce the values — so good behavior doesn't depend on each driver's goodwill. For AI: policies, review boards, audits, and monitoring.
Now see it as a pyramid
Stack the four layers and you get the AI Ethics & Governance Hierarchy — Ethics at the base as the foundation of values, Responsible AI and Trustworthy AI building on it, and Governance at the top, implementing and enforcing everything below it:
The subtle difference in one line each
- AI Ethics — the beliefs: what should be true.
- Responsible AI — the behavior: what we do to make it true.
- Trustworthy AI — the result: what the system demonstrably is, as experienced by users.
- AI Governance — the system: how an organization guarantees it, at scale and over time.
Which layer does this belong to?
Your company publishes a value statement: "Our AI will never discriminate." Six months later, an internal audit committee starts reviewing every AI feature against that statement before launch, with authority to block releases. The audit committee is an example of…
AI is embedded in everyday life — governance has to catch up
From healthcare to transportation, AI has moved from the lab into daily life. Scale changes the stakes: failures now affect patients, passengers, applicants, and markets — and three well-documented incidents show what happens when governance lags.
Three incidents every engineer should know
Amazon's recruiting tool (2018)
An internal AI resume-screening tool, trained on a decade of past hiring data, learned to penalize resumes containing the word "women's" and downgrade graduates of women's colleges. Amazon scrapped it. Lesson: historical data encodes historical bias; without fairness testing, the model faithfully automates it.
Dutch childcare benefits scandal
A government risk-scoring algorithm wrongly flagged tens of thousands of families for benefits fraud, disproportionately those with dual nationality — pushing families into debt and contributing to the Dutch cabinet's resignation in 2021. Lesson: automated decisions at population scale can devastate lives; harm to people is not hypothetical.
Air Canada's chatbot (2024)
The airline's website chatbot invented a bereavement-fare refund policy. A tribunal ruled Air Canada liable for its chatbot's statements and ordered compensation. Lesson: "the AI said it, not us" is not a defense — organizations own their AI's outputs.
What enterprises are doing
In McKinsey's 2025 State of AI survey, risk & compliance (57%) and data governance (46%) are the most centralized elements of AI deployment — organizations treat them as too important to leave scattered, while tech talent is often hybrid.
Gartner (June 2025) found 91% of high-maturity organizations have appointed dedicated AI leaders — and their #1 implementation barrier is security threats (48%), followed by data availability/quality (29%). Low-maturity organizations struggle first with finding the right use cases (37%).
What "AI harm" means (NIST AI RMF)
- Harm to people — individual (civil liberties, physical or psychological safety, economic opportunity), group/community (discrimination against a sub-group), societal (democratic participation, educational access).
- Harm to organizations — business disruption, security breaches, monetary loss, reputation.
- Harm to ecosystems — interconnected systems: supply chains, the global financial system, natural resources and the environment.
Map the three cases: Amazon = harm to people (group) and the organization's reputation; the Dutch scandal = harm to people at societal scale; Air Canada = harm to the organization (monetary + reputation).
The layers of AI governance — what a program actually has to govern
"AI governance" is not one activity — it is a canvas of layers that a program must cover. Before we get into definitions and frameworks, here is the map: six layers you will see again and again, from board-level policy down to the carbon footprint of a training run.
Governing policies
- Enterprise AI policy — what is allowed, what is prohibited, who decides
- Ethics board / steering committee with authority to block launches
- Board-level accountability and clear decision rights
Resources & competencies
- Budget and named owners — governance without funding is theater
- Skills: AI literacy for everyone, specialist training for builders and reviewers
- Tooling for evaluation, monitoring, and documentation
Risk management
- Risk registers and impact assessments per use case
- Defined risk appetite — what the organization will and won't accept
- Controls, internal audits, and regulatory compliance mapping
AI system lifecycle
- Stage gates: ideation → data → build → validate → deploy → monitor → retire
- Change management across the whole pipeline — data, prompts, libraries, weights
- Documentation that travels with the system, version to version
Climate & environmental impact
- Track energy use and CO₂ emissions of training and inference workloads
- Right-size models — the smallest model that meets the need
- Report AI's footprint within sustainability commitments
Data, compliance & stakeholders
- Data governance: quality, provenance, rights, privacy
- Transparency to users, regulators, and affected communities
- Grievance and redress channels for people impacted by AI decisions
Zooming out: the same layering repeats at every altitude
Countries govern AI with national strategies and regulation (1,000+ initiatives in the OECD.AI repository). Enterprises govern it with the six layers above. And inside the enterprise, governance cascades again — organizational level, AI-system level, model level — which is exactly where the next module picks up.
What AI governance is — and how enterprises structure it
AI governance is the system by which an organization manages its development and use of AI: the governance structures, policies, skills, and practices that guide AI use, monitoring, and management — so AI aligns with stakeholder objectives, is used responsibly and ethically, and complies with applicable requirements.
Recap: what "trustworthy" means, precisely (NIST)
Module 1 said Trustworthy AI is the destination. NIST defines what that destination looks like — a trustworthy AI system is: valid & reliable, safe, secure & resilient, explainable & interpretable, privacy-enhanced, fair with harmful bias managed, and accountable & transparent — balanced according to the system's context of use. Neglecting these characteristics increases both the probability and the magnitude of negative consequences.
An enterprise AI governance program runs at three levels
| Level | Scope & typical artifacts | Approach |
|---|---|---|
| Organizational level | AI policy, ethics/steering committee, roles & competencies, regulatory-compliance mapping, stakeholder expectations, risk & sustainability management, internal audits, alignment with org values. | Process-driven |
| AI-system level | Data management, impact assessments, use-case verification & validation, internal/external communications, system documentation, alignment with the AI policy. | Tool and process-driven |
| Model level | Training & evaluation, performance monitoring, testing, documentation, change management, alignment with system requirements. | Tool-based, metrics-driven |
A useful cross-check: practitioner maps of the discipline (e.g. Regulations.ai) break it into 12 recurring areas — board oversight, risk management, documentation & records, human oversight & ethical safeguards, transparency & disclosure, data governance, testing & validation, incident management, AI supply-chain governance, AI literacy & culture, compliance monitoring, and enforcement & penalties. If your program has an answer for each, you have coverage.
Standard vs. Framework vs. Regulation — tap each card to flip it
How they interact in real life
These instruments stack rather than compete. A bank in the EU might be required to meet the EU AI Act (regulation), choose to structure its program on NIST AI RMF (framework), and certify against ISO 42001 (standard) to demonstrate compliance to customers and auditors. Standards and frameworks are often the practical "how" behind a regulation's "what."
NIST AI RMF, ISO/IEC 42001, and the EU AI Act — what each actually asks of you
These are the three instruments you'll most often be asked to "comply with" or "align to." Here's what each one contains, and what it means at your desk.
NIST AI Risk Management Framework — four functions
| Function | What it means | Engineering translation |
|---|---|---|
| Govern | A culture of risk management is cultivated and present — policies, roles, accountability, at the center of everything. | Your team has an AI policy, a named risk owner, and review gates in the release process. |
| Map | Context is recognized; risks related to context are identified, with contributing factors. | Before building: document intended use, users, misuse potential, and affected groups. |
| Measure | Identified risks are assessed, analyzed, tracked — including metrics for trustworthiness, social impact, human-AI configurations. | Benchmarks, fairness metrics, red-team results, tracked over versions. |
| Manage | Risks are prioritized and acted on based on projected impact; mitigation is monitored. | Risk register with owners, mitigations shipped, monitoring dashboards, incident runbooks. |
ISO/IEC 42001 — the AI Management System standard
A management system standard (MSS) for organizations that develop or deploy AI — the same species as ISO 9001 (quality), ISO 14001 (environment), ISO/IEC 27001 (information security), and ISO 27701 (privacy). MSS benefits: performance and continuous improvement, efficient resource use from leadership down, risk management, consistent products and services — applicable across sectors, sizes, and geographies.
It follows the familiar Plan-Do-Check-Act loop: context & leadership, AI policy and objectives, risk and impact assessment, operational controls, performance evaluation, audits, and continual improvement. Organizations can be certified against it — increasingly requested in procurement.
EU AI Act (2024) — the risk pyramid
High-risk obligations include: risk management system, data governance, technical documentation, logging, human oversight, accuracy/robustness/cybersecurity requirements, and registration. Penalties scale up to a percentage of global turnover.
Triage the use case: which EU AI Act tier?
Assign each AI use case to the tier where it most likely belongs. Tier definitions are above.
The OECD AI Principles
Adopted in 2019 and updated in 2024, the OECD AI Principles were the first intergovernmental standard on AI — endorsed by 47+ adherent countries and the basis for the G20 AI Principles. Five values-based principles for trustworthy AI, plus five recommendations for policymakers.
Inclusive growth, sustainable development & well-being
AI should benefit people and planet — augmenting human capabilities, advancing inclusion, and reducing inequality.
AT YOUR DESK: ask who benefits and who bears the cost of your use case; consider compute/energy footprint.
Human rights & democratic values, fairness & privacy
Respect the rule of law, human rights, equality, and privacy across the AI lifecycle, with safeguards such as human oversight.
AT YOUR DESK: human-in-the-loop for consequential decisions; data minimization by default.
Transparency & explainability
People should know when they interact with AI and be able to understand and challenge outcomes.
AT YOUR DESK: disclosure in UI, model documentation, meaningful explanations for adverse decisions.
Robustness, security & safety
Systems should function appropriately across their lifecycle, resist attack and misuse, and allow override or safe decommission.
AT YOUR DESK: adversarial testing, guardrails, kill switch, graceful degradation.
Accountability
Actors are responsible for the proper functioning of AI systems, with traceability of data, processes, and decisions.
AT YOUR DESK: audit logs, versioning, a named owner for every model in production.
Policy recommendations
Invest in AI R&D · foster an inclusive AI ecosystem · shape an enabling, interoperable policy environment · build human capacity for the labour-market transition · cooperate internationally.
Spot the odd one out
Which of the following is NOT one of the five OECD AI Principles?
UNESCO's Recommendation on the Ethics of AI
Adopted by all 193 UNESCO member states in November 2021 — the first truly global standard on AI ethics. It rests on four values (human rights & dignity; peaceful, just & interconnected societies; diversity & inclusiveness; environment & ecosystem flourishing) and ten principles.
| Principle | Engineering relevance |
|---|---|
| 1. Proportionality & do no harm | Use AI only to the extent needed for a legitimate aim; do a risk assessment first. If a simpler method works, prefer it. |
| 2. Safety & security | Avoid unwanted harms (safety) and vulnerabilities to attack (security) throughout the lifecycle. |
| 3. Fairness & non-discrimination | Test for unequal performance across groups; promote inclusive access to AI's benefits. |
| 4. Sustainability | Assess AI against sustainability goals — including energy and compute footprint. |
| 5. Right to privacy & data protection | Data minimization, consent, protection through the lifecycle; adequate data-protection frameworks. |
| 6. Human oversight & determination | Humans retain ultimate responsibility — no unchecked autonomy for consequential decisions. |
| 7. Transparency & explainability | Disclosure appropriate to context; people should be able to understand and contest outcomes. |
| 8. Responsibility & accountability | Auditable, traceable systems; clear ownership; mechanisms for redress. |
| 9. Awareness & literacy | Educate users and the public — distinctive to UNESCO among the major sets. |
| 10. Multi-stakeholder & adaptive governance | Inclusive participation; governance that evolves with the technology. |
The convergence insight
Lay UNESCO next to OECD, the EU AI Act, NIST, Singapore PDPC, Hong Kong PCPD, and Australia's AI Ethics Principles, and the same rows keep appearing: transparency/explainability, fairness, safety/robustness, privacy, human oversight, accountability. Wording differs — "auditability" here, "interpretability" there — but the themes converge. Practically, this means one well-designed internal control set can satisfy many frameworks at once.
Match the shared theme to the framework-specific wording
Click a theme on the left, then click its framework wording on the right.
The 7 Sutras — India's AI Governance Guidelines (MeitY)
On 5 November 2025, India's Ministry of Electronics and Information Technology (MeitY) released the India AI Governance Guidelines under the IndiaAI Mission. At their heart are seven guiding principles — the Sutras — adapted from the RBI's FREE-AI Committee Report (August 2025) for the financial sector, made technology-agnostic and sector-neutral for the whole economy.
Trust is the Foundation
Trust is the precondition for AI adoption at population scale. Every other sutra exists to build and preserve it — without trust, even beneficial AI fails.
People First
Human-centric design and human oversight: AI must serve people and improve lives, with humans retaining ultimate control over consequential outcomes.
Innovation over Restraint
India's distinctive stance: prefer responsible innovation to pre-emptive restriction. No standalone AI law for now — existing laws (IT Act, DPDP Act, consumer protection) are extended to AI, with sandboxes and adaptive risk mitigation.
Fairness & Equity
Inclusive development — "AI for All." Actively test for and reduce bias in training data and outcomes, so AI doesn't create discriminatory results in service delivery.
Accountability
Clear allocation of responsibility across the AI value chain, with a graded, risk-proportionate liability approach — the backbone of enforcement.
Understandable by Design
Transparency and explainability built in from the start — disclosures, documentation, and explainable-AI design rather than opaque "black boxes."
Safety, Resilience & Sustainability
Systems must be safe and robust against failure and misuse, resilient in operation, and sustainable in societal and environmental impact — the counterweight that keeps "innovation over restraint" proportionate and risk-based.
How the sutras are operationalized
- Six pillars of recommendations: infrastructure, capacity building, policy & regulation, risk mitigation, accountability, and institutions.
- New institutions: an AI Governance Group (AIGG) to coordinate policy, a Technology & Policy Expert Committee (TPEC) to advise it, and an AI Safety Institute (AISI) for testing, standards, and evaluation.
- Techno-legal tools: content authentication and provenance (watermarking), an AI incidents database, regulatory sandboxes, and India-specific risk frameworks.
How the sutras map to what you've learned
- People First → OECD/UNESCO "human oversight & determination"
- Fairness & Equity → "fairness & non-discrimination"
- Understandable by Design → "transparency & explainability"
- Safety, Resilience & Sustainability → "robustness, security & safety" + "sustainability"
- Accountability → "responsibility & accountability"
The distinctive one is Innovation over Restraint — a deliberate "lightweight," principle-based alternative to the EU AI Act's prescriptive tiers: guidance and existing law first, hard regulation only where evidence demands it.
India's distinctive choice
Which sutra most clearly distinguishes India's approach from the EU AI Act's prescriptive, tier-based regulation?
Common Responsible AI principles & processes across frontier AI companies
Anthropic, OpenAI, Google/DeepMind, Microsoft, Meta, and AWS publish their own Responsible AI frameworks. The vocabulary differs, but a common core has converged — in the principles they commit to, the processes they run, and the artifacts they publish.
Shared principles
- Safety & reliability — prevent harmful output and misuse (AWS: "Safety"; Microsoft: "Reliability & safety").
- Fairness — consider impacts on different groups of stakeholders; manage harmful bias.
- Privacy & security — appropriately obtain, use, and protect data and models.
- Transparency / explainability — help users understand and evaluate system outputs.
- Accountability & controllability — mechanisms to monitor and steer AI behavior; clear human responsibility (AWS lists "Controllability" explicitly).
- Human oversight & societal benefit — human-centered values; broadly distributed benefits.
Shared processes
- Pre-deployment evaluation & red-teaming — adversarial testing for dangerous capabilities, jailbreaks, and misuse before release.
- Frontier safety policies — capability thresholds that trigger stronger safeguards before scaling further.
- Model / system cards — published documentation of capabilities, limitations, and evaluation results.
- Usage policies & enforcement — acceptable-use rules plus classifiers and monitoring to enforce them.
- Staged / phased releases — limited rollouts, trusted-tester programs, gradual capability exposure.
- Alignment & safety training — techniques such as RLHF and constitution-based training to shape model behavior.
- Impact assessments & incident response — formal templates, bug bounties, and post-incident review.
Named examples — who calls it what
| Company | Signature responsible-AI artifacts |
|---|---|
| Anthropic | Responsible Scaling Policy (AI Safety Levels), Constitutional AI training, usage policy, model/system cards. |
| OpenAI | Preparedness Framework, system cards, external red-teaming network, usage policies. |
| Google / DeepMind | AI Principles, Frontier Safety Framework, Secure AI Framework (SAIF), model cards (Google popularized the format), Responsible AI practices site. |
| Microsoft | Responsible AI Standard v2, Responsible AI Impact Assessment Guide & Template (publicly downloadable), Office of Responsible AI, annual RAI Transparency Report. |
| Meta | Responsible Use Guides for Llama, open safety tooling (e.g. Llama Guard / Purple Llama), Frontier AI Framework. |
| AWS | Core dimensions of responsible AI: fairness, explainability, privacy & security, safety, controllability, veracity & robustness, governance, transparency; AI Service Cards. |
Why this matters for you
These company processes are the industrial translation of the OECD/UNESCO principles: red-teaming operationalizes robustness & safety; model cards operationalize transparency; usage policies and monitoring operationalize accountability. When you build with these models or ship your own, you inherit the same pattern: evaluate → document → gate → monitor.
Pick the right artifact
A customer asks: "Before we adopt your model, we need a published document describing its capabilities, known limitations, and evaluation results." Which artifact answers this?
Core Responsible AI risks in engineering contexts
AI risk overlaps with — but is not the same as — cyber risk and privacy risk. Engineers need to recognize all three, know the risk domains unique to AI, and see where each risk enters the lifecycle.
Seven AI risk domains (MIT AI Risk Repository)
- Discrimination & toxicity — unfair discrimination and misrepresentation; exposure to toxic content; unequal performance across groups.
- Privacy & security — leaking or correctly inferring sensitive information; AI system vulnerabilities and attacks.
- Misinformation — false or misleading information; pollution of the information ecosystem and loss of consensus reality.
- Malicious use — disinformation, surveillance and influence at scale; cyberattacks and weapon development; fraud, scams, targeted manipulation.
- Human–computer interaction — overreliance and unsafe use; loss of human agency and autonomy.
- Socioeconomic & environmental — power centralization, inequality, devaluation of human effort, governance failure, environmental harm.
- AI safety, failures & limitations — goal misalignment, dangerous capabilities, lack of robustness, lack of transparency or interpretability.
MIT also classifies each risk by entity (AI / human / other), intent (intentional / unintentional), and timing (pre- vs post-deployment) — useful axes when you log risks in a register.
Risks by lifecycle phase (IBM AI Risk Atlas, condensed)
- Training & tuning — input — data poisoning, unrepresentative or biased data, personal/confidential info in training data, unclear data usage rights, data transfer restrictions.
- Inference — input — prompt injection, jailbreaking, prompt leaking, personal or confidential data in prompts, membership/attribute inference attacks, extraction and evasion attacks.
- Output — hallucination, toxic or harmful output, output bias, exposing personal information, copyright infringement, harmful code generation, unexplainable or untraceable output, over/under-reliance.
- Non-technical — lack of model/system transparency, incomplete or unrepresentative risk testing, legal accountability, generated-content ownership, impact on jobs, environment, and human agency.
Generative AI amplifies traditional risks (bias, privacy) and adds new ones (prompt injection, jailbreaking, hallucination) — your controls must cover both.
Classify the risk: cyber, privacy, AI — or several?
Check every category that applies to each scenario, then verify. Several scenarios belong to more than one category.
| Scenario | Cyber | Privacy | AI |
|---|
Evaluate the use case before you build or ship it
Most AI harm is cheaper to prevent at the use-case evaluation stage than to fix in production. A structured pre-deployment evaluation answers four questions and produces two artifacts: a risk rating and an impact assessment.
The four questions
| Question | How to answer it |
|---|---|
| 1. Who can be harmed, how badly? | Map stakeholders to NIST's harm categories (people / organization / ecosystem). Score each harm on severity × likelihood — a simple 3×3 or 5×5 matrix is enough; consistency matters more than precision. Severity considers reversibility: a wrong movie recommendation is trivially reversible; a wrongly denied loan is not. |
| 2. What are the failure modes? | Walk the standard list: hallucination, bias/unequal performance, brittleness on edge cases and distribution shift, prompt injection, misuse by bad actors, overreliance by users, and cascading failures into downstream systems. |
| 3. What tier does it fall in? | Use the EU AI Act pyramid as a triage heuristic even outside the EU — anything touching employment, credit, health, education, or law enforcement is high-risk and needs formal impact assessment, documentation, and human oversight. |
| 4. Is AI proportionate here? | UNESCO's "proportionality & do no harm": if a simpler, more explainable method (rules, regression, lookup) achieves the aim, prefer it. "We could use an LLM" is not a reason to. |
The impact assessment artifact
Record the answers in a structured template — Microsoft's publicly available Responsible AI Impact Assessment Guide & Template is a good starting point: intended uses, stakeholders and potential harms, fitness for purpose, known limitations, failure modes, and mitigations. The completed assessment becomes the review gate: it is what your governance committee approves, and what your auditors (and increasingly, regulators) ask to see. No assessment, no launch.
Scenario: triage the feature request
A product manager asks your team to add an LLM feature that auto-summarizes patient discharge notes and recommends follow-up medication schedules, shipping in four weeks to beat a competitor. What is the right evaluation posture?
AI harms — naming what can go wrong, for whom, and how badly
Risk is potential; harm is the realized negative impact on real people, organizations, and ecosystems. Before choosing controls, you need a shared vocabulary of harm — three references give you that: ISO/IEC 42005 tells you how to assess impact, the MIT AI Incident Tracker tells you what kinds of harm exist and how severe, and OECD.AI shows you the evidence of harms actually occurring.
ISO/IEC 42005 — the AI system impact assessment standard
Published in 2025 — the how-to companion to ISO/IEC 42001: where 42001 requires impact assessment, 42005 shows how to do it well. Its core moves:
- Define the scope and context of the AI system
- Identify affected stakeholders — including vulnerable groups
- Analyze reasonably foreseeable benefits and harms, including misuse
- Assess sensitive uses; document the results
- Feed findings into risk management and design decisions
Think of it as the standardized, auditable version of Module 11's four questions.
MIT AI Incident Tracker — the harm taxonomy
The MIT AI Risk Repository's Incident Tracker (airisk.mit.edu) grades real incidents using a harm taxonomy built on CSET's AI Harm Framework:
- 10 types of harm — e.g. physical harm, property damage, financial loss, human rights
- Severity scored 1–5 — from "Negligible" to "Catastrophic"
- Tangible harm (observable: injury, financial loss, damage) vs intangible (detrimental content, differential treatment, rights, privacy)
- Harm event (occurred) vs harm issue (could occur) vs near-miss
- Each incident also tagged by domain & causal taxonomies and EU AI Act risk level
- Dutch benefits scandal = mixed harm: tangible financial loss + intangible differential treatment
OECD.AI — definitions and real-world evidence
The OECD supplies the internationally agreed vocabulary and the evidence base:
- AI incident = harm actually caused; AI hazard = could plausibly cause harm
- Harm categories: physical, psychological, reputational, economic/financial, environmental, human rights, public interest
- AI Incidents Monitor (AIM) tracks reported incidents worldwide, searchable by industry and harm type
- Checking AIM for your domain = one of the fastest, cheapest inputs to an impact assessment
Grading a harm: four dimensions
Whatever taxonomy you use, grade each identified harm on: severity (how bad at its worst), reversibility (can the person be made whole — a refund is reversible, a wrongful arrest is not), scale (one user or a population), and vulnerability (are children, patients, or benefit-dependent families among the affected?). High marks on any dimension push the use case up the risk tiers from Module 5 — and demand the stronger controls coming in Module 13.
Pick the right reference
Your governance committee asks: "We need standardized, auditable guidance on how to conduct an AI system impact assessment that plugs into our ISO 42001 management system." Which reference answers this directly?
Apply controls at four layers: organization, data, model, system
Once a use case is approved, mitigation happens in the build — inside an organizational envelope that applies to every AI system you run. Controls stack in four layers, and the layers back each other up: a bias missed in the data audit can still be caught by model fairness metrics; a jailbreak that beats model training can still be caught by system guardrails; and organization-level policy decides that those checks exist at all. Defense in depth.
- Enterprise AI policy, ethics/steering committee & board oversight
- Roles, resources & competencies — budget, accountable owners, AI literacy training
- Defined AI lifecycle processes with stage gates (ideation → development → deployment → monitoring → retirement)
- Sustainability tracking — CO₂/energy emissions of training & inference workloads
- Regulatory compliance mapping, vendor/supply-chain governance & internal audits
- Provenance & usage-rights verification (can we legally use this data for training?)
- Representativeness & bias audits before training
- De-identification, anonymization & data minimization
- Poisoning screening & outlier detection
- Documented data lineage & versioned datasets
- Fairness metrics across demographic groups (e.g. selection-rate parity, equalized odds)
- Robustness & adversarial testing; red-teaming
- Safety fine-tuning & alignment training
- Evaluation benchmarks tracked across versions
- Model cards; versioned change management for weights, prompts, and hyperparameters
- Input/output guardrails & content filters
- Prompt-injection defenses (input sanitization, privilege separation, tool-use allow-lists)
- Human-in-the-loop for consequential decisions
- Rate limits, authentication & access control
- Audit logging of decisions; AI disclosure in the UI
Rule of thumb for placement — run each control through this checklist
- Applies across the whole company — policy, people, processes, sustainability? → Organization level
- Acts before training — on datasets, rights, lineage? → Data level
- Shapes or evaluates the model itself — training, testing, metrics, cards? → Model level
- Wraps the running application — anything a user or attacker touches at inference? → System level
- And at every layer: change management — the Air Canada and resume-screening incidents both began with an untracked change.
Sort the control to its layer
Assign each of the 15 controls to the layer where it belongs: Organization, Data, Model, or System.
Monitoring and escalation in production
Governance doesn't end at launch. NIST's Measure and Manage functions run continuously: track trustworthiness metrics, detect drift and incidents, and escalate through defined paths — this is also the continual-improvement loop at the heart of ISO 42001.
What to monitor — five signal families
- Quality & drift — accuracy against golden sets; input distribution shift; degradation after upstream changes (data pipelines, libraries, prompts, model versions).
- Safety signals — guardrail trigger rates, jailbreak attempts, toxic-output flags, refusal-rate anomalies.
- Fairness in production — outcome parity across user segments on live traffic, not just in offline tests.
- Usage & misuse — anomalous access patterns, policy-violating prompts, scraping or extraction attempts.
- Human factors — override rates, user complaints, appeal volume. A rising override rate is one of the earliest warnings a model has drifted.
Escalation design — six elements
- Thresholds & ownership — every metric has a numeric threshold and a named owner. "Everyone's problem" means no one's problem.
- Tiered response — auto-mitigation (filter, fallback, safe mode) → on-call engineer → AI risk/ethics committee for systemic issues.
- Kill switch & rollback — the ability to disable a model or revert versions quickly, tested like any other disaster-recovery procedure.
- Incident records & review — log AI incidents like security incidents: severity, timeline, root cause, corrective action; feed lessons back into evaluations.
- Change management coverage — monitor the whole pipeline: upstream libraries, prompt templates, and data sources, not only model weights.
- Regulatory reporting — high-risk systems may carry mandatory incident-reporting duties (EU AI Act; India's guidelines propose an AI incidents database).
Scenario: the drifting screening model
Your team runs an AI resume-screening assistant. Monitoring shows that over the last month, the shortlisting rate for one demographic group dropped 18% with no change in applicant quality metrics. The model wasn't retrained, but an upstream resume-parsing library was upgraded. What is the best first response?
Final quiz
Fifteen questions covering the whole course. You need 70% (11/15) to pass. Choose an answer for every question, then submit.
You've finished the course
This is to certify that
—
has successfully completed the course
AI Governance 101
Principles · Frameworks · Industry practice · Risk & harm evaluation · Engineering controls · Production monitoring
Date: —
Co-Founder, AramGRC — AI Assurance Platform and Consulting
Download your certificate
Click the button below and a JPG image of your certificate — with your registered name and today's date — will be saved to your device (usually the Downloads folder; on mobile, check your gallery or Files app). You can then print it, attach it to your CV, or share it on LinkedIn.
If no file appears in Downloads, your certificate will be shown below — right-click it (desktop) or press-and-hold it (mobile) and choose "Save image as…" / "Save to Photos".
Where to go deeper
- OECD.AI Policy Navigator — 1,000+ national AI policies and strategies across 80+ jurisdictions.
- NIST AI RMF 1.0 and its Playbook — the Govern / Map / Measure / Manage functions in detail.
- ISO/IEC 42001 — the AI management-system standard, in the same family as ISO 9001 and 27001.
- India AI Governance Guidelines (MeitY, Nov 2025) and the RBI FREE-AI Committee Report — the 7 Sutras in full.
- MIT AI Risk Repository and IBM AI Risk Atlas — comprehensive risk taxonomies.
- Microsoft Responsible AI Impact Assessment Guide & Template — a ready-to-use evaluation process.
- NASSCOM Responsible AI Resource Kit — governance framework, maturity assessment, and architect's guide.
- UK AI Standards Hub and AI Security Institute — standards tracking and safety research.
Thank you for learning with us
AramGRC
AramGRC helps organizations build and prove trustworthy AI — AI governance consulting, ISO/IEC 42001 implementation and audits, corporate training, and privacy & information-security programs — led by practitioners who audit and implement these frameworks every week.
Consult
AI governance programs, AIMS (ISO 42001) implementation, risk & impact assessments, privacy and infosec advisory.
Audit
ISO 42001 internal audits and certification-readiness, with certified lead auditors.
Train
Lead Implementer / Lead Auditor batches, executive masterclasses, and courses like this one — tailored to your teams.
Reach out
Web: www.aramgrc.com
Email: Sakthi@AramGRC.com · Anand@AramGRC.com
Questions about this course, ISO 42001 certification, or setting up an AI governance program? We'd love to hear from you.