AI EngineeringZero to ProductionHome·About·What’s new·Contact
Enterprise & Leadership · Capstone

Project · Governance & rollout plan

The capstone ties EL1–EL6 into one deliverable: stand up AI governance and a rollout for a representative mid-size company. You'll produce a governance charter, a risk register, a rollout plan, and an eval/monitoring gate — the exact artifact set a new head of AI is asked for in their first 90 days. Templates are provided; the scenario is a representative composite, and every regulatory specific must be verified against the current text with legal. This is engineering-leadership practice, not legal advice.

⏱️ ~2.5 hours🏢 Org / decision layer🎯 Lead / staff

Learning objectives

  • Author a governance charter: scope, risk tiers, review lanes, mandatory artifacts, and framework alignment.
  • Build a risk register with likelihood, impact, owner, and mitigation per risk.
  • Design a pilot → scale rollout plan with graduation gates, a RACI, and adoption metrics.
  • Define the eval + monitoring gate that governs what may deploy and stay deployed.
  • Self-assess the whole deliverable against a rubric at meets-bar and above-bar levels.
Representative scenario — verify the specificsThe company below is an illustrative composite, not a real customer, and its numbers are invented to give the plan shape. Public frameworks (EU AI Act, ISO/IEC 42001, NIST AI RMF, SOC 2, GDPR/DPDP) are cited as fact; their specifics drift — verify against the current regulation/text with legal. Nothing here is legal advice.

1 · The scenario

Start where every new head of AI actually starts: not with a blank page, but with a mess someone else made. Teams have already shipped things. Nobody wrote down what. A customer is now asking a question you can't yet answer, and the clock started before you did. If you've ever joined a company and discovered the "system" was three people's habits and a Slack channel, you know this feeling — and you know the instinct to panic and build a giant policy binder is exactly wrong.

Think of it like being handed a house that's already half-built by different crews with no blueprint. You don't bulldoze it and you don't add a second storey — you first walk every room and write down what's there, then decide which walls are load-bearing. Governance works the same way: you inventory before you rule, and you rule before you scale. The scenario below is deliberately ordinary — a mid-size B2B company, three half-shipped AI features, one nervous enterprise customer — because that ordinariness is the point. This is the median situation, not the dramatic one, and the median is what you'll actually be hired into.

Why does the order matter so much? Because governance you impose before you know what exists is theatre — you'll write rules for imaginary systems and miss the real one that's already talking to customers. And the common mistake here is treating "describe your AI governance" as a documentation task. It isn't. It's a signal that a buyer is deciding whether you're a safe vendor, and your honest answer is worth more than a polished lie you can't back up. Read the scenario as a founder would: what's the smallest set of true things I can stand up in 90 days that makes this company safer and faster?

Representative scenario. "Meridian" is a ~600-person B2B software company. Teams have started shipping AI features ad hoc: a support-drafting agent, a doc-search assistant, and a prototype that drafts customer-facing content. There is no inventory, no review process, and no one accountable. A large EU customer just asked, in a security questionnaire, "describe your AI governance." You've been hired as the first head of AI engineering. Deliver the foundation in 90 days.

what you inherit · already shipped, ungoverned support agent doc search content drafter no owner / no log EU customer asks: "describe your AI governance" the winning order — do NOT skip a step 1 · Inventory 2 · Charter 3 · Scale inventory before you rule · rule before you scale You inventory before you rule, and you rule before you scale. The red boxes are the mess you inherit — real systems already talking to customers with no owner; the fatal move is writing rules before you know what exists.
🗺️ How to read this diagram

Read the top band first (the situation you walk into), then the bottom band (the order you fix it in).

  • The red boxes up top are Meridian's three AI features — already shipped, but with no owner and no audit trail. The red arrow shows the trigger: an EU customer (amber box) asking a question you can't yet answer.
  • The green boxes along the bottom are the only safe sequence: inventory what exists, then rule (write the charter), then scale. The blue arrows are one-way — each step depends on the one before it.
  • The payoff is the ordering itself: governance imposed before you know what exists is theatre — you'd write rules for imaginary systems and miss the real one already talking to customers.

In short: A mess you inherit plus a customer on the clock — win by walking every room before you make any rules, and ruling before you scale.

The 90-day arcYou cannot boil the ocean. The winning sequence is: inventory + charter (know what exists and set the rules), then risk register + review gate (control what ships), then rollout + monitoring (scale what works). Governance first buys you the right to move fast later — it's the Responsible-Scaling ratchet applied to an org.

2 · Deliverable A — the governance charter

You've seen the failure mode even if you've never called it governance. A team writes a 40-page "AI policy," circulates it once, and six months later nobody can find it, three new systems shipped without touching it, and the doc contradicts the runbook someone actually follows. The policy wasn't wrong — it was overloaded. It tried to be a constitution and an instruction manual at once, so it aged like milk and got ignored like fine print.

A charter is the constitution, and the analogy is exact: a national constitution says "there shall be a supreme court" — it does not list next Tuesday's docket. It states durable principles (what is in scope, how we tier risk, who is accountable) and delegates the changeable mechanics to laws and procedures beneath it. Your charter should read the same way: short enough to actually read, stable enough that you're not rewriting it every sprint, and authoritative enough that every other artifact — the register, the gate, the rollout — points back to it as the source of truth.

The precise point: the six sections below aren't a checklist for its own sake — each one answers a question a real reviewer, auditor, or nervous customer will ask. What do you even govern? (scope). How do you decide how hard to govern it? (risk tiering). What does a system have to have before it ships? (mandatory artifacts, as deploy blockers — not aspirations). Who is on the hook when it breaks? (roles). Why keep it stable rather than comprehensive? Because a charter you rewrite monthly has no authority — people learn to wait it out. The common mistake is stuffing tool choices and exact eval thresholds into the charter; those belong in linked procedures, which you'll change often precisely so the charter doesn't have to.

The charter is the constitution: short, durable, and the thing everything else references. It reuses EL1's policy shape. Minimum sections:

the charter references down; procedures change without touching it Charter — the constitution (stable, rarely edited) scope risk tiering review lanes mandatory artifacts framework alignment roles / RACI linked procedures (changed often)templates · exact gates · tool choices A charter you rewrite every month has no authority. Durable principles live in the stable top band; the things you tune every sprint live in the linked procedures below — so the constitution stays put while the mechanics move.
🗺️ How to read this diagram

Read it top-to-bottom as two layers: the durable charter on top, the changeable procedures underneath.

  • The purple band at the top is the charter itself — the "constitution" you edit rarely.
  • The blue boxes are its six required sections: scope, risk tiering, review lanes, mandatory artifacts, framework alignment, and roles/RACI. Each answers a question a real reviewer or auditor asks.
  • The arrow points down to the green band — the linked procedures (templates, exact eval thresholds, tool choices). This is where the changeable how-to lives, so the charter above never has to be rewritten to adjust a threshold.

In short: Durable principles up top, changeable mechanics linked below — keep them separate and the charter keeps its authority.

SectionContentSource lesson
ScopeWhat counts as an 'AI system' under governanceEL1 §1
Risk tieringEU-AI-Act-style tiers + blast-radius checkEL1 §2
Review lanesFast path (low-risk) vs full path (high-risk)EL1 §5 / expert rung
Mandatory artifactsOwner + model card + audit trail, as deploy blockersEL1 §4
Framework alignmentISO 42001 / NIST AI RMF mapping; verify-the-text stanceEL1 §3
Roles / RACIOne accountable owner per decisionEL1 §5
Charter vs proceduresKeep the charter stable and put the changeable how-to (templates, exact gates, tool choices) in linked procedures. A charter you rewrite every month isn't a constitution — it's a to-do list.

3 · Deliverable B — the risk register

Here's the moment the register would have saved you. Something goes wrong in production — a wrong answer reaches a customer, or a doc-search result leaks across tenants — and in the postmortem someone asks "did we know this could happen?" If the answer is "no," you have a competence problem. If the answer is "yes, but nobody owned it," you have a governance problem, and it's worse. The risk register exists to make the second answer impossible: every foreseeable failure is written down, ranked, and has exactly one name next to it.

Think of it as a pre-flight checklist crossed with a bet. Pilots don't file a checklist because they expect the engine to fail; they file it because knowing which failures are plausible, how bad each is, and who handles it turns a crisis into a procedure. A risk register does the same for an AI portfolio — and the "bet" part is the two numbers on every row: likelihood × impact. That product is what ranks the list, and the top of the list is where your scarce control effort goes. A rare-but-catastrophic cross-tenant leak and a common-but-mild hallucination are genuinely different problems, and pretending they're the same is how teams either over-invest in the trivial or sleepwalk into the disaster.

The point most people miss: a risk register is not a static compliance artifact you write once — it's the source that feeds your board risk framing (each row collapses to a three-sentence "what could go wrong / how likely and how bad / who owns it and how it's mitigated") and it changes as systems change. The common mistake is a register full of risks with no owner. A risk everyone is responsible for is a risk no one is — the single accountable owner per row is the load-bearing column, not the mitigation text.

Inventory each in-flight AI system, then log its risks in the EL6 format. A starter register for Meridian's three systems:

likelihood → impact → govern hardest support answer med × med cross-tenant leak low × critical content drafter high × high Likelihood × impact ranks the register. The content drafter lands in the top-right danger zone (high × high) so it earns the strictest controls; a rare-but-critical leak and a common-but-mild wrong answer are genuinely different problems.
🗺️ How to read this diagram

Read it like a scatter plot: how likely a risk is runs left→right, how bad it is runs bottom→top; the top-right corner is where the danger concentrates.

  • The horizontal axis is likelihood and the vertical axis is impact — the two numbers on every register row. Their product is what ranks the list.
  • Each dot is one plotted risk: the amber support-answer dot sits mid-mid; the cross-tenant leak sits far left but near the top (rare, but critical); the content-drafter dot sits high on both.
  • The shaded red band is the danger zone — high likelihood and high impact. The content drafter lands there, which is why it gets the full review path and human approval before publish while the internal support agent moves faster.

In short: Plot each risk by likelihood × impact; the row in the top-right corner sets your hardest controls, and every row needs exactly one owner's name.

RiskSystemLikelihoodImpactOwnerMitigation
Hallucinated support answerSupport agentMediumMediumEng LeadGrounding + citations + HITL send
Cross-tenant leak in doc searchDoc searchLowCriticalEng LeadTenant-filtered retrieval + canary test
Customer-facing content is wrong/off-brandContent drafterHighHighProductHuman approval before publish; decision-support only
PII in prompts/logsAllMediumHighSecurityDLP boundary; PII-free logging
Vendor deprecation / lock-inAllMediumMediumPlatformProvider abstraction + fallback
Untracked cost growthAllMediumMediumFinOpsTagging + budgets + anomaly alerts
The content drafter is your highest risk — treat it soHigh likelihood × high impact (customer-facing, unproven) makes the content drafter the system to govern hardest: full review path, human approval before anything publishes, and an eval gate for faithfulness and brand safety. The support agent, internal and grounded, can move faster. Match the control to the risk — don't govern them identically.

4 · Deliverable C — the rollout plan

You've probably watched a launch that was really just an announcement. "It's live for everyone as of Monday" — and then week two is a support fire, half the org quietly stops using it, and the retro concludes "the tool wasn't ready." Usually the tool was fine; the rollout was a cliff, not a ramp. There were no checkpoints where you could look at real evidence and decide whether to widen the door or hold it shut.

A good rollout looks less like flipping a switch and more like a clinical trial: a small phase to prove it's safe and wanted, a larger phase to prove it holds under load, and only then general availability — and crucially, each phase-to-phase move is a decision gated on evidence, not a date on a calendar. The graduation gate is the whole idea: "we scale when the pilot squad hits the acceptance target and wants to keep it," not "we scale on the 15th because the plan said so." That single reframe — dates are guesses, gates are facts — is what separates a governed rollout from optimistic scheduling.

Two things make or break it, and both are about honesty. First, pick adoption metrics that measure value, not vanity: "% of eligible drafts done via the agent" and "time saved per ticket" tell you something; "total logins" tells you nothing and is easy to game. Second, match the human-in-the-loop policy to the risk of each action — a draft internal note can be autonomous, but sending to a customer needs a human hand on it. The common mistake is scaling on enthusiasm: a loud pilot squad loves it, so you go company-wide before you've proven the support load is survivable or the trust hasn't been quietly broken. Enthusiasm is a signal to test the next gate, not to skip it.

For the system worth scaling first (the internal, grounded support agent), lay out the pilot → scale path from EL4 with graduation gates, a rollout RACI, adoption metrics, and the HITL policy. The flow below is the whole governed lifecycle, from a system entering governance to being monitored in production.

Inventory what exists Charter + tier classify Review gate approve Pilot → scale adopt Monitor evals+cost Re-review as things change
🗺️ How to read this diagram

Read it strictly left→right, following the brand-colored arrows: each box is a stage a system must pass through, and the small caption under each label tells you what happens there.

  • The first two boxes set the scope: Inventory ("what exists") lists every AI system, then Charter + tier ("classify") sorts each one into the charter's risk tiers.
  • The arrows are one-directional and connect the boxes in a fixed order — Review gate ("approve") is the single accountable checkpoint, and Pilot → scale ("adopt") is the staged rollout that follows approval.
  • The last two boxes are what makes it a lifecycle, not a one-shot: Monitor ("evals+cost") watches the system in production, and Re-review ("as things change") loops governance back on as risk or regulation shifts.

In short: every system runs the same conveyor — inventory, classify, approve, adopt, monitor, re-review — so governance is a continuous pipeline rather than a one-time sign-off.

5 · Deliverable D — the eval + monitoring gate

Ask a hard question of any governance program: what does it physically stop? If the answer is "it produces a document," it's not governance — it's paperwork. A charter that classifies risk and a register that names owners are worthless if a failing system can still deploy and stay deployed. The gate is where the abstract becomes enforceable: it's the one place in the whole program where a machine, on evidence, says no.

The mental model is a security checkpoint at an airport, and it has two halves people often forget are separate. There's the gate at the door — you don't board unless you clear it (the CI deploy gate: quality evals pass, cost-per-success within budget, and for high-risk systems, faithfulness and an isolation canary). And there's ongoing surveillance after you're through — because a passenger who was fine at security can still cause trouble mid-flight (runtime monitoring for drift, error/refusal spikes, cost anomalies, with rollback triggers). A deploy gate with no monitoring lets systems rot in production; monitoring with no deploy gate lets rotten systems in to begin with. You need both, and they check different things at different times.

The deepest point is that the gate should get stronger over time, and this is where governance either compounds or decays. When an incident happens, the amateur move is to patch the bug and move on; the professional move is to turn that failure into a permanent check — a new eval case, a new monitor, a new rail in the deploy gate — so that exact class of failure can never silently return. Do this and your gate ratchets: every scar becomes armor. The common mistake is uniform strictness — running expensive faithfulness and isolation checks on every system, including the low-risk internal one. That doesn't make you safer; it makes teams route around the gate. Match the check to the tier, and reserve the heavy machinery for the systems that can actually hurt someone.

Governance is only real if something can fail. Define the gate that governs deployment and continued operation, drawing eval discipline from the safety/case-study tracks and cost/adoption from EL3/EL4:

new version wants to ship Deploy gate (CI) evals · isolation · cost fail blocked — fix & retry pass Live + runtime monitor severe regression → roll back A gate at the door plus ongoing surveillance. Nothing goes live without clearing the deploy gate; once live, monitoring can trip a rollback — a deploy gate with no monitoring lets systems rot, monitoring with no gate lets rotten systems in.
🗺️ How to read this diagram

Follow the new version left→right through the checkpoint, then watch the loop that pulls a bad release back out.

  • The blue box on the left is a new version that wants to ship; it must pass the amber deploy gate — quality evals, high-risk faithfulness/isolation, and cost-per-success within budget.
  • The red downward arrow is the fail path: the version is blocked until fixed. The green rightward arrow is the pass path: it goes Live with runtime monitoring attached.
  • The red curved arrow is the surveillance half — a severe regression, cost anomaly, or cross-tenant signal in production trips a rollback straight back to blocked. That loop is why you need both the gate and the monitor, not one or the other.

In short: Pass the gate to go live, and stay live only while monitoring holds — the two halves check different things at different times.

GateChecksAction on fail
Deploy gate (CI)Quality evals pass; faithfulness/bias for high-risk; isolation canary; cost per success within budgetBlock deploy
Runtime monitoringDrift, error/refusal rate, cost anomalies, adoption trendAlert owner; roll back on severe regression
Periodic re-reviewRisk still tiered correctly? Regulation changed? Value realized?Re-classify; update charter/register
Every incident ends as a gate checkThe compounding move: when something goes wrong in production, the fix isn't just a patch — it's a new check added to the deploy gate or monitoring so that class of failure can't silently return. That's how governance gets stronger over time instead of re-learning the same lesson.

✓ Checkpoint — you can move on when you can…

  • Produce a governance charter with all six sections and a stable charter-vs-procedures split.
  • Build a risk register with likelihood, impact, owner, and mitigation, and identify the highest-risk system.
  • Lay out a pilot→scale rollout with graduation gates, a RACI, and value (not vanity) adoption metrics.
  • Define a deploy gate, runtime monitoring, and a re-review cadence.
  • Self-assess the full deliverable against the rubric and know what 'above bar' looks like.
✓ Knowledge check

Meridian's CEO wants all three AI systems governed identically "to be fair to the teams." Why is uniform governance the wrong call, and what do you propose instead?

Show answer
Uniform governance is wrong because it either over-controls the low-risk systems (killing velocity and inviting teams to route around governance) or under-controls the high-risk one (the customer-facing content drafter), and usually both. Governance should be proportional to risk: the internal, grounded support agent takes the fast path (owner + model card + eval gate), while the customer-facing content drafter takes the full path (full review, human approval before publish, faithfulness/brand evals). "Fair" doesn't mean identical — it means the same transparent rule (tier by stakes and blast radius) applied consistently, which is the EL1 review-lane design.
✓ Knowledge check

The EU customer's questionnaire asks Meridian to "describe your AI governance." You've been in role three weeks. What's the honest, credible answer?

Show answer
Don't overclaim maturity you don't have (a good enterprise buyer will see through it) and don't admit to chaos. The honest, credible answer describes the program you're standing up: "We govern AI systems under a charter that classifies them by risk tier and aligns our controls to ISO/IEC 42001 and the NIST AI RMF; every system has a named owner, a model card, and an audit trail; high-risk and customer-facing systems require full review and human oversight; and we verify EU AI Act obligations against the current text with our legal team." Then state where you are on the journey honestly. This is truthful, shows a real framework (not vibes), and gives the buyer what they actually want — evidence that risk is known, owned, and mitigated. Confirm the regulatory specifics with legal before it goes in a contract.

6 · Self-assessment rubric

The trap at the end of a big deliverable is relief. You produced a charter, a register, a rollout plan, and a gate — four real artifacts — so it's tempting to call it done. But "I made the thing" and "the thing is good" are different claims, and the gap between them is exactly where a governance program that looks complete quietly fails to protect anyone. The rubric exists to close that gap by making you grade yourself honestly, against a bar, before someone else does it for you in a boardroom or a security review.

Think of it the way a pilot treats a checkbook of standards rather than a feeling of "that landing seemed fine." Two levels — meets bar and above bar — force a specific judgment on each dimension: not "did I write a risk register?" but "does every risk have a single owner and a real mitigation, and did I identify and hardest-govern the top one?" The above-bar column is deliberately concrete because vague self-grading always inflates; "it's pretty good" is how weak work survives.

The point worth internalizing: not all dimensions are equal, and the rubric tells you which failures are fatal. If your risk register or your eval + monitoring gate is below the bar, systems can ship or drift with no owner and no way to fail — fix those before anything cosmetic. And the difference between a binder no one reads and governance leadership actually trusts lives almost entirely in the last two rows, communication and honesty: a program that's technically sound but can't be explained to a skeptical CFO, or that overclaims maturity it doesn't have, will lose the room even when the engineering is right. The common mistake is grading the artifacts you enjoyed making generously and skimming the ones you found tedious — which are usually the ownership and honesty rows that decide whether the whole thing holds.

Grade your full deliverable. This is the whole track, integrated — score each dimension honestly at meets-bar or above-bar.

fatal if below bar — fix first Risk registera risk with no owner Eval + monitoring gatenothing can fail core deliverables Governance charter Rollout plan wins (or loses) the room Communication Honesty / compliance posture each dimension scored: meets bar vs above bar meets bar above bar Not all six dimensions are equal. The red pair is fatal if below bar — systems could ship or drift with no owner and no way to fail; the green pair (communication + honesty) is what separates a binder no one reads from governance leadership actually trusts.
🗺️ How to read this diagram

Read the dimensions top-to-bottom by weight, not as a flat checklist — the color tells you where a low score actually hurts.

  • The two red boxes at the top are the fatal-if-below-bar dimensions: the risk register (a risk with no owner) and the eval + monitoring gate (nothing can fail). Fix these before anything cosmetic.
  • The blue boxes are the core deliverables — the charter and the rollout plan — the substance of the work.
  • The green boxes on the right are communication and honesty: a program that's technically sound but can't be explained to a skeptical CFO, or that overclaims maturity, still loses the room. The bottom pair shows the two grades you assign each dimension — meets bar vs above bar.

In short: Grade all six honestly, fix the red ones first, and remember the green ones decide whether anyone trusts the rest.

📋 Grade your governance + rollout deliverable
DimensionMeets barAbove bar
Governance charterA charter exists with scope and some rules.Six sections; risk-tiered review lanes; artifacts are deploy blockers; frameworks mapped; stable charter-vs-procedures split; verify-the-text stance stated.
Risk registerA list of risks exists.Every system inventoried; each risk has likelihood × impact, a single owner, and a concrete mitigation; the highest-risk system is identified and governed hardest.
Rollout planA plan to launch the agent.Explicit pilot→scale graduation gates; rollout RACI incl. sponsor; value (not vanity) adoption metrics; tiered HITL policy matched to risk.
Eval + monitoring gateSome testing before launch.CI deploy gate (quality + high-risk evals + isolation canary + cost/success); runtime monitoring with rollback; periodic re-review; incidents become permanent gate checks.
CommunicationArtifacts are technically sound.Board-ready framing: BLUF ROI case, three-sentence risk framing, now/next/later roadmap; can say no to a bad idea with evidence and an alternative.
Honesty / compliance postureMentions regulations.Public frameworks cited as fact and attributed; company specifics labelled representative; regulatory drift hedged with verify-against-current-text; framed as engineering leadership, not legal advice.

Score each dimension Meets or Above. All six at least Meets = a governance foundation a new head of AI could actually present in their first 90 days and defend to that EU customer. If Risk register or Eval + monitoring gate is below Meets, systems can ship or drift with no owner and no way to fail — fix those before anything else. Above bar on Communication and Honesty is what separates a compliance binder no one reads from governance that leadership trusts and teams actually follow.

🪜 Practice ladder beginner → industry

Six graded exercises, easy to real-world. Try each before opening its solution.

Exercise 1 · Inventory the AI systems and tier themBeginner

Context: You can't govern what you haven't listed; the first 90-day move is an inventory.

Your task: Produce the AI-system inventory for Meridian and assign each a risk tier with justification.

Requirements:

  • List the three systems with a one-line description each
  • Assign a risk tier and blast-radius note to each
  • Flag which needs the fast path vs full path
  • Note the verify-against-current-text caveat

💡 Hint: Tier by stakes and blast radius, not by how impressive the model is.

Show solution

Inventory + tiering:

SystemDescriptionTier / blast radiusPath
Support agentDrafts support replies; human sendsLimited; internal, reversibleFast
Doc searchAnswers over internal + customer docsLimited-to-high; cross-tenant riskFull (isolation)
Content drafterDrafts customer-facing contentHigh; customer-facing, unprovenFull

The content drafter and doc search take the full review path (customer-facing / cross-tenant risk); the internal, grounded support agent takes the fast path. Tier boundaries verified against the current EU AI Act text with legal.

Exercise 2 · Write the governance charterIntermediate

Context: The charter is the durable constitution everything else references.

Your task: Author Meridian's one-page governance charter with all six sections.

Requirements:

  • Scope, risk tiering, review lanes, mandatory artifacts, framework alignment, roles
  • Make artifacts deploy blockers
  • State the verify-the-text stance and that it's not legal advice
  • Keep procedures out of the charter (link them)

💡 Hint: Stable charter; changeable procedures live in linked runbooks.

Show solution

Meridian AI Governance Charter (v1):

1. Scope: any system using ML/LLMs to inform a decision, generate content, or act for Meridian — built or bought.

2. Risk tiering: each system classified minimal/limited/high using current EU AI Act tiers + blast-radius, recorded in the inventory.

3. Review lanes: low-risk → fast path (Eng Lead + model card); high-risk/customer-facing → full path (Governance board + full evidence).

4. Mandatory artifacts (deploy blockers): named owner, current model card, audit trail.

5. Framework alignment: controls mapped to ISO/IEC 42001 and NIST AI RMF; EU-facing systems classified under the EU AI Act; specifics verified against the current text with legal. Not legal advice.

6. Roles: one accountable owner per decision (RACI in linked procedure). Charter reviewed twice a year; templates and gates live in linked runbooks.

Exercise 3 · Build the risk registerAdvanced

Context: The register is both an engineering artifact and the source of board risk framing.

Your task: Build Meridian's risk register across the three systems and identify the highest-risk one.

Requirements:

  • Each risk: likelihood, impact, owner, mitigation
  • Cover model, security, privacy, cost, and vendor risks
  • Identify the highest-risk system and justify governing it hardest
  • Note how each entry maps to a board three-sentence framing

💡 Hint: Likelihood × impact ranks the register; the top entry sets your hardest controls.

Show solution

Register (starter — see §3 table for the full set). Highest-risk row:

Content drafter — customer-facing content wrong/off-brand. Likelihood High (unproven, generative, public), Impact High (brand + possible compliance). Owner: Product. Mitigation: full review path, human approval before publish, faithfulness + brand-safety eval gate, decision-support framing.

Why govern it hardest: it's the only system that reaches customers unmediated and it's unproven — the product of likelihood and impact tops the register, so it earns the strictest controls while the internal support agent moves faster.

Board framing (from EL6): "Our AI content tool could publish an inaccurate or off-brand message to customers (high impact); today that's likely without controls, so nothing it produces publishes without human approval and an automated accuracy check, and Product owns it." Each register row collapses to that three-sentence shape.

Exercise 4 · Design the pilot→scale rollout with gatesExpert

Context: A launch plan without graduation gates is enthusiasm, not governance.

Your task: Design the rollout for the support agent from pilot to default tool with explicit gates, a RACI, adoption metrics, and the HITL policy.

Requirements:

  • Define the four stages and the graduation criterion for each
  • Give the rollout RACI incl. a sponsor
  • Pick value (not vanity) adoption metrics
  • State the tiered HITL policy for the agent's actions

💡 Hint: Each stage transition is a decision gated on evidence, not a calendar date.

Show solution

Stages + gates: Pilot (one squad hits target draft-acceptance and wants to keep it) → Limited (3–4 teams, support load manageable, no trust-destroying incident) → Broad (training + champions in place, adoption climbing, HITL holding) → Default (majority of eligible drafting flows through it, value realized).

RACI: Pilot — R: PM, A: Rollout lead. Training — R: Enablement, A: Rollout lead. HITL sign-off — A: Risk owner. Metrics — A: PM. Sponsor: a VP who visibly uses it and provides air cover.

Adoption metrics (value, not vanity): % of eligible drafts done via agent; draft-acceptance rate; time saved per ticket; weekly active on real tickets; realized value as the headline.

HITL policy: draft internal reply → autonomous (sample); post internal note → notify; send to customer → human approves (the agent never sends unattended); any account change → two-key. Uncertainty escalates one tier.

Exercise 5 · Define the eval + monitoring gateProfessional

Context: Governance is only real if something can fail; the gate is where it can.

Your task: Specify Meridian's deploy gate, runtime monitoring, and re-review cadence across the three systems.

Requirements:

  • CI deploy gate checks (incl. high-risk-only checks)
  • Runtime monitoring signals and rollback triggers
  • Re-review cadence and what forces an off-cycle review
  • How an incident becomes a permanent gate check

💡 Hint: Match extra checks (faithfulness, isolation canary) to the high-risk systems only.

Show solution

Deploy gate (CI): all systems — quality evals pass, cost-per-success within budget, model card current. High-risk only — faithfulness + brand-safety evals (content drafter), cross-tenant isolation canary (doc search). Fail → block deploy.

Runtime monitoring: error/refusal rate, drift, cost anomalies, adoption trend, and (content drafter) sampled faithfulness. Rollback triggers: a quality regression past threshold, a cost anomaly, or any confirmed cross-tenant signal → auto-alert owner, roll back on severe.

Re-review: scheduled semi-annually; off-cycle forced by a regulatory change, a material incident, or a use-case change (e.g. someone wires the support agent to send unattended → immediate re-tier).

Incident → gate: every production incident produces a new check — a rail, an eval case, or a monitor — added to the deploy gate so that failure class can never silently recur. The gate strengthens monotonically.

Exercise 6 · Present the 90-day plan to the boardIndustry scenario

Context: Representative scenario: 90 days in, you present the governance + rollout foundation to Meridian's board, which includes the skeptical CFO and the EU customer's concern on the agenda.

Your task: Deliver the board presentation that lands the whole deliverable — integrating every EL lesson.

Requirements:

  • Open with BLUF: what you built and why it matters commercially
  • Frame the top risks in three sentences each (what / likelihood×impact / owner+mitigation)
  • Present the ROI of the support-agent rollout with a value range
  • Give a now/next/later roadmap
  • Address the EU customer's governance question truthfully
  • Handle a board member pushing to 'go faster on the customer-facing tool'

💡 Hint: Board altitude throughout: money, risk, time, ownership — mechanism only if asked.

Show solution

BLUF. "In 90 days we've gone from ungoverned AI to a governance program that lets us ship faster and answer enterprise buyers: every AI system is inventoried, tiered, owned, and gated, and our first agent rollout is delivering measured value."

Top risks (three sentences each). Content drafter: could publish something wrong to customers (high impact); likely without controls, so nothing publishes without human approval + an accuracy check; Product owns it. Doc search: cross-tenant leak (critical impact); low likelihood because retrieval is tenant-filtered and a canary test blocks regressions; Eng owns it.

ROI. Support agent: conservative/expected/optimistic net value ~$180k/$330k/$540k a year at ~70% adoption; funded as a gated pilot before broader spend. Numbers verified against current pricing.

Roadmap. Now: support agent to broad rollout, governance live. Next: extend drafting, cost routing. Later (bet): autonomous back-office if reliability clears the bar.

EU customer. "We govern AI under a charter aligned to ISO/IEC 42001 and NIST AI RMF, with owners, model cards, audit trails, and human oversight on high-risk systems; EU AI Act obligations are verified with legal." Truthful, framework-based, contract-ready.

'Go faster on the customer-facing tool.' Affirm the goal, show the register entry (high × high), and offer the path: human-in-the-loop now, autonomy earned by evals — visibly ahead without betting the brand. The board owns the call; the risk is documented either way.

© 2026 studybydoing.in · AI Engineering: Zero to Production · All rights reserved. · About · Privacy Policy · Terms · Contact
Educational content, provided as-is and without warranty. Code samples are examples — review, test, and adapt them before using in production. See the Terms of Use & Disclaimer. Use at your own risk.
© studybydoing.in