AI EngineeringZero to ProductionHome·About·What’s new·Contact
Enterprise & Leadership · Part 6

Executive & board communication

The best technical decision dies if you can't communicate it upward. This lesson is how AI-engineering leaders talk to executives and boards: building an ROI business case, maintaining a risk register, framing risk for a board, communicating a roadmap, reporting the metrics execs actually care about, and — the hardest skill — saying no to a bad AI idea without becoming the department of no. Scenarios are representative; the communication craft is real.

⏱️ ~90 min🏢 Org / decision layer🎯 Lead / staff

Learning objectives

  • Build an ROI business case for an AI feature that a CFO will accept.
  • Maintain a risk register and translate technical risk into board language.
  • Frame AI risk for a board: likelihood × impact, owner, and mitigation — not jargon.
  • Communicate a roadmap that survives contact with shifting priorities and model releases.
  • Report the few metrics execs care about, and say no to a bad AI idea constructively.
Representative scenariosThe business cases, board asks, and 'bad idea' scenarios here are illustrative teaching devices, not real companies or claimed outcomes. Any numbers are made up to show the shape of an argument. The communication techniques are genuine; adapt the specifics to your context.

1 · The altitude problem

Engineers lose executives by talking at the wrong altitude — tokens, latency, and model names when the exec is asking about money, risk, and time. The core skill is translation: every technical fact has an executive-level meaning, and your job is to lead with the meaning and keep the mechanism in your back pocket for when they ask. Lead with the so-what.

Picture the meeting you've probably sat in. You've spent six weeks shaving p95 latency, adding an eval gate, and wiring up prompt caching. You get eight minutes in front of the leadership team, and you use them to walk through the architecture — token budgets, the retrieval pipeline, why you chose one model over another. Faces go polite and blank. Someone checks their phone. At the end the CFO asks, "So… is this thing making us money or costing us money?" and you realize the entire eight minutes missed the only question in the room. The work was excellent; the communication failed. That is the altitude problem, and it kills more good technical decisions than bad code ever will.

Here's the analogy that fixes it. Think of a pilot talking to air-traffic control versus talking to a mechanic. To the mechanic, the pilot describes the specific valve and pressure reading. To the tower, the pilot says "requesting descent to 10,000 feet" — same aircraft, completely different altitude of description, chosen for who's listening and what they'll decide with it. Executives fly at the money-risk-time altitude. Every fact you have lives down at the engineering altitude, and it is your job to climb it up to theirs — not theirs to climb down to you. They literally do not have the context to, and expecting them to is the mistake.

So what does "translation" mean concretely? It means for every technical fact, you ask one question before you open your mouth: "so what does this mean for money, risk, time, or the customer's experience?" The answer to that is your headline; the technical fact is the footnote you keep ready for when someone asks "how?" Notice this is not dumbing down — a good exec is sharp, just optimizing for different variables. You're not hiding the mechanism; you're leading with its consequence and offering the mechanism on request. The common mistake isn't using jargon (you can define a term); it's ordering the sentence wrong — putting the mechanism first and the meaning last, so the listener has to survive the whole explanation before learning why they should care. Flip the order. The table below is a translation dictionary: engineer-speak on the left, the blank stare it produces in the middle, and the sentence that actually lands on the right.

engineering altitude "We cut p95 latency 40%" mechanism first → blank stare Ask: money? risk? time? customer? executive altitude "The feature feels instant, so more users finish" same fact — the meaning is the headline, the mechanism is the footnote lead with the so-what · keep the "how" in your back pocket Translation, not dumbing-down. The same fact climbs from the engineer's altitude (red, mechanism-first) to the exec's (green, meaning-first) by passing through one question: what does this mean for money, risk, time, or the customer?
🗺️ How to read this diagram

Read it left-to-right: a raw technical fact enters on the left and leaves on the right re-framed for the people in the room.

  • The red box on the left is the fact as an engineer naturally says it — mechanism first ("we cut p95 latency 40%"). To an exec this is the blank stare.
  • The middle box is the single translation question you run every fact through: what does this mean for money, risk, time, or the customer?
  • The green box on the right is the answer to that question — the same fact, now led by its consequence ("the feature feels instant, so more users finish"). The bar underneath is the rule: lead with the so-what, keep the "how" for when they ask.

In short: You don't hide the mechanism — you re-order the sentence so the meaning comes first and the mechanism becomes the optional footnote.

Engineer saysExec hears (nothing)Translate to
"We cut p95 latency 40%"?"The feature now feels instant, so more users finish the task"
"We added an eval gate in CI"?"We can't ship a quality regression to customers anymore"
"Prompt caching saves tokens"?"This cuts the feature's running cost ~X%/year"
"The model sometimes hallucinates"?"There's a bounded accuracy risk; here's how we contain and monitor it"
BLUF — bottom line up frontExecutives read top-down and stop when they have the answer. Put the recommendation, the number, or the ask in the first sentence, then support it. A memo that builds to its conclusion over two pages will be decided on the first paragraph anyway — so make the first paragraph the one you want them to act on.

2 · The ROI business case

A credible AI business case has four parts: the problem (in business terms), the expected value (revenue, cost saved, or risk reduced — quantified), the cost (build + run TCO from EL3), and the risk/assumptions stated honestly. The number that wins is net value with a stated confidence, not a best-case fantasy.

Here's the pitch that almost always dies, and why. An engineer, genuinely excited, tells the funding meeting: "This AI feature could save us millions — customers will love it, it'll cut support time in half, and the model just keeps getting better." Every word might be defensible, and the request gets declined anyway. Not because the idea was bad, but because a business case made entirely of upside reads, to anyone who controls a budget, as naive — or worse, as someone hiding the downside. The most reliable way to not get funded is to present a case that can only go right.

Think about how a bank decides whether to give you a loan. They don't just ask "how much could you earn?" They ask what you already earn, what you owe, what happens if you lose your job, and how confident they are in your answer. They're pricing risk-adjusted return, not best-case return. A CFO evaluates an AI investment exactly the same way, and the four-part structure below is simply the shape of an argument that answers all four of their instinctive questions: what problem is this worth solving, what do we get, what does it truly cost, and what could go wrong. Skip any one part and a sharp exec fills the gap with their own (usually pessimistic) assumption.

Two pieces of this need spelling out because beginners get them wrong. First, expected value must be quantified in the exec's currency — dollars, hours saved, or risk reduced — not in "users will love it." "Love it" is not a line item. If you can't put a number on it, say so honestly and label it a qualitative benefit, rather than dressing a feeling up as a fact. Second, cost means total cost of ownership (the build and the ongoing run cost — inference, monitoring, upkeep — from EL3), not just the sprint to ship it. The single most common ROI mistake is quoting the build cost and quietly ignoring that inference bills arrive every month forever. The number that actually earns funding is net value stated with a confidence range: not "this saves $500k" but "conservative $180k, expected $360k, optimistic $540k, and here's the assumption that decides which one we land on." A range signals you understand the uncertainty; a single confident number signals you haven't thought hard enough. The pipeline below shows the four parts flowing into that final honest net.

Business problem in $ terms Expected value quantified Cost (TCO) build + run Risk + assumptions honest Net + confidence the ask
🗺️ How to read this diagram

Follow the blue arrows left to right: the business case is a chain, and each box feeds the next until you reach the number you actually ask for.

  • The first box — "Business problem, in $ terms" — anchors the whole case: you name the pain in money, not in technology.
  • The middle three boxes, joined by the blue arrows, do the arithmetic honestly: "Expected value (quantified)" is the upside, "Cost (TCO): build + run" subtracts what it costs to build and operate, and "Risk + assumptions (honest)" forces you to state what could make the number wrong.
  • The last box — "Net + confidence, the ask" — is the payoff: a net figure carried at an explicit confidence level, not a lone best-case number.

In short: A credible ROI case flows problem → value → cost → risk → net, ending in a confidence-qualified ask rather than a single rosy figure.

An ROI case without downside is a red flag to a good CFOExecutives who've been burned distrust a business case with no risks and a single rosy number. Presenting a range (conservative / expected / optimistic) with the assumptions that drive it builds more credibility than a confident point estimate — and it's honest. State what would make the number wrong.

3 · The risk register and board framing

A risk register is the living list of what could go wrong, each entry with a likelihood, an impact, an owner, and a mitigation. It's an engineering artifact and the source for board risk framing — boards think in likelihood × impact and "who owns it," not in exploit mechanics.

The failure this prevents is the worst kind: the surprise. Imagine the board learns your AI system leaked customer data — not from you, but from a news headline or a regulator's letter. In that moment two things happen at once: the incident itself, and the discovery that you knew this was possible and never told them. The second is often career-ending in a way the first isn't, because it destroys the one thing a leader trades on — trust. A risk register exists so that no risk is ever a surprise. Every scary possibility has already been written down, sized, assigned an owner, and paired with a plan, before it happens.

Think of it as the same document a doctor keeps: a chart listing each condition, how serious it is, how likely it is to flare up, who's managing it, and the treatment. A patient with a well-managed chronic condition isn't "unsafe" — they're known and cared for. That reframe is the whole point. The register doesn't make you look risky; it makes you look like the adult in the room who has already thought about what could go wrong. An AI system with an empty risk register isn't safe — it's unexamined, which is far more dangerous.

The register has two audiences, and confusing them is the classic mistake. To engineers, it's a working artifact: precise, technical, full of the exploit detail you need to actually build the mitigation. To the board, it's a source you translate up — the same altitude problem from section 1. A board does not want to hear "indirect prompt injection via retrieved context"; it wants three things per material risk: what it is in plain language, how bad × how likely, and who owns it and what they're doing. The four columns — likelihood, impact, owner, mitigation — exist precisely because those are the columns a board reasons in. Note that likelihood and impact are separate axes on purpose: a low-likelihood, critical-impact risk (a cross-tenant data leak) is managed completely differently from a medium-likelihood, medium-impact one (runaway cost), and collapsing them into a single "high/low" label throws away the information that decides where you spend your attention. The sample register below shows the shape; the callout after it shows how each row compresses into the board's three sentences.

why likelihood and impact are separate axes likelihood → impact → low watch runaway cost cross-tenant leak (critical) low watch low high low low critical Two axes, not one label. A rare-but-critical risk (bottom-right red: a cross-tenant leak) and a likely-but-mild one (top-left/green: watch-list cost) sit in totally different cells — and get totally different responses. Collapsing them to "high/low" hides that.
🗺️ How to read this diagram

Read it like a map: how likely a risk is runs up the left edge, how bad it is runs along the bottom — every risk lands in one cell.

  • The vertical axis is likelihood (low at the bottom, high at the top); the horizontal axis is impact (mild on the left, critical on the right).
  • The colors rank the cells: green cells are low-concern, amber are watch-and-manage, the red cell is the one you cannot ignore — high impact even if it's rare.
  • The payoff is the bottom-right red cell: a cross-tenant data leak is low likelihood but critical impact, so it needs strong preventive controls — nothing like the likely-but-mild runaway-cost risk. A single "high/low" score would blur these two into the same bucket.

In short: Keeping likelihood and impact as separate axes is what tells you where to spend attention — the register's two columns are these two axes.

RiskLikelihoodImpactOwnerMitigation
Model hallucinates in a customer answerMediumHighEng LeadGrounding + citations + eval gate + HITL on high-stakes
Prompt injection exfiltrates dataLowHighSecurityLeast privilege + rails + action gate + monitoring
Cross-tenant data leakLowCriticalEng LeadTenant-filtered retrieval + canary test in CI
Vendor deprecates the modelMediumMediumPlatformProvider abstraction + tested fallback
Runaway costMediumMediumFinOpsBudgets, quotas, anomaly alerts
Board framing: three sentences per riskFor a board, each material risk is: what it is (plain language), how bad × how likely, and what we're doing about it and who owns it. That's it. A board doesn't want the CVE; it wants confidence that risks are known, owned, and mitigated — and it wants to hear the scary ones from you before they hear them from a headline.

4 · Roadmap communication

AI roadmaps face a special hazard: model releases and priorities shift faster than a Gantt chart. Communicate in outcomes and horizons, not dated feature promises. A now / next / later framing survives change; "feature X ships March 14" does not, and breaking it costs you credibility you'll need later.

You've seen this movie, probably starring you. Last quarter you put "Autonomous agent — ships Q3" on a slide because a new model was rumored to make it possible. The model slipped. The capability wasn't there. Q3 came and you shipped nothing autonomous. It doesn't matter that the delay was entirely outside your control — what the org remembers is that you promised a thing and missed it. Do that twice and your roadmap stops being read as a plan and starts being read as a wish list. In AI this happens more than anywhere else, because so much of what you'd like to build depends on capabilities that don't exist yet on the day you present.

The fix borrows from how good weather forecasts are communicated. A forecaster says "it's raining now" (certain), "rain likely tomorrow" (probable), and "unsettled next week" (a direction, not a promise) — and nobody feels lied to when next week turns out sunny, because the confidence was baked into the framing. A now / next / later roadmap does the same thing: it attaches a confidence level to each horizon so that a shift in the far horizon is expected, not a broken promise. You commit hard to Now because you're already building it. You point a direction with Next and reserve the right to learn. You name only themes in Later, deliberately vague, because pretending to know exactly what you'll build in a year is the fiction everyone can see through.

The single most important move is how you handle a capability-dependent item — the feature that needs a model that isn't out yet. The mistake is to promise it with a date, betting your credibility on someone else's release schedule. The craft is to state it as a bet with a trigger: "if models reach reliability bar X, then we'll build Y." Now if the model ships, you look prescient; if it doesn't, you look disciplined — and either way you kept your word, because you never promised the model, you promised your response to it. That's why the whole framing protects the currency you can't refill on demand: credibility. You spend credibility on the hard asks later (the big budget, the risky pivot), so you protect it now by only putting dates on things you actually control. The horizon table below lays out what you commit to, and at what confidence, in each band.

commit hard up close, stay vague far out time → Now outcomes in flight high confidence Next directional bets medium confidence Later themes & options low confidence capability bet: "IF models reach X, THEN we build Y" Confidence baked into the framing. You commit hard to Now (green), point a direction with Next (amber), name only themes in Later (grey) — and anything that needs an unreleased model is an if-then bet, never a dated promise.
🗺️ How to read this diagram

Read it left-to-right along the time arrow: the further out you look, the less you commit and the vaguer you get — on purpose.

  • The three boxes are the horizons. Now (green) is specific outcomes you're already building; Next (amber) is a direction with named bets; Later (grey) is themes only.
  • The confidence label under each box drops from high → medium → low. That declared confidence is what makes a shift in the far horizon expected rather than a broken promise.
  • The bottom purple bar is the key move: a feature that depends on a model that doesn't exist yet is stated as "if models reach bar X, then we build Y" — you promise your response, not someone else's release date.

In short: Attaching a confidence to each horizon — and framing capability items as if-then bets — protects the credibility you'll need to spend on the hard asks later.

HorizonWhat you commit toConfidence
NowSpecific outcomes in flightHigh — you're building it
NextDirection + the bets we're makingMedium — subject to learning
LaterThemes and options, not promisesLow — deliberately vague
Don't promise a dated feature that depends on a model that doesn't exist yetIt's tempting to roadmap around an anticipated model capability. State it as a bet with a trigger ("if models reach X, we'll do Y"), not a commitment. When you promise a date contingent on someone else's release and miss it, the org remembers the miss, not the caveat.

5 · Metrics execs care about & saying no

Execs care about a handful of numbers: value delivered (adoption × per-task value, from EL4), cost (and trend, from EL3), risk posture (open high risks and their owners), and reliability (does it work when customers need it). Report those; leave tokens-per-second for the engineering review. And the hardest leadership skill: saying no to a bad AI idea — an executive's pet project, an AI-for-AI's-sake feature, a use case with unacceptable risk — without becoming an obstacle.

There's a quiet law of organizations: you get more of what you measure. Put tokens-per-second on the executive dashboard and, without anyone deciding to, the org starts optimizing tokens-per-second — engineers tune the metric on the slide because that's what leadership looks at, even though a customer has never once cared how many tokens per second your model emits. Report the wrong numbers and you don't just waste a slide; you steer the whole team toward the wrong goal. The choice of what to report is a management decision, disguised as a formatting one.

So which numbers? Boil it down to the four questions every executive actually has, whether or not they phrase them this way: Is it making us money? (value delivered — and remember value is adoption × per-task benefit, so a brilliant feature nobody uses is worth roughly nothing). Is it costing us too much? (run cost and its trend). Are the scary things handled? (open high risks and who owns them). Does it actually work? (reliability). Everything else — latency percentiles, eval sub-scores, model version churn — is real and important, and it belongs in the engineering review, not the exec page. And always show a trend, not a snapshot: "$40k/month" tells an exec nothing; "$40k/month, down from $70k last quarter" tells a story they can act on.

The last skill on this page is the hardest, and it's the flip side of everything above: saying no. Sooner or later a senior leader will fall in love with an AI idea that's high-risk, low-value, or just AI-for-AI's-sake, and your job is to stop it without becoming the "department of no" that everyone learns to route around. The instinct to fear is reflexive refusal — "no, too risky" — which reads as obstruction and costs you the seat at the table you need to do the job at all. The move that works is agree with the goal, disagree with the method: affirm the outcome the leader wants (you almost always share it), then bring evidence — the ROI case, the risk-register entry, the TCO — for why this specific approach won't get there, and crucially, offer an alternative that does. Then let them decide: you inform, they own the call. That last part is what separates leadership from gatekeeping. A "no" that comes with a reason and a better path is you doing your job; a "no" with nothing behind it is just friction — the organizational version of the over-refusing safety filter that blocks so much it becomes useless. The callout spells out the exact framing.

A bad AI idea lands Agree with the goal affirm the outcome they want Disagree with the method bring ROI · risk · TCO evidence Offer an alternative same goal, lower risk — they decide Reflexive "no, too risky" no reason, no path "Department of no" everyone routes around you Two ways to say no. The left (green) path — agree with the goal, disagree with the method on evidence, offer a path, let them own the call — is leadership. The right (red) path — a reflexive refusal — makes you the department everyone routes around.
🗺️ How to read this diagram

Start at the top box and follow the two arrows down: the left branch is the constructive "no," the right branch is the one that costs you your influence.

  • The top box is the trigger — a leader's high-risk, low-value AI idea lands on your desk.
  • The left green column is the move that works, top to bottom: first agree with the goal, then disagree with the method using ROI/risk/TCO evidence, then offer an alternative that serves the same goal — and let them make the call.
  • The right red column is the failure mode: a reflexive "no, too risky" with no reason and no path, which turns you into the "department of no" people learn to bypass.

In short: A "no" backed by a reason and a better option is leadership; a bare "no" is just friction — same as an over-refusing safety filter.

How to say no and keep your influenceSay no by agreeing with the goal and disagreeing with the method: "I want the same outcome you do — here's why this approach won't get us there, and here's what would." Bring the cost/risk/ROI evidence, offer an alternative, and let the decision-maker own the call. "No" with a reason and a better option is leadership; "no" as a reflex makes you the department everyone routes around — the organizational version of an over-refusing safety filter.

✓ Checkpoint — you can move on when you can…

  • Translate three technical facts into executive-level meaning and lead with the so-what.
  • Build an ROI case with a value range, TCO, and stated assumptions rather than one rosy number.
  • Turn a technical risk into a three-sentence board framing (what / likelihood×impact / owner+mitigation).
  • Communicate a roadmap in now/next/later instead of dated feature promises.
  • Say no to a bad AI idea while preserving the relationship and offering an alternative.
✓ Knowledge check

An executive asks in a review: "Is our AI safe?" You know the honest answer is "it depends on what you mean, and there's residual risk." How do you answer in a way that's both truthful and useful to a board?

Show answer
Don't answer "yes" (false) or dive into mechanics (useless to them). Answer at board altitude: "No AI system is risk-free; ours has a known, owned, and mitigated risk posture." Then give the three-sentence framing for the top one or two risks — what it is, how bad × how likely, and what we're doing about it and who owns it — and point to the risk register as the living record. This is truthful (acknowledges residual risk), useful (frames it as managed, not absent), and it builds trust because you surfaced the scary items yourself. The failure modes are over-claiming safety (which one incident destroys) and drowning them in jargon (which reads as evasion).
✓ Knowledge check

A senior VP is excited about adding a flashy generative-AI feature you believe is high-risk and low-value. How do you say no without torching your relationship or your influence?

Show answer
Lead with the shared goal, not the rejection: affirm the outcome the VP wants. Then present evidence, not opinion — the ROI case (low expected value at real cost), the risk-register entry (high likelihood × high impact, e.g. a customer-facing hallucination or compliance exposure), and the TCO. Crucially, offer an alternative that serves the same goal at lower risk/higher value, and let the VP make the final call — you inform, they decide. Framing: "I want the same win you do; this specific approach carries [risk] for [little value], and here's a path that gets us there safely." This preserves the relationship because you're a partner solving their problem, not a gatekeeper — and reflexive, evidence-free 'no' is exactly what makes leaders route around you.

🪜 Practice ladder beginner → industry

Six graded exercises, easy to real-world. Try each before opening its solution.

Exercise 1 · Translate five technical facts for an execBeginner

Context: The foundational skill is speaking at the right altitude — meaning first, mechanism later.

Your task: Rewrite five engineer-level statements into executive-level meaning that leads with the so-what.

Requirements:

  • Facts: latency cut, eval gate added, caching saved tokens, occasional hallucination, provider abstraction built
  • Each rewrite leads with business impact (money, risk, time, or experience)
  • Keep the mechanism as an optional follow-up, not the headline

💡 Hint: Ask of each fact: 'so what does this mean for money, risk, time, or the customer?'

Show solution
  • Latency −40%: "The feature now responds instantly, so more users finish the task and fewer drop off."
  • Eval gate in CI: "We can no longer accidentally ship a quality regression to customers — every change is quality-checked before release."
  • Caching saves tokens: "This lowers the feature's running cost by roughly X% a year with no change to the experience."
  • Occasional hallucination: "There's a bounded accuracy risk; we contain it with grounding, citations, and human review on high-stakes answers, and we monitor it."
  • Provider abstraction: "We're not locked to one AI vendor — if one raises prices or deprecates a model, we can switch with low disruption, which also gives us negotiating leverage."

Each leads with money/risk/time/experience; the mechanism is available if asked.

Exercise 2 · Build a one-page ROI business caseIntermediate

Context: A CFO funds a clear net-value case with honest assumptions, not a rosy point estimate.

Your task: Write a one-page ROI case for a representative AI feature (say, a support-drafting agent).

Requirements:

  • State the business problem in money/time terms
  • Quantify expected value as a range (conservative/expected/optimistic)
  • Include build + run TCO
  • State the key assumptions and what would make the number wrong
  • End with the net value and the ask

💡 Hint: Net value with a confidence range beats a single optimistic number.

Show solution

Problem (BLUF): Support agents spend ~40% of time drafting routine replies; at current volume that's ~$1.2M/year of agent time on work an AI can draft.

Expected value (range): conservative 15% time saved → ~$180k/yr; expected 30% → ~$360k/yr; optimistic 45% → ~$540k/yr. Value = time saved redeployed to complex tickets + faster response.

Cost (TCO, from EL3): ~$30k build + ~$30k/yr run (inference + upkeep). Net expected value ≈ $330k/yr.

Assumptions / what makes it wrong: adoption reaches ~70% (the biggest lever — see EL4), draft-acceptance stays high, no trust-destroying incident. If adoption stalls at 20%, net value roughly quarters.

Ask: fund a 4-week pilot ($X) with a go/no-go on measured time-saved and acceptance before broader investment. All cost figures verified against current pricing.

Exercise 3 · Turn a technical risk into a board slideAdvanced

Context: Boards decide on likelihood × impact and ownership, not exploit mechanics.

Your task: Take a real technical risk and produce the board-level framing.

Requirements:

  • Pick a risk (e.g. prompt injection with tool access)
  • Give the plain-language 'what it is'
  • State likelihood × impact and why
  • Name the owner and the mitigation in one line each
  • Contrast it with the (wrong) jargon-heavy version

💡 Hint: Three sentences: what it is, how bad × how likely, what we do and who owns it.

Show solution

Board framing (right):

"What: A malicious instruction hidden in content our agent reads could try to make it leak data or take an unauthorized action. How bad × likely: High impact if it worked, but low likelihood because of our controls. What we do / who owns it: Security owns it; the agent can only access the data it needs and can't take irreversible actions without human approval, and we monitor every action — so even a successful attempt is contained and logged."

Jargon version (wrong): "Indirect prompt injection via retrieved context could pivot the ReAct loop to invoke exfiltration tools bypassing the system prompt's guardrails…" — the board glazes over and reads it as either 'scary and unmanaged' or 'he's hiding something.'

Why the first works: it gives the board exactly what it needs — the risk is known, sized, owned, and contained — and it comes from you, not a headline.

Exercise 4 · Write a now/next/later roadmap that survives changeExpert

Context: AI roadmaps break when they promise dated features tied to unreleased capabilities.

Your task: Produce a now/next/later roadmap for an AI product line and defend why it's structured this way.

Requirements:

  • Now: committed outcomes in flight (high confidence)
  • Next: directional bets (medium confidence)
  • Later: themes and options (low confidence)
  • Include one capability-dependent item framed as a bet with a trigger
  • Explain how this protects credibility

💡 Hint: Commit to outcomes and horizons, not dates on features you don't control.

Show solution

Now (this quarter, high confidence): ship the support-drafting agent to broad rollout; reach ~70% adoption in support; land the eval gate and HITL policy. These are in flight — we commit.

Next (following quarter, medium confidence): extend drafting to a second department; pilot difficulty-based model routing to cut cost. Direction is firm; specifics may shift on learning.

Later (themes, low confidence): deeper workflow automation; multi-step agents for back-office tasks. Options, not promises.

Capability-dependent bet: "If reasoning models reach the reliability bar for unattended multi-step actions, then we'll pursue autonomous back-office workflows" — a bet with a trigger, not a dated commitment on a model that doesn't exist yet.

Why it protects credibility: we only put dates on what we control; everything contingent is framed as a bet, so a shifted priority or a delayed model release is 'we learned and adjusted,' not 'they missed their commitment.' Credibility is the currency you spend on the hard asks later.

Exercise 5 · Design the monthly exec AI dashboardProfessional

Context: Reporting the wrong numbers trains the org to optimize the wrong things.

Your task: Design the one-page monthly AI dashboard for the executive team.

Requirements:

  • Pick ~5 metrics across value, cost, risk, and reliability
  • Define each in one line and why an exec cares
  • Include trend, not just a snapshot
  • State what you deliberately leave OFF (and where it goes instead)

💡 Hint: Value, cost, risk, reliability — the four questions every exec actually has.

Show solution

Exec AI dashboard (monthly, one page):

  • Realized value (adoption × per-task value, trend): are we getting the return? The headline.
  • Run cost + trend (from EL3): is it economical and is spend under control?
  • Open high/critical risks + owners (from the register): are the scary things known and owned?
  • Reliability (uptime / SLA adherence): does it work when customers need it?
  • Adoption trend (% of eligible work): the leading indicator of future value.

Deliberately left off: tokens/sec, p95 latency, model version churn, eval sub-scores — these belong in the engineering review, not the exec dashboard. Putting them on the exec page invites optimization of inputs instead of outcomes. Every metric shows a trend arrow so the story is direction, not a decontextualized snapshot.

Exercise 6 · Say no to a CEO's pet AI projectIndustry scenario

Context: Representative scenario: the CEO, energized by a competitor's announcement, wants a fully-autonomous customer-facing AI agent live in six weeks. You assess it as high-risk, low-readiness. You must respond in a leadership meeting.

Your task: Deliver the 'no' (or 'not like this') in a way that is truthful, evidence-based, and keeps your influence and the relationship.

Requirements:

  • Affirm the underlying goal the CEO cares about
  • Present the risk and readiness evidence at board altitude
  • Offer a credible alternative that serves the same goal
  • Make the decision the CEO's, not yours
  • Say how you'd handle it if overruled

💡 Hint: Agree with the goal, disagree with the method, bring evidence, offer a path, let them decide.

Show solution

Affirm the goal. "You want us to be visibly ahead on AI in the customer experience — I'm completely aligned on that, and I want us to win it."

Evidence at altitude. "A fully autonomous, customer-facing agent in six weeks carries high, hard-to-contain risk: a confident wrong answer or an unauthorized action goes straight to a customer, with reputational and possibly regulatory exposure (risk register: high impact, and at this timeline, high likelihood). We haven't proven the evals, the HITL policy, or the rollout that make it safe — so the expected value is low against a real downside."

Credible alternative. "Here's how we win the same goal fast: ship a human-in-the-loop version in six weeks — the agent drafts, a person approves — which is visibly ahead, low-risk, and gives us the data to expand autonomy safely. We announce the AI experience now and earn autonomy with evidence."

Their call. "That's my recommendation; you own the decision. If speed-to-announce is the priority, the HITL version gets us there without betting the brand."

If overruled: state the residual risk in writing for the register, insist on the minimum non-negotiable guardrails (action gate, monitoring, a kill switch, a bounded scope), and commit to making the CEO's chosen path as safe as it can be — disagreeing and then committing, with the risk owned and documented, not silently sandbagging.

© 2026 studybydoing.in · AI Engineering: Zero to Production · All rights reserved. · About · Privacy Policy · Terms · Contact
Educational content, provided as-is and without warranty. Code samples are examples — review, test, and adapt them before using in production. See the Terms of Use & Disclaimer. Use at your own risk.
© studybydoing.in