POM in the AI Era
Written from hands-on use. This guide comes from working with the tools and practices it covers, not just from reading the documentation.
- AI makes teams faster, but results often stay flat if the team still works like a project shop.
- Cagan’s July 2026 way of putting it: build to learn (discovery) versus build to earn (delivery).
- Whether speed turns into outcomes depends on the operating model, not the tool.
Part of our AI Driven Product Operating Model hub. Start there for the full map of guides, checklists and templates.
In July 2026 Marty Cagan wrote about what he calls the AI productivity paradox. Plenty of teams are clearly delivering faster with AI, yet their outcomes aren’t improving. He points to McKinsey, which describes growing adoption but a hard-to-find performance impact, and to an Atlassian report where most executives say AI sped things up but very few can show a return across the whole organization.
Why it isn't a real paradox
Cagan’s take is that most people use AI to speed up the old project-model way of working, and slowness was never the only problem with that model. It was built to deliver output, not outcomes. He quotes AI product leader Hilary Gridley, who says it has “never been easier to run 10 times faster in the wrong direction.”
Build to learn, build to earn
- Build to learn: Discovery. AI accelerates prototypes and tests that show whether a solution is valuable and viable, before committing.
- Build to earn: Delivery. Once evidence exists, AI accelerates commercial-quality building: reliable, accurate, scalable, performant.
Weaker teams use AI to churn out the old model’s paperwork faster: business cases, roadmaps, PRDs and code. Stronger teams use it to find a solution that’s actually worth building.
What to change in your operating model
| Area | Question to ask |
|---|---|
| Strategy | Are we using AI speed to test more ideas, or to ship more of the same? |
| Teams | Do teams own an outcome, or just deliver faster to a plan? |
| Governance | Do we review outcome evidence, not shipped-feature counts? |
| Quality | Is there a clear threshold between prototype and production? |
Connect to the role-level series. For how the leader's job changes, see our AI-native product leader operating model and the human-agent loop.
Signs you are inside the paradox
- You ship more features every quarter and customer metrics don’t move.
- AI-written PRDs, roadmaps and decks pile up, and nobody can name a decision they changed.
- Prototypes go out to customers as real products, with no quality bar in between.
- Leaders judge AI by hours saved instead of outcomes moved.
- Teams still get handed a list of features to build, just with a shorter deadline.
AI at each concept of the model
| Concept | Use AI to | Keep human judgment for |
|---|---|---|
| Culture | Surface patterns from feedback and retrospectives | Trust, ethics and what the company stands for |
| Strategy | Synthesize data, customer and market signals | Choosing focus and placing bets |
| Teams | Draft artifacts and automate routine work | Ownership and accountability for outcomes |
| Discovery | Build prototypes and run quick tests | Interpreting evidence and deciding what is worth building |
| Delivery | Accelerate code, tests and monitoring | Quality thresholds, security and release decisions |
A build-to-learn week (illustrative)
| Day | Activity | Output |
|---|---|---|
| Monday | Pick one assumption; write the experiment card | Assumption and success threshold |
| Tuesday | Build a prototype with AI tools | Clickable prototype |
| Wednesday | Test with five customers | Recorded sessions |
| Thursday | Review evidence against the threshold | Decision: build to earn, iterate or stop |
| Friday | Record learning and update strategy bets | Updated bets and next experiment |
Use this for AI-assisted prototypes. It keeps discovery honest and disposable.
Template: Build-to-learn experiment card
EXPERIMENT CARD (BUILD TO LEARN) Assumption we are testing: Which risk? value / usability / feasibility / viability Prototype (what we built, with which tools): Who we test with, how many, how: Success threshold agreed before the test: Result: Decision: build to earn / iterate / stop What this prototype is NOT: it is not production code or a customer commitment. Safeguards: customer data handled responsibly; test participants informed.
Prototype with Figma, v0, Lovable or Claude, and test with Maze or UserTesting. Log cards in Notion, Airtable or Jira Product Discovery, and use LaunchDarkly or Statsig flags for small live tests. Use whatever your team already works in.
Run this before an AI-built prototype gets near customers. It checks the threshold SVPG describes between discovery and delivery.
Checklist: Build to learn, build to earn: AI-era gate
- 0 to 4: Keep it a prototype. Gather more evidence.
- 5 to 7: Close. Resolve gaps in quality and risk.
- 8: Ready for commercial-quality delivery.
Staged rollouts: LaunchDarkly, Statsig or Optimizely. AI quality checks: Langfuse, LangSmith, Braintrust or Promptfoo. Make the gate a required step in your GitHub or GitLab pull request template or your Jira workflow. Any equivalent tool works just as well.
Risks to manage
- Trusting generated requirements and analysis without checking where they came from.
- Being sloppy with customer data in prototypes and test tools.
- Mistaking a convincing prototype for proof that people want it.
- Letting speed wear away the review habits that catch bad ideas.
West’s blog on the APOM Guiding Principles sees it much the same way. AI may push organizations to become faster, smaller and flatter, as long as they have a strong, evidence-based operating model built on the fundamentals.
The experiment card and the build gate are there to keep discovery disposable and delivery trustworthy.
Evals: the discovery habit for AI products
If what you ship is itself an AI feature, discovery needs a new habit. Teresa Torres of Product Talk calls it evals. Instead of judging AI output by feel, teams write down what good looks like, test outputs systematically and track quality over time. In operating-model terms, evals sit with discovery and delivery: they test value and feasibility before release and watch quality after it.
| Stage | Eval question | Example evidence |
|---|---|---|
| Discovery | Does the AI output solve the customer problem well enough to be valuable? | Reviewer ratings on real customer cases against a written standard |
| Pre-release | Does quality meet the threshold for commercial use? | Pass rate on a fixed test set; failure categories |
| Post-release | Is quality holding up with real customers? | Monitoring of flagged outputs, complaints and corrections |
| Change | Did a prompt, model or data change make things better or worse? | Before-and-after comparison on the same test set |
Outcome metrics for AI features
An AI feature still needs an outcome, not just a usage count. This table pairs common AI features with outcome-style metrics. The examples are illustrative, so plug in your own baselines and targets.
| AI feature | Output metric (weak) | Outcome metric (stronger) |
|---|---|---|
| Support chatbot | Conversations handled | Share of issues resolved without a human; customer satisfaction after contact |
| Drafting assistant | Drafts generated | Time from start to approved document; share of drafts accepted with light edits |
| Recommendations | Recommendations shown | Change in repeat purchase or task completion |
| Code assistant | Lines generated | Cycle time and defect trends for shipped changes |
What the McKinsey research adds
McKinsey’s operating-model research says that rolling generative AI tools out across the software life cycle, and building capability on purpose, can improve developer experience and productivity in code generation, documentation, translation and test creation. It also warns that operating-model maturity, especially ways of working, correlates most strongly with business results. Put that next to SVPG’s paradox and the message is simple: AI helps most where the model around it already turns speed into learning. See the evidence section for caveats.
Governing AI-built work
- Give every AI-assisted decision that reaches customers a named human owner.
- Keep prototype environments and data apart from production, and say so on the experiment card.
- Note which parts of a spec, analysis or design were drafted by AI and who checked them.
- Set a quality bar a prototype has to clear before it goes anywhere near customers.
- Review AI incidents without blame and feed what you learn back into evals and constraints.
- Don’t put customer data into tools your security and legal teams haven’t approved.
Pairs with the gate checklist above. One page per release candidate.
Template: Production-readiness note (build to earn)
PRODUCTION READINESS NOTE Solution and outcome metric (baseline and target): Evidence it is worth building (link to experiment cards): Quality: reliability, accuracy, performance, scalability results Instrumentation: what we will measure after launch Monitoring and alerts: owner on call Rollout: A/B or staged release plan Rollback plan: Human owner accountable in production: Approved by (product, design, engineering):
Attach it to the pull request or release ticket in GitHub, GitLab or Jira. Supporting checks: CI (GitHub Actions, GitLab CI), security scanning (Snyk, SonarQube), observability (Datadog, Grafana, Sentry) and AI evals (Langfuse, LangSmith).
A 30-day plan for product leaders
- Week 1: list where teams already use AI and what it produces, then note which outcomes those artifacts actually changed.
- Week 2: pick one team and give it an outcome with a baseline. Ask it to use AI for discovery experiments, not extra output.
- Week 3: bring in the build-to-learn experiment card and the production-readiness note.
- Week 4: hold an evidence review. Did AI shorten the time to a decision, or just add to the pile of artifacts?
Watch out. If the review shows more artifacts but the same decisions, you have found the paradox in your own organization. Fix structure, funding and decision rights before buying more tools.
Related guides in this hub
Sources
SVPG, "The AI Productivity Paradox" (July 23, 2026), citing McKinsey and Atlassian’s State of Teams 2026. Also: Product Talk, "AI Evals: A Hands-On Guide for Product Teams" (September 2, 2026); McKinsey, "The bottom-line benefit of the product operating model" (December 19, 2023). Metrics tables are editorial and illustrative.

Next step: turn the operating model into product decisions
An operating model only works if teams can discover what is worth building. The PPDV course covers validation, evidence and ordering assumptions.
Related: Lean Product Validation hub
Frequently Asked Questions (FAQ)
Cagan argues the opposite. The model is what lets strong companies turn AI into outcomes, and the gap between them and everyone else is widening.
Not for learning. The risk is shipping quick prototypes to customers as if they were products.
No. Point it at discovery and quality too, not only output. Speed is useful once you know what’s worth building.
Track the same outcome metrics and flow measures you always have, and compare teams or periods that use AI differently. Hours saved on its own isn’t an outcome.