The Product Experience (Mind the Product)
Why Your AI Strategy Is Failing - Barry O'Reilly (Author, Artificial Organizations)
Why It Matters
Understanding that AI success hinges on behavior change, not just tool adoption, helps leaders avoid costly, ineffective projects and unlock real productivity gains. As AI spending surges, companies that embed AI into decision‑making processes can achieve faster, higher‑quality outcomes, giving them a competitive edge in a rapidly evolving market.
Key Takeaways
- •Tools-first AI projects fail; behavior change drives success.
- •85% of Gen AI initiatives and 83% of transformations fail.
- •Pairing humans with AI triples ideation productivity and decision velocity.
- •Leaders must role‑model AI usage to create safe, scalable adoption.
- •Measure success via decision readiness, velocity, not just time saved.
Pulse Analysis
The episode opens with a stark warning: launching AI initiatives by picking a tool first almost guarantees failure. Barry O'Reilly cites that 85 % of generative‑AI projects and 83 % of broader digital transformations collapse because they treat technology as the problem instead of a catalyst for behavior change. He argues that true AI strategy is about reshaping how people work, preserving human judgment, and creating space for deeper thinking. This perspective reframes AI from a buzzword to a lever for productivity, decision speed, and sustainable competitive advantage.
O'Reilly illustrates his point with personal experiments that turned ordinary tasks into high‑velocity processes. By swapping a keyboard for a conversation‑driven transcription service, he produced a 10,000‑word chapter in two hours, dramatically shortening his writing cycle. He extended the same habit to one‑on‑ones, using AI to capture, synthesize, and distribute meeting insights instantly, turning every conversation into a reusable data asset. The result was faster decision making, clearer agendas, and a measurable boost in what he calls ‘decision velocity.’ He emphasizes that leaders must model these behaviors to build psychological safety and encourage organization‑wide adoption.
For executives, the takeaway is to shift metrics from superficial time‑saving to leading indicators of behavioral shift. Simple gauges—such as a pre‑meeting readiness score or the proportion of decisions made within a set timeframe—provide early signals of AI’s impact. Role‑modeling AI usage, publicly sharing successes and failures, and framing tools as amplifiers rather than replacements create a culture where teams experiment without fear. By focusing on decision readiness, velocity, and data‑asset creation, companies can move beyond the 5 % profit lift most AI pilots deliver and achieve lasting transformation.
Episode Description
Barry O’Reilly is an entrepreneur, author, and founder of Nobody Studios, an early-stage venture studio focused on building AI companies. Over the last six years he has worked with founders, executives and enterprise leadership teams to rethink how organisations operate in the age of generative AI, while simultaneously building and launching companies inside the studio model.
A former startup advisor and executive coach, Barry has spent the last several years studying why most AI transformations fail despite enormous investment. Through his coaching and advisory work with leaders from companies including American Airlines, Skyscanner, and Slack, Barry has developed practical frameworks for improving decision-making, reducing administrative overhead, and increasing what he calls "decision velocity".
In this episode, Barry explains why AI adoption fails when companies focus on tools instead of behaviour change, why judgment is becoming the most important human skill, and how teams can use AI to improve collaboration rather than replace people.
Key takeaways
— Most AI transformations fail because organisations start with tools instead of behaviours. Installing AI software does not change how people work, make decisions or collaborate.
— The most effective AI use cases amplify a person’s natural way of working. Barry realised he produced better writing by talking through ideas and using transcription tools instead of forcing himself into traditional writing workflows.
— Capturing meetings, conversations and decisions as structured data creates long-term organisational intelligence. Every interaction becomes a reusable asset that improves preparation, follow-through, and future decision-making.
— Leaders must role-model AI adoption themselves. Organisations see better outcomes when executives openly experiment with tools, share lessons learned, and create psychological safety around adoption.
— Decision velocity matters more than raw productivity. Teams improve when they arrive prepared, make decisions faster, reduce reversals, and spend more time solving meaningful problems instead of handling administration.
— AI should be used to challenge thinking, not replace it. The most valuable prompts ask for blind spots, alternative scenarios, and pressure tests rather than definitive answers.
— Teams working with AI outperform individuals working with AI. Barry cites research showing that collaborative ideation with AI produces significantly stronger outcomes than isolated use.
— Productivity gains are meaningless if they simply create more exhaustion. The real opportunity is creating space for reflection, slow thinking, and better judgment.
— Judgment is the critical human capability organisations cannot outsource. If people stop exercising judgment and rely entirely on AI-generated answers, they gradually erode their ability to make decisions under uncertainty.
Chapters
1:03 — Building AI companies at Nobody Studios
3:16 — Why AI transformations fail
5:05 — The danger of focusing on tools
6:35 — Discovering natural workflows with AI
8:51 — Turning conversations into data assets
12:02 — Measuring successful AI adoption
13:14 — Why leaders must role-model behaviour change
18:39 — Decision velocity as a leadership metric
21:33 — Escaping administrative overload
23:02 — Why leaders need time to think
26:54 — What CFOs are worried about
28:08 — Can AI replace startup teams?
29:45 — Why distribution still matters most
33:13 — Capturing and synthesising ideas with AI
34:38 — Using AI to challenge your thinking
37:11 — Avoiding top-down AI-driven strategy
39:00 — Why teams plus AI outperform individuals
42:31 — The problem with AI-generated certainty
43:12 — Preserving human judgment
44:55 — Hiring for judgment and decision-making
47:19 — Final reflections on leadership and AI
Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.
Comments
Want to join the conversation?
Loading comments...