Why Adding a Human Doesn't Automatically Make AI Better

Why It Matters

Organizations embedding AI into workflows may not see quality improvements simply by putting humans ‘in the loop’; miscalibrated confidence and human response to uncertainty can degrade results, so firms must redesign interfaces, incentives, and processes to realize the promise of AI-human collaboration.

Summary

Researchers presented experimental evidence that adding humans to AI decision loops does not automatically improve outcomes. In a radiology study, a supervised AI outperformed about three-quarters of radiologists on its own, yet radiologists using the tool performed no better on average than those without it. Analysis showed the effect depended on AI confidence: confident AI recommendations improved human accuracy, while uncertain recommendations made humans less accurate. The speakers argued that human-AI teaming requires careful design, calibration of AI confidence signals, and understanding of human biases rather than assuming additive gains.

Original Description

On April 30, 2026, Wharton Human-AI Research (WHAIR) hosted an AI Horizons webinar exploring the perils of human-AI teaming. The discussion was led by Prasanna (Sonny) Tambe, Faculty Co-Director of Wharton Human-AI Research, joined by Gérard Cachon, Fred R. Sullivan Professor of Operations, Information and Decisions and Professor of Marketing at the Wharton School, and Alex Moehring, Assistant Professor at the Daniels School of Business, Purdue University.

Each of the speakers drew from recent research they conducted, and together their panel examined how human-AI collaboration impacts decision-making across industries, highlighting both opportunities and risks.

ABOUT THE SERIES

Explore the evolving world of artificial intelligence with the AI Horizons webinar series, hosted by Wharton Human–AI Research. This series dives into the latest AI research, applications, and industry trends—highlighting how emerging technologies are shaping the future of business. Episodes feature a range of expert voices, from leading academic researchers to authors of influential white papers, industry reports, and popular press books. Whether sharing new research insights or real-world use cases, each conversation offers a fresh perspective on the rapidly shifting AI landscape.

To learn more, visit whr.tn/aihorizons.

#Wharton #AIinBusiness #AIintheWorkplace #HumanAI #HumanAICollaboration

-----

Founded in 1881 as the world’s first collegiate business school, the Wharton School of the University of Pennsylvania is shaping the future of business by incubating ideas, driving insights, and creating leaders who change the world.

With a standing faculty of 241 renowned professors, Wharton has 5,000+ students across four degree programs: undergraduate, MBA, executive MBA, and doctoral. Each year 13,000+ professionals from around the world advance their careers through Wharton Executive Education’s individual, company-customized, and online programs – with 200,000+ others earning certificates from Wharton Online since 2015. More than 104,000 Wharton alumni form a powerful global network of leaders who transform business every day.

Learn more about Wharton: https://www.wharton.upenn.edu/

Subscribe to the Wharton YouTube channel: https://www.youtube.com/user/thewhartonschool/?sub_confirmation=1