Agents Of Tech
Who Controls Medical AI and What Do They Want?
Why It Matters
Understanding who controls medical AI is crucial because the technology could dramatically shift disease prevention, reduce diagnostic errors, and reshape healthcare costs. As AI moves from research labs to real‑world clinics, ensuring equitable access and patient‑centered governance will determine whether it narrows or widens health disparities.
Key Takeaways
- •1,000 FDA‑approved AI tools rarely used in daily care.
- •AI improves cancer detection by about 29% in trials.
- •Reimbursement, admin bias, and equity hinder AI implementation.
- •Hospitals may deploy AI to increase revenue, not patient time.
- •Early risk prediction enables prevention of heart disease, Alzheimer’s, cancer.
Pulse Analysis
The episode opens with a stark contrast: nearly a thousand FDA‑approved AI systems exist, yet they rarely appear in everyday clinical workflows. Dr. Eric Topol cites Swedish, German, and Hungarian studies that show a 29 % boost in cancer detection when AI assists radiologists. While the technology promises earlier diagnosis and even decade‑long risk prediction, the conversation quickly turns to who will write the rules. Insurers, tech firms, and hospital executives—not physicians or patients—are poised to shape the regulatory landscape, raising urgent questions about accountability and patient safety.
In the United States, reimbursement models remain unclear, and administrators often prioritize revenue over clinician time, risking a repeat of the EHR‑induced burnout. Automation bias, de‑skilling concerns, and the threat of inequitable access—where only affluent patients afford cutting‑edge AI—compound the problem. Real‑world examples illustrate both promise and peril: China’s opportunistic AI that flags pancreatic cancer on routine CT scans, and synthetic note‑generation that frees physicians for bedside care. Yet without win‑win payment structures, these advances may stay isolated pilots.
Looking ahead, Topol emphasizes prevention. Large biobank analyses from the UK and Denmark demonstrate that electronic health records, lifestyle data, protein biomarkers, and polygenic risk scores can forecast over a thousand diseases years before symptoms appear. Multimodal AI could turn routine mammograms into cardiovascular and cancer risk screens, restoring valuable doctor‑patient interaction. To realize this vision, policymakers must craft governance that balances innovation with equity, ensuring tech companies keep tools affordable and accessible. When responsibly deployed, medical AI could shift healthcare from reactive treatment to proactive longevity.
Episode Description
Disclaimer: The conversation in this video is for information purposes only and does not constitute medical advice. Always consult a licensed healthcare professional before making any health decisions.
Dr. Eric Topol believes AI can predict disease decades before symptoms appear, and he's argued that AI without doctors may outperform doctors with AI. But someone has to set the rules. And right now, the people most likely to write them aren't doctors or patients, but rather insurers, tech companies, and hospital administrators.
This week on Agents of Tech we’re exploring prevention, power, and who really controls medical AI, with Dr. Eric Topol, cardiologist, bestselling author, and Founder and Director of the Scripps Research Translational Institute.
We start with Autria asking Dr. Topol about accountability when it comes to medical AI. “It has to be accountable,” he says, but “The problem most people don't realize is there's lots of errors by physicians. In the US, you know, 800,000 serious diagnostic errors a year that result in disability or death. So we're trying to improve accuracy.” He describes studies that show that AI without doctors outperforms doctors using AI, and offers some possible reasons that the studies came to those conclusions.
Stephen brings up a Swedish breast cancer study that showed a 29% improvement when AI was brought into detecting, and wonders why that kind of result hasn’t led to widescale adoption. Eric breaks down some of the issues with adopting AI, and he and Laila discuss the implementation problem, including the impact of income disparities on access.
Dr. Topol and Autria consider the differences between using AI to look for a cure, and what Eric feels is more promising, using AI for disease prevention.
He explains to Stephen how AI has already been used not only to predict disease, but also when it will show up! With Alzheimer’s, for instance, there are layers of data we’re not yet using. “There are biomarkers, like the breakthrough one for Alzheimer's disease, p-tau217, that tells us in advance 15 or 20 years about people who are destined to have a high risk.” Later, he goes into more detail about how AI can make a difference in preventing Alzheimer’s and slowing down the “brain clock.”
The conversation shifts to who controls medical AI and what their goals are. Dr. Topol describes hospital administrators who only want to use AI to “increase revenue and to use AI to maximize productivity…My biggest concern about the AI era in medicine is we have this great chance to restore a remarkable patient-doctor relationship. We may never see it again for a long, long time, if ever. And we could blow it because of business-centric issues.”
Eric tells Laila how AI can give doctors back time they spend on writing notes, and how China is using opportunistic AI – finding things that were not the reason why abdominal and chest CTs were done that doctors miss – to pick up pancreatic cancer before it’s too late.
Another question the team addresses is whether medical AI will benefit everyone or just the rich. Dr. Topol says it will be hard work to ensure the democratization of healthcare, and that it’s one of his primary worries.
Finally, it’s our lightning round. Autria asks where people will draw the line with AI, and Eric talks about the current public backlash to AI that he feels will fade over time as we resolve their issues.
Laila asks Eric what’s widely accepted in his field that he disagrees with, and he says it’s ludicrous that people in genomics say we shouldn't be using polygenic risk scores.
And Stephen asks Eric what people aren't talking about now, and he says “no one's really talking about this prevention opportunity. I'm kind of the lone wolf out there.”
What about you? If AI could predict your disease decades early, but the price was that that data is sitting in the hands of tech companies and insurers, not necessarily your doctor, would you still want it? Tell us in the comments.
Comments
Want to join the conversation?
Loading comments...