‘Not Regulated’: Launch of ChatGPT Health in Australia Causes Concern Among Experts

Why It Matters

The launch exposes a regulatory vacuum for AI‑driven medical advice, creating immediate public‑health risks and prompting urgent policy action.

Key Takeaways

• ChatGPT Health not classified as medical device in Australia
• No independent safety studies published for the AI platform
• Users may mistake AI advice for professional medical guidance
• Privacy claims rely on consent, not mandatory oversight
• Experts demand clear regulations and consumer education

Pulse Analysis

The Australian health‑tech market is witnessing a rapid infusion of generative AI, with OpenAI’s ChatGPT Health promising to translate lab results and wellness data into layperson‑friendly guidance. While the platform leverages a proprietary HealthBench testing framework involving physicians, the methodology remains opaque and unverified by peer‑reviewed research. This lack of transparency contrasts sharply with the stringent approval pathways required for traditional medical devices, leaving consumers to rely on an AI that operates without mandatory safety checks or post‑market monitoring.

Recent incidents illustrate the tangible hazards of unregulated AI advice. A 60‑year‑old man, misled by ChatGPT Health to substitute table salt with industrial sodium bromide, suffered severe hallucinations and required emergency care. Such cases reveal how confident, personalized responses can blur the line between general information and clinical recommendation, especially when the system omits critical safety details like contraindications or side‑effect warnings. Without independent validation, the risk of misinformation proliferates, potentially amplifying health disparities among users lacking medical literacy.

Policymakers, industry leaders, and consumer advocates now face a pivotal choice: impose a regulatory framework that treats AI health tools as medical devices, or risk a cascade of avoidable harms. Clear guidelines, mandatory safety trials, and transparent reporting could harness AI’s benefits—multilingual support, chronic‑condition monitoring, and reduced wait times—while safeguarding public health. Simultaneously, robust consumer education campaigns are essential to ensure users understand the advisory nature of the technology and seek professional care when needed. Balancing innovation with oversight will determine whether AI becomes a trusted partner in healthcare or a source of unchecked risk.