Proposing a Framework to License Clinical AI

Proposing a Framework to License Clinical AI

Proposing a Framework to License Clinical AI

https://ldi.upenn.edu/our-work/research-updates/proposing-a-framework-to-license-autonomous-clinical-ai/

Publish Date: 2026-05-15 09:14:00

Source Domain: ldi.upenn.edu

  • Utah’s Medical Licensing Board suspended a pilot program with AI company Doctronic, which allowed a chatbot to evaluate patients and recommend prescription renewals for chronic condition drugs, citing lack of proper clinical oversight and potential risks to patient safety.
  • The incident highlights a broader regulatory landscape where states like Utah are grappling with over 250 bills governing clinical AI without a cohesive federal regulatory framework.
  • Federal regulatory tools, particularly the FDA’s device-approval process, are outdated and unsuitable for regulating autonomous clinical AI, which requires continuous updates and adaptation unlike static medical products.
  • The move occurs amid a national physician shortage, where traditional solutions take years to implement, and alternative faster solutions like AI in healthcare need regulatory alignment.
  • The author, Alon Bergman, emphasizes the urgent need for a regulatory framework that supports and appropriately oversees the rapid adoption of clinical AI.