71% of FDA-Approved AI May Be a Clinical Liability (Here’s Why)
What you'll discover
I don't think you can ever get rid of bias. But you can definitely try to improve bias by improving the generalizability of the AI model developed on the data.
Dr. Martin Willemink
When 71% of training data for FDA-approved AI comes from just three states, geographic bias shifts from a technical oversight to a direct clinical liability. To deliver on the promise of value-based care, we must move beyond "clean" academic datasets and integrate the diverse, real-world data that reflects the actual patients we serve.
In this episode, Dr. Junaid Kalia and Dr. Harvey Castro sit down with Dr. Martin Willemink, a radiologist and former Stanford faculty member who transitioned into the entrepreneurial world to solve AI’s most significant bottleneck: data diversity. As a clinician-turned-founder of Segmed, Dr. Willemink provides a systematic look at why "garbage in, garbage out" is a systemic risk to patient safety and how building a more representative data pipeline is the only way to achieve true generalizability in healthcare AI.
Referenced in the episode
Connect with the guest
- Martin WilleminkLinkedIn
Medical disclaimer. This podcast is for general informational purposes and is not medical advice. Listening does not create a doctor and patient relationship. Views expressed by the guests and co-hosts are their own and do not represent their employers. No specific vendor or product is endorsed. No PHI is shared.
Read the transcript
AI in healthcare is not an algorithm problem; it's a data problem. Future diagnostics won't be determined by who is the best model, but who has the best data set. Data diversity is the vaccine against AI bias. In medicine we say "garbage in, garbage out," but AI just scales that problem. The real breakthrough in healthcare AI will come when models are trained on the "messy reality" of medicine and not the clean data sets seen in research labs.
Learn more about the work we do
Dr. Junaid Kalia, Neurocritical Care Specialist & Founder of Savelife.AI™
🔗 Website
📹 YouTube
Dr. Harvey Castro, ER Physician, #DrGPT™
🔗 Website
📑 Substack
Edward Marx, CEO, Advisor
🔗 Website
Martin Willemink, MD, PhD, FSCCT, Co-founder & Chief Scientific Officer at Segmed