Where Are We Now? Bias in Health AI

Bias in health AI can shape who gets care, how fairly risk is measured, and whether automation helps or harms patients. Karandeep Singh, M.D., M.M.S.C. explains that predictive AI can reflect historical, representation, measurement, learning, evaluation, and deployment bias, especially when models are trained on limited populations or use flawed proxies for illness and access to care. Singh also describes generative AI as a system trained first to predict text and then to follow instructions, with bias entering through training data, instruction tuning, prompts, and outside information sources. Alongside these risks, he highlights practical uses such as AI-assisted sepsis quality review and patient outreach workflows, while emphasizing governance, human oversight, disclosure, and careful measurement of whether these tools actually improve care. Recorded on 01/30/2026. [Show ID: 41365] Donate to UCTV to support informative & inspiring programming: https://www.uctv.tv/donate Please Note: Knowledge about health and medicine is constantly evolving. This information may become out of date. Explore More Health & Medicine on UCTV (https://www.uctv.tv/health) UCTV features the latest in health and medicine from University of California medical schools. Find the information you need on cancer, transplantation, obesity, disease and much more. Explore More Humanities on UCTV (https://www.uctv.tv/humanities) The humanities encourage us to think creatively and explore questions about our world. UCTV explores human culture through literature, history, ethics, philosophy, cinema and religion so we can better understand the human experience. Explore More Science & Technology on UCTV (https://www.uctv.tv/science) Science and technology continue to change our lives. University of California scientists are tackling the important questions like climate change, evolution, oceanography, neuroscience and the potential of stem cells. UCTV is the broadcast and online media platform of the University of California, featuring programming from its ten campuses, three national labs and affiliated research institutions. UCTV explores a broad spectrum of subjects for a general audience, including science, health and medicine, public affairs, humanities, arts and music, business, education, and agriculture. Launched in January 2000, UCTV embraces the core missions of the University of California -- teaching, research, and public service – by providing quality, in-depth television far beyond the campus borders to inquisitive viewers around the world. (https://www.uctv.tv)