The missing value of medical artificial intelligence

Back to news list

Source: Nature Medicine

Original: https://www.nature.com/articles/s41591-025-04050-6...

Published: 2025-11-25

The article "The missing value of medical artificial intelligence" highlights the problem of the mismatch between the values of artificial intelligence (AI) in medicine and the values of patients and society. AI systems often maximize financial gain, which can lead to the overuse of expensive and risky interventions without regard for the patient's true needs[1]. A study from the Icahn School of Medicine showed that generative AI models can recommend different treatments for the same condition depending on the socioeconomic and demographic background of the patient, leading to disparities in care[2]. For example, higher income patients are more likely to be recommended advanced diagnostic tests, while lower income patients are more likely to be referred for no further tests[2]. The authors highlight the need for better oversight and ethical standards in the development and use of AI in healthcare to ensure equitable and safe care for all patients[2][6]. Further, the importance of aligning the values of physicians, patients, and AI systems for trust and treatment effectiveness is highlighted[1]. Research also highlights the need for physician involvement in AI development as their attitudes influence the adoption of these technologies in clinical practice[3]. Overall, the article calls for systematic evaluation and modification of AI to better reflect ethical and societal values in medicine[1][2][6].