OpenNashPodcasts

Topic

Roxana Daneshjou

Roxana Daneshjou is a Stanford dermatologist who runs an AI for healthcare lab, and in podcast appearances on NEJM AI Grand Rounds and the Microsoft Research Podcast she discussed bias and fairness in medical AI, especially in dermatology. She says she sees patients half a day a week and spends the rest of her time on the lab.

She told the Microsoft Research Podcast that her team's benchmark found AI models performed significantly worse on brown and black skin, and that fine-tuning on diverse skin tones eliminated the bias. She also said GPT-3.5 and GPT-4 suggested using race to calculate kidney function, which she calls untrue. A 2024 study by her team found 65 percent of surveyed dermatologists reported using large language models.

25 facts from 2 episodes, in date order. These are what speakers said on the shows, each linked to the moment it was said. They aren't independently verified.

Undated

A Science Advances paper from Roxana Daneshjou's team built a diverse skin-disease benchmark and found AI models performed significantly worse on brown and black skin.

“and one of our landmark papers, which was in Science Advances, showed we created a diverse data set, our own diverse benchmark of skin disease and showed that the models performed significantly worse on brown and black skin”

Roxana Daneshjou · The AI Revolution in Medicine, Revisited: Laws, norms, and ethics for AI in health, 1:05:48

Undated

A Proceedings of the National Academy of Sciences paper on untrue race-based beliefs among medical trainees inspired Daneshjou's team to test whether language models repeat them.

“there was a paper in the Proceedings of the National Academy of Sciences, which did not look at technology at all, but actually looked at the race-based biases of medical trainees”

Roxana Daneshjou · The AI Revolution in Medicine, Revisited: Laws, norms, and ethics for AI in health, 1:09:12

Episodes