In brief
Dr. John Halamka argues that healthcare AI will only help patients if it is built and tested on carefully curated, diverse, privacy-protected data. Mayo Clinic Platform pursues this through a federated network, where partner hospitals keep their own data and algorithms travel to the data. Shared standards, transparent model labels and public testing registries are meant to build clinician and patient trust.
The central tension is between AI's promise and its credibility. Many algorithms exist, but few are used daily, because clinicians cannot see what data trained them or where they fail. Halamka contrasts verifiable predictive AI with hard-to-validate generative AI. His answer is human responsibility, plus transparency, ethics and equitable access, so AI augments doctors rather than replacing them.
Facts
Stated by the speakers. Each quote matches the transcript, which shows what was said, not that it is true.
John Halamka was hired on January 1, 2020 to lead Mayo Clinic's front door for partnerships with innovators.
“I was hired January 1 of 2020 to be that kind of front door for Mayo Clinic as it seeks partnerships and collaborations with innovators around the world.”
0:01:02 · John Halamka · Mayo Clinic Platform · 2020
In 2019 Mayo Clinic CEO Gianrico Farrugia asked what it would take to bring innovation to patients in 18 hours rather than 18 years.
“So in 2019, Gianrico Ferruja, the CEO of Mayo Clinic, asked the question, what if you wanted it to be 18 hours, not 18 years?”
0:00:31 · John Halamka · Innovation speed · 2019
Mayo Clinic Platform puts de-identified data into the OMOP standard format under the control of the organizations that generated it.
“put them in an industry standard format, OMOP, under the control of those who generated the data.”
0:04:48 · John Halamka · Data standards
Brad Malin certifies each de-identified data set in the Mayo Clinic Platform federation.
“Brad Malin, one of the world leaders in DID, REID, does the certification of each of the resulting data sets.”
0:07:37 · John Halamka · Data certification
Mayo's data set was graded as 99.6 percent de-identified when it was certified.
“In the case of Mayo, it was graded as 99.6 % de-identified and highly curated and normalized.”
0:07:37 · John Halamka · De-identification
Mayo's data sits in Google Cloud, Mercy uses Azure and Albert Einstein uses AWS, so the federation is cloud neutral.
“In my case, our data happens to sit in Google Cloud, but in the case of Mercy, which works with us, they're Azure. In the case of Albert Einstein, they're AWS.”
0:09:31 · John Halamka · Cloud
Working with the International Standards Organization, Mayo Clinic Platform extended OMOP to cover digital pathology and genomics.
“We've extended OMOP to include certain other kinds of data elements like digital pathology and genomics that are quite in core OMOP.”
0:11:04 · John Halamka · Data standards
In one partner data set Mayo's tools found that more than half of the social determinants of health data were missing, so AI based on them was discouraged.
“what we found is more than half of the social determinants of health were missing.”
0:11:39 · John Halamka · Data quality
Mayo Clinic Platform's accelerator program has brought in about 40 startup companies.
“On the one hand, we have an accelerator program where we brought in about 40 companies so far.”
0:16:54 · John Halamka · Accelerator · 2024
Mayo Clinic and HIMSS announced a program called Solution Studio to test and deploy company AI models.
“Mayo and HIMSS announced something called Solution Studio”
0:18:10 · John Halamka · Solution Studio
Of more than 200 algorithms Mayo has developed, about 30 are used in clinical practice daily.
“of those 200 and some algorithms we've developed, say about 30 are used in clinical practice every single day.”
0:19:35 · John Halamka · AI deployment · 2024
Stat reporter Casey Ross wrote an article saying healthcare AI has a credibility problem.
“Casey Ross, who is a reporter at Stat, a Boston Globe affiliate, wrote a brilliant article last year which said, healthcare AI has a credibility problem.”
0:20:27 · John Halamka · AI transparency · 2023
Mayo's cardiac mortality prediction tool works well for patients with a body mass index under 31 and poorly above 35.
“that tool works really well if your body mass index is less than 31 and not so well if your body mass index is above 35.”
0:22:24 · John Halamka · Model performance
The Coalition for Health AI began in September 2021 with six organizations and had 90 by October.
“in September of 2021, we brought together six organizations Then by October, there were 90 organizations.”
0:24:19 · John Halamka · Coalition for Health AI · 2021
The Coalition for Health AI plans to assign testing to a network of laboratories and host a national registry of results rather than test products itself.
“So CHI won't do the testing itself, but will assign the testing to a nationwide network of laboratories that will report on these products.”
0:26:47 · John Halamka · AI testing
John Halamka has worked with the Bill and Melinda Gates Foundation for 15 years in sub-Saharan Africa and Northern India.
“I've worked with the Bill and Melinda Gates Foundation for the last 15 years in sub-Saharan Africa and Northern India.”
0:29:48 · John Halamka · Global health
Mayo CEO Gianrico Farrugia set Halamka a goal of touching 4 billion people by the end of his presidency.
“And by the end of your presidency, I want you to have touched 4 billion people.”
0:33:09 · John Halamka · Global reach
Mayo is working with Kenya to deploy algorithms there, funded by philanthropy.
“we recently worked with Kenya and we'll be deploying a variety of algorithms in Kenya. and philanthropy will fund the deployment of the algorithms in Kenya.”
0:33:45 · John Halamka · Kenya · 2024
John Halamka did a postdoc in AI at MIT in the 1990s, writing rule-based systems.
“My postdoc was in AI at MIT in the 1990s.”
0:34:29 · Michael Krigsman · Halamka background · 1990s
At Mayo, AI auto-contouring reduced head and neck tumor radiation treatment planning from 16 hours to one hour.
“it used to take 16 hours for a human to develop a sophisticated head and neck tumor treatment algorithm. Today, it takes one hour.”
0:41:41 · John Halamka · Radiation oncology · 2024
About 3,000 of Mayo Clinic's 10 million patients have opted out of data use.
“Of our 10 million patients, about 3 ,000 of 10 million have opted out.”
0:42:33 · John Halamka · Patient consent · 2024
Halamka says a draft CMS non-discrimination rule states AI should augment human decision-making and the doctor stays responsible.
“He said AI should be an augmentation to human decision-making.”
0:39:36 · John Halamka · AI regulation · 2024
Halamka's wife was diagnosed with stage 3A breast cancer in December 2011, which led to founding Unity Farm Sanctuary.
“In December of 2011, my wife was diagnosed with stage 3A breast cancer.”
0:46:38 · John Halamka · Unity Farm origin · 2011
In 2012 the Halamkas sold their Wellesley home and bought 15 acres in Sherborn, Massachusetts, to start Unity Farm Sanctuary.
“So in 2012, we sold our small home in Wellesley, Massachusetts, and purchased 15 acres in a rural town called Sherbourne, Massachusetts.”
0:47:17 · John Halamka · Unity Farm origin · 2012
Unity Farm Sanctuary now covers 100 acres with 22 barns, 360 large animals and about 1,000 volunteers.
“We're now 100 acres and 22 barns with 360 large animals, 1 ,000 volunteers, programs for the elderly, programs for the disabled, and a preschool”
0:47:55 · John Halamka · Unity Farm Sanctuary · 2024