OpenNashPodcasts

Person

Peter Lee

Peter Lee is a Microsoft researcher and executive who appears on podcasts including NEJM AI Grand Rounds and the Microsoft Research Podcast, where he discusses artificial intelligence in medicine, GPT-4 and his career. Lee, Carey Goldberg and Zak Kohane wrote the book The AI Revolution in Medicine shortly after OpenAI released GPT-4.

Lee says he was a Carnegie Mellon professor, later worked at DARPA, and in 2016 agreed to lead Microsoft's healthcare work. He also describes Microsoft's medical experiments with GPT-4, including using one GPT-4 to propose a diagnosis and another to check it for errors. Each fact below links to the moment it was said.

3 episodes · 31 quoted claims

Peter Lee says his parents immigrated from Korea, earned PhDs, and became a physics professor and a chemistry professor.

“My parents immigrated from Korea and got their PhDs, and my dad became a physics professor, and my mom became a chemistry professor.”

NEJM AI Grand Rounds · 0:04:21

Peter Lee became a professor at Carnegie Mellon University, working on theoretical computer science.

“I ended up getting my professorship at Carnegie Mellon University doing that kind of theoretical computer science work.”

NEJM AI Grand Rounds · 0:05:04

After Barack Obama's 2008 election, Peter Lee was pulled into government service at DARPA.

“And then after Barack Obama was elected in 2008, I was Shanghai to serve in the government at DARPA.”

NEJM AI Grand Rounds · 0:05:04

DARPA staged the Network Challenge on the 40th anniversary of the ARPANET, placing 10 red weather balloons across the continental United States.

“we staged a national contest on the 40th anniversary of the ARPANET. We took 10 big red weather balloons across the continental U.S.”

NEJM AI Grand Rounds · 0:07:54

The DARPA Network Challenge offered a $40,000 prize to whoever found the precise locations of the 10 balloons.

“said, whoever can find the precise locations of these 10 balloons would win a $40 ,000 prize.”

NEJM AI Grand Rounds · 0:08:28

A team from the MIT Media Lab led by Sandy Pentland won the DARPA Network Challenge by mobilizing social media.

“a team from the MIT Media Lab under Sandy Pentland that came up with a beautiful way to mobilize social media”

NEJM AI Grand Rounds · 0:08:28

Peter Lee says the Network Challenge became the foundation of a program called Nexus 7, which was deployed in Afghanistan.

“That project, as silly as it was, ended up forming the foundation of a program called Nexus 7 that ended up getting deployed in Afghanistan during that war”

NEJM AI Grand Rounds · 0:09:10

Peter Lee says a Microsoft research project becomes an official incubation when its expense grows large enough to bother the chief financial officer, after which it must be shut down or turned into a real business.

“at some point it gets large enough that the company, and in particular our chief financial officer, starts getting annoyed at the expense. And at that point, we officially designate the effort as an incubation.”

NEJM AI Grand Rounds · 0:12:04

In 2016, Microsoft chief technology officer Harry Shum told Peter Lee he would be reassigned to work on healthcare.

“in 2016, I received a note from my boss, who at that time was Harry Shum, our chief technology officer at the time, saying that I was going to be reassigned to work in healthcare.”

NEJM AI Grand Rounds · 0:13:18

Peter Lee says he agreed to lead Microsoft's healthcare work after being cornered by CEO Satya Nadella at a political fundraiser in 2016.

“Satya Nadella was there. And so he cornered me, and I just was not, I didn't have enough spine to stand up to him.”

NEJM AI Grand Rounds · 0:14:32

Peter Lee says Microsoft partnered with Google, Amazon, IBM, Salesforce and others to advance healthcare technology.

“we actually even partnered with Google, with Amazon, with IBM, with Salesforce and others, in order to try to move the technology forward”

NEJM AI Grand Rounds · 0:17:52

Microsoft Research recently established an AI for Science laboratory under Chris Bishop.

“we've just recently established a new laboratory under the leadership of Chris Bishop called AI for Science, Microsoft Research AI for Science.”

NEJM AI Grand Rounds · 0:27:32

Microsoft Research's AI for Science lab aims to develop machine learning foundations that could accelerate molecular dynamics simulation by about ten million times.

“to develop the machine learning foundations to, say, achieve 10 million fold acceleration in molecular dynamics simulation.”

NEJM AI Grand Rounds · 0:27:32

Peter Lee says the OpenAI and Microsoft relationship began with Microsoft providing computing infrastructure for OpenAI.

“started several years ago a relationship that I think at the beginning was really focused just on Microsoft providing compute infrastructure for OpenAI”

NEJM AI Grand Rounds · 0:29:36

Peter Lee says Microsoft offers OpenAI's GPT models through its cloud with assurance that they meet compliance requirements such as HIPAA for medical use.

“we can assure our corporate customers that it meets compliance requirements like HIPAA for use in medical settings.”

NEJM AI Grand Rounds · 0:32:07

Peter Lee says ChatGPT using the GPT-3.5 model was reported to score 61% on the US Medical Licensing Exam.

“People have tested the CHAT-GPT with the 3.5 model on the U.S. Medical Licensing Exam and found, I think the report was they achieved a 61 % score”

NEJM AI Grand Rounds · 0:38:46

Microsoft Research's Sebastian Bubeck and colleagues wrote a paper training a neural network to solve systems of linear equations, which Peter Lee uses to illustrate emergent abilities.

“A colleague of mine at Microsoft Research, Sebastian Bubeck, and his colleagues of a paper where they train a neural net to solve systems of linear equations.”

NEJM AI Grand Rounds · 0:42:39

Peter Lee says GPT-4 was trained only on text yet can generate drawing code for a picture of a unicorn.

“GPT-4 has been trained only on text. And so you can have a conversation where you ask it, do you know what a unicorn is?”

NEJM AI Grand Rounds · 0:46:24

Peter Lee says Microsoft's medical experiments use one GPT-4 to propose a differential diagnosis and a second GPT-4 to check it for errors.

“And so a trick that we've been using now in medical scenarios is to have one GPT-4, let's say proposed differential diagnosis, and then have a second GPT-4 read over the first GPT-4's differential diagnosis and check it for errors”

NEJM AI Grand Rounds · 0:49:29

Peter Lee describes a doctor who used GPT-4 to prepare for a hard conversation with a pancreatic cancer patient, after which GPT-4 asked how the doctor was holding up.

“after he said thank you to GPT-4, GPT-4 said, and what about you? How are you holding up? Are you getting all the help that you need?”

NEJM AI Grand Rounds · 0:53:23

Peter Lee served on the founding board of directors of the Kaiser Permanente School of Medicine.

“One of the privileges I've had is being on the founding board of directors for the Kaiser Permanente School of Medicine.”

NEJM AI Grand Rounds · 1:06:21

Peter Lee says Zak Kohane leads a new department at Harvard Medical School devoted to teaching data and machine learning in medicine.

“Zach Kohani, who created it and is the head of a whole new department at Harvard Medical School, which is devoted to that”

NEJM AI Grand Rounds · 1:07:35

Peter Lee says the scale hypothesis, that bigger models trained on more data keep getting more capable, has so far held up with no sign of slowing.

“So far, the scale hypothesis has been holding up. And so far, it shows no signs of letting up.”

NEJM AI Grand Rounds · 1:02:28

Peter Lee, Kerry Goldberg and Zak Kohani published the book The AI Revolution in Medicine shortly after OpenAI released GPT-4.

“Shortly after OpenAI's GPT-4 was publicly released, Kerry Goldberg, Dr. Zak Kohani, and I published The AI Revolution in Medicine”

Microsoft Research Podcast · 0:00:03

The opening passage Peter Lee read comes from Chapter 7 of The AI Revolution in Medicine, titled The Ultimate Paperwork Shredder.

“The book passage I write at the top is from Chapter 7, The Ultimate Paperwork Shredder.”

Microsoft Research Podcast · 0:00:55

Umair Shah was Washington State's Secretary of Health from 2020 to 2025 and led a pandemic response described as one of America's top-rated.

“He led one of America's top-rated pandemic responses as Washington State's Secretary of Health, a position he hailed from 2020 to 2025.”

Microsoft Research Podcast · 0:02:12

Gianrico Farrugia is president and CEO of Mayo Clinic, described as the world's top-ranked hospital for seven consecutive years.

“the president and CEO of Mayo Clinic, the world's top-ranked hospital for seven consecutive years and a pioneer in technology-forward platform-based healthcare.”

Microsoft Research Podcast · 0:02:49

Peter Lee, Carey Goldberg and Zak Kohane published the book The AI Revolution in Medicine shortly after OpenAI released GPT-4.

“Shortly after OpenAI's GPT-4 was publicly released, Kerry Goldberg, Dr. Zak Kohani, and I published The AI Revolution in Medicine”

Microsoft Research Podcast · 0:00:38

OpenAI's ChatGPT launched in November 2022 and GPT-4 followed in the spring of 2023, according to Peter Lee.

“So, November 2022, CHAT GPT. Later in the spring of 2023, GPT-4.”

Microsoft Research Podcast · 0:08:12

Peter Lee says Laura Adams led the Rhode Island Quality Institute, which he regards as an important early example of using health data to improve health statewide.

“Also, our listeners might want to know that you led something called the Rhode Island Quality Institute, which was really, I think, arguably the most important early kind of examples”

Microsoft Research Podcast · 0:16:59

Peter Lee says Geoffrey Hinton predicted that by around 2018 human radiologists would no longer be needed because of AI, which did not come to pass.

“Jeff Hinton, Turing winner and one of the grandfathers of the AI revolution, famously had predicted many years ago that by 2018 or something like that, we wouldn't need human radiologists because of AI.”

Microsoft Research Podcast · 1:24:48