# The Economics of AI: A Conversation with Larry Summers

- **Show:** NEJM AI Grand Rounds
- **Published:** 18 Dec 2024
- **Source:** https://ai-podcast.nejm.org/e/the-economics-of-ai-a-conversation-with-larry-summers/
- **Transcript:** https://podcasts.opennash.com/shows/nejm-ai-grand-rounds/the-economics-of-ai-a-conversation-with-larry-summers-ba138d/
- **Provider:** OpenNash Podcasts (machine-generated)

## In brief

Larry Summers argues that artificial intelligence may be the most important technology ever invented. He gives even odds that historians will treat human-like intelligence in machines as the defining story of the century, ahead of wars and political leaders. He compares it to the leap from calculator to computer, and says its ability to improve itself sets it apart from earlier technologies such as electricity.

The tension running through the conversation is between huge potential and deep uncertainty. Summers says he knows he doesn't know, and warns that technologies arrive later than expected and then move faster than expected. He pushes back on 'radical abundance' and on universal basic income, stresses lasting scarcity, and defends economics as a way of reasoning rather than a tool for forecasting. He also describes the OpenAI board review, which found no safety issue behind Sam Altman's removal.

## Key insights

1. **Summers calls AI possibly history's most important technology** He puts even odds on historians treating human-like machine intelligence as the main story of this century. In the nearer term he compares it to the jump from calculator to computer.
2. **AI's self-improvement separates it from electricity** Summers says electricity did not generate more electricity, but AI is likely within a year or two to take over much of the work of the people building AI software. That feedback loop is what he calls a qualitative change from earlier general-purpose technologies.
3. **Technology impacts arrive late, then arrive fast** He cites meeting Jeff Bezos in 1998 and seeing that mall owners were at risk, a point that mattered financially only 15 to 20 years later. He also notes that self-driving trucks have not yet cost drivers their jobs, though he expects wide effects eventually.
4. **Abundance will not end scarcity or striving** Beachfront property, copper and exclusive goods such as top schools stay scarce, and people value things in relative terms. He also doubts that obesity is caused by calorie abundance, and says that doubt makes him wary of universal basic income.
5. **OpenAI's review found Altman's ouster was not about safety** Summers says a major law firm spent millions of dollars and reviewed tens of thousands of documents. He says the review found the dispute turned on personality conflicts with the prior board, not on product safety or safeguards.

## Questions this episode answers

### Why does Larry Summers think AI could be more important than other technologies?

He says AI can improve itself, since it will soon take over much of the work of the people who build AI software. Electricity, by contrast, did not produce more electricity. He gives even odds that historians will see it as the defining story of the century.

### Does Summers think AI will make everything abundant and free?

No. He says some goods stay scarce, such as beachfront property, copper and places at elite schools, and that people value things partly by comparison with others. He also worries about what people will find meaningful if work disappears.

### Was Sam Altman fired from OpenAI because of AI safety concerns?

According to Summers, no. He says a legal review of the November 2023 events found that the request for Altman's resignation did not involve the safety or safeguards of OpenAI products. It came from personality conflicts with the prior board.

### Can economics predict where AI is headed?

Summers rejects the idea that economics should be judged on prediction. He points to the efficient market hypothesis, which holds that future prices can't be predicted because known information is already priced in. He says core ideas such as opportunity cost, incentives and scarcity will stay as important as ever.

### When will AI replace doctors, according to the conversation?

Summers doesn't give a date, but says AI will likely do diagnostic reasoning, like the TV character Dr. House, before it can hold a patient's hand before surgery. He expects questions about whose values the models should embody to matter less in medicine for some time.

## Facts

- **Arjun Manrai** [0:01:18]: "he's been a member of the board of directors of OpenAI for just over a year."
- **Larry Summers** [0:03:43]: "I'm the child of economists. My parents were economics professors. I have uncles who were prominent economists."
- **Larry Summers** [0:08:08]: "I first met Jeff Bezos when he came to a CEO lunch at the Treasury in 1998."
- **Larry Summers** [0:08:08]: "And I remember then Secretary Rubin and I saying to each other that the owners of malls had better watch out."
- **Larry Summers** [0:08:08]: "But that wouldn't have been a financially important legitimate insight for another 15 or 20 years after we had it."
- **Larry Summers** [0:08:08]: "I remember hearing now a decade ago about these automated vehicles that had driven up Route 101 from San Jose to San Francisco with no driver."
- **Larry Summers** [0:10:30]: "Electricity was great, but electricity didn't self-generate more electricity."
- **Larry Summers** [0:00:00]: "I think that it's an even-money chance that when historians write about the second-fifth of the 21st century, Russia and Ukraine and Donald Trump and Xi Jinping will be secondary stories"
- **Larry Summers** [0:13:40]: "diminishing returns is likely to come somewhat faster from scaling, but that modifications of the technology to make possible longer change of reasoning and more human-like reasoning processes"
- **Larry Summers** [0:14:59]: "The first cameras, moving picture cameras, were put at the back of theaters to record plays."
- **Larry Summers** [0:15:47]: "It was originally envisioned that there'd be a market for only five mainframe computers."
- **Larry Summers** [0:19:12]: "I think if you look at the upper 75 % of the American population, there was no substantial difficulty in affording an adequate caloric intake 50 years ago, and yet levels of obesity have risen."
- **Larry Summers** [0:23:43]: "I was approached by the people who were involved in forming new arrangements to ask whether I would take on a position on the board."
- **Larry Summers** [0:25:38]: "Millions of dollars were spent. Tens of thousands of documents were reviewed. Witnesses were questioned for many hours by a major law firm that had substantial experience with this kind of thing."
- **Larry Summers** [0:25:38]: "There were complicated issues of personality between him and members of the prior board that led to that decision."
- **Larry Summers** [0:27:58]: "It is not literally accurate, but it conveys the nature of that meeting."
- **Larry Summers** [0:29:01]: "I should say I also have a bias. Kenneth was my uncle."
- **Larry Summers** [0:29:56]: "President of Harvard University, it's got a lot more politics in it than working at the treasury in Washington, given the extreme decentralization of Harvard and of universities in general."
- **Larry Summers** [0:30:20]: "Probably John Maynard Keynes, because he embodied the practical, intellectual, economics-oriented life that I have tried to lead."
- **Larry Summers** [0:30:54]: "I was a tutor in Lowell House, so I'm going to stick with Lowell House."
- **Andrew Beam** [0:31:08]: "It's written by this 21-year-old named Leopold Auschenbrenner. But it's an economic analysis of the next five years of AI."
- **Larry Summers** [0:32:01]: "the efficient market hypothesis, essentially has as its central idea that you can't predict the evolution of a future speculative price, because if you could predict it, it already would have moved."
- **Larry Summers** [0:32:41]: "AI and digital technology more generally promote economies of scale. They promote what economists call non-convexities."
- **Arjun Manrai** [0:34:37]: "But then there's this kind of lighter compute, but very important phase where humans are brought in to label examples of good or helpful outputs and then to rank outputs."

## Transcript

**[0:00:00] Larry Summers:** I think it's possible that this is going to be the most important technology that ever got invented. I think that it's an even-money chance that when historians write about the second-fifth of the 21st century, Russia and Ukraine and Donald Trump and Xi Jinping will be secondary stories and that the real story will be the dramatic discontinuity that was associated with human-like intelligence being achieved by non-humans. I think that in a mirror-term thing, it may not be unreasonable to think that this is to the internet as the computer was to the calculator.

**[0:01:06] Larry Summers:** The calculator was a very important thing. The computer was a much, much more fundamental thing.

**[0:01:18] Arjun Manrai:** Welcome to NEJM AI Grand Rounds. I'm Raj Manrai, and I'm here with my co-host, Andy Beam. Today, we are delighted to bring you our conversation with Larry Summers. Andy, I think it's fair to say that Larry Summers truly does not need an introduction. He's been so influential. He's been the Secretary of the Treasury of the United States, the President of Harvard University, Director of the National Economic Council, and so many other things. And as we dig into the episode itself, he's been a member of the board of directors of OpenAI for just over a year.

**[0:01:49] Arjun Manrai:** I've listened to him a lot, but I think this conversation still surprised me. Maybe it was his enthusiasm or his predictions for what would be remembered by historians of this period of the 21st century, the way he described how these models are continuing to evolve, and also our uncertainty about where we're going really was quite powerful.

**[0:02:11] Andrew Beam:** Yeah, I'm going to break the fourth wall a little bit here, Raj. And how cool is it that we got to talk to Larry Summers about AI? Like, how amazing was that? Again, I agree with you. I'm a big fan of his. I've listened to all the podcasts he's been on. And still, there were several things that I learned in this conversation. We got a little glimpse into what happened with some of the open AI drama, with the board turnover and with the leadership turnover.

**[0:02:33] Andrew Beam:** And so that was news to me. I think you did a great job at asking him about his appearance in the movie The Social Network. And so that was like super great to hear. So much fun. So much fun. So many gems like that in this conversation that I'm excited for the listeners to hear. And again, just like what a treat to get to talk to Larry Summers about such a wide range of topics. Really, really, really fun conversation.

**[0:02:54] Arjun Manrai:** Totally agreed.

**[0:02:58] Andrew Beam:** The NEJM AI Grand Rounds podcast is brought to you by Microsoft, Viz.ai, Lyric, and Elevent's Health. We thank them for their support. And with that, we bring you our conversation with Larry Summers on AI Grand Rounds. Larry Summers, thank you for joining us on AI Grand Rounds today. We're super excited to talk to you.

**[0:03:22] Arjun Manrai:** Good to be with you. Larry, welcome and thank you for being here. This is a podcast about AI, so please forgive our nerdy question framing, but we always start with the same question. Could you please tell us about the training procedure for Larry Summers Neural Network? What data and experiences led you to where you are today? And please take us back as early as you can. We say that we like

**[0:03:43] Larry Summers:** to start with the initial conditions. I'm the child of economists. My parents were economics professors. I have uncles who were prominent economists. So I found myself writing on a graduate school essay that while some children were taught to believe in God, I came to believe in the power of systems analysis. So I'm a person who's always believed very much in data, empirical analysis, logic, argument as the way to get closer to truth and to believing that you're likely to do much better in contexts where you have more understanding than where you have less.

**[0:04:37] Larry Summers:** And that's why I've devoted myself to a career as an economist and tried to focus on studying economics for its own sake, but very much also as a tool for leading to human betterment in spheres ranging from the better allocation of resources in health care to the avoidance of financial catastrophes that lead to millions of people becoming unemployed. And so my training has been from a kind of analytical social science perspective.

**[0:05:27] Andrew Beam:** So trading the invisible hand of God for the invisible hand of Adam Smith. Is that fair?

**[0:05:32] Larry Summers:** That would be a way of putting it. You know, I've always, as a sort of ideological matter, always thought of the task as being to find a well-handled middle ground where you recognize that the invisible hand can't do everything, but that there are enormous dangers to heavy hands. and to try to think of ways in which governments and policymakers can provide helping hands.

**[0:06:07] Arjun Manrai:** I think that's a great point to transition. So, you know, we want to dig into some of your work and your recent roles, particularly around artificial intelligence. And of course, we want to start with large language models and their oversight. So large language models like ChatGPT. We had Peter Lee from Microsoft on the podcast last year, and he gave us a preview of GPT-4 before it came out. And I can still remember to this day losing sleep after talking to him, thinking about what this means.

**[0:06:35] Arjun Manrai:** You know, we've seen the evolution of models at OpenAI, but also I think this very competitive ecosystem of other proprietary and open source models emerged since then. And we like to talk about the scale hypothesis. And what I mean by that is this idea that with increasing compute in data, we are going to keep seeing improvements to the fundamental capabilities of these models. So I think many of us agree that we're on some type of S-shaped curve, but where exactly on the sigmoid we are is debated.

**[0:07:06] Arjun Manrai:** And maybe I can ask you how you think about the continued growth of these models, whether you have some intuition about whether we will keep seeing major improvements to capabilities with increased scale as we've seen for the past few years. I think closely related to that are your perspectives on what the key bottlenecks are for continued exploration of larger and larger scale. Energy, data, compute, they all come up. But how do you think about these problems and the sort of fundamental increase in capabilities at scale

**[0:07:36] Larry Summers:** of these models? Well, look, let me first say that there are two groups of people. They're the people who know that they don't know and the people who don't know that they don't know. And I'm in the first group. I know that I don't know for sure. I think there's a general lesson that's helpful for us all to keep in mind with respect to technologies, that things take longer to happen than you think they will, and then they happen faster than you thought they could.

**[0:08:08] Larry Summers:** And there are all kinds of examples of that. I first met Jeff Bezos when he came to a CEO lunch at the Treasury in 1998. And I remember then Secretary Rubin and I saying to each other that the owners of malls had better watch out. And we were right. That was a legitimate insight. But that wouldn't have been a financially important legitimate insight for another 15 or 20 years after we had it. I remember hearing now a decade ago about these automated vehicles that had driven up Route 101 from San Jose to San Francisco with no driver.

**[0:08:56] Larry Summers:** And I would have been surprised at that point if you had told me that no truck drivers have lost their jobs by the beginning of 2025. On the other hand, I'm sure there will ultimately be pervasive impacts. It's been a long time since I read a paper newspaper. And that's another example of a change. But I remember not that many years ago, whenever I wrote an op-ed regarding it as an important part of negotiation, whether my op-ed was going to appear in the printed paper or only online.

**[0:09:37] Larry Summers:** So it's very hard to know what the exact timing is going to be. I would be very surprised if in the fullness of what these kinds of models are going to accomplish, we were past the fourth inning. And I say that because it's relatively early days in terms of the amount of time that there has been since there were really serious models going. I say that because the capacity of these models to self-improve is, I think, a qualitative difference from previous general purpose technologies.

**[0:10:30] Larry Summers:** Electricity was great, but electricity didn't self-generate more electricity. Fire didn't generate more controlled fire. But AI is already going to, within a year or two, be likely to take on the tasks that many of those doing the software for AI are now doing. And so that self-improving aspect represents a very big change.

**[0:11:04] Andrew Beam:** Could I just maybe dig into that a little bit? Because what you hear people talk about, especially in the Bay Area, is that this is not a technology, it's the technology. Sam Altman has said things like, this will capture the light cone of all future value. And so in what sense should we take that literally, but not seriously, seriously, not literally? Do we think that this kind of technology is qualitatively different or is yet another kind of technology that will increase productivity, enhance human well-being and things like that?

**[0:11:37] Larry Summers:** I think it's possible that this is going to be the most important technology that ever got invented. I think that it's an even-money chance that when historians write about the second-fifth of the 21st century, Russia and Ukraine and Donald Trump and Xi Jinping will be secondary stories. and that the real story will be the dramatic discontinuity that was associated with human-like intelligence being achieved by non-humans. I think that in a nearer term thing, it may not be unreasonable to think that this is to the internet as the computer was to the calculator.

**[0:12:42] Larry Summers:** The calculator was a very important thing. The computer was a much, much more fundamental thing. So it seems to me there are lots of prospects for thinking that this is going to be very, very important. There are, I think, legitimate questions about what the constraints are going to be, and we don't really know. I think it is clear that there are substantial gains to be had simply from scaling without any innovation in design and without anything more than mobilization of data that has not yet been mobilized.

**[0:13:40] Larry Summers:** relative to what people thought a year ago, I would say that a reasonable best guess, as I understand it, is that diminishing returns is likely to come somewhat faster from scaling, but that modifications of the technology to make possible longer change of reasoning and more human-like reasoning processes, I would say any positive surprise in that, I think, has been far larger than any negative surprise in the efficacy of scaling. And I think there has also been substantial progress and substantial surprise in what one might think of as compression or distillation of these models, in which it's possible to do more with less, building on a very large model than one might previously have supposed.

**[0:14:59] Larry Summers:** I think it's also important to understand that the history of profound technologies is that the initial focus is always on how they can perform previously defined tasks better than they've been performed before. But ultimately, the real impact comes from the definition of new tasks that advance progress. The first cameras, moving picture cameras, were put at the back of theaters to record plays. And then people realized there was much better things to do with moving picture cameras.

**[0:15:47] Larry Summers:** It was originally envisioned that there'd be a market for only five mainframe computers. Originally envisioned that there would be a market for less than a million phones that people carried around with them. And so I think that we surely have not exhausted what is going to be possible with software that is able to act as people's agents.

**[0:16:23] Andrew Beam:** Can I follow up on something there? I actually am surprised that in your estimation that essentially everything will be footnotes to AI. I think Raj and I tend to agree with that, but I wanted to follow up, like play that forward and get you to help us think about the consequences of that. So if we have human level intelligence, one immediate implication, and you can definitely correct me if this is wrong, is that the marginal cost of everything essentially goes to zero.

**[0:16:47] Andrew Beam:** And I've heard folks like Demis Asabas talking about the idea of radical abundance in the age of AI. That because we have these super intelligent machines who can do so many things, we will all kind of live in this utopia. But one thing that I go to is radical abundance in and of itself is not a purely good thing. We have radical abundance of calories, and that has been a public health disaster by some measure. So is there something about the radical abundance idea of AI outside of the safety concerns that we should be thinking about proactively that having a radical abundance of intelligence may actually have downsides that we aren't really appreciating yet?

**[0:17:20] Larry Summers:** Sure. Look, I think you can overdo this idea of radical abundance. There's still only so much beachfront property. There's still only so much copper in the ground. There's still only so much of a whole range of goods that have some inherent scarcity to them. Some substantial part of what people value is goods that derive some of their value from their exclusivity. Not everyone can go to what's regarded as the top school. Not everyone can eat at what is regarded as the coolest restaurant.

**[0:18:12] Larry Summers:** And so the human instinct to compare and the human instinct to want things whose value is determined importantly in relative ways, Both mean that this idea that we're all going to abound in ecstasy with every need met and nothing to strive for does not strike me as being a plausible rendering of a place that the world is likely to get. I'm not sure that the right, I don't think the right paradigm for thinking about obesity actually has anything much to do with the universal abundance of calories.

**[0:19:12] Larry Summers:** I think if you look at the upper 75 % of the American population, there was no substantial difficulty in affording an adequate caloric intake 50 years ago, and yet levels of obesity have risen. So I don't think the right way to think about that phenomenon has anything much to do with the abundance of calories. I think it has to do with changes in lifestyle. It has to do with marketing practices and the design of products that are in various ways addicting.

**[0:19:52] Larry Summers:** But I think linking and those raise all kinds of issues of consumer protection and paternalism and how society should be responding to all of that. But I think thinking of that as a problem of abundance is not actually a helpful way of thinking about obesity. So I tend to be a person who believes that there should be a strong presumption in favor of things that give people things that they want to have, unless there is a compelling kind of downside.

**[0:20:39] Larry Summers:** I think there is potentially, my guess is that it is a long way down the road, but I think there are important issues raised by questions of human satisfaction and what the role of work is in thinking about human well-being. And on the one hand, I very much think that we should probably be thinking about what it is people are going to do with all that time that is available. You know, I have never seen a systematic study of the experience of those who inherit great wealth and therefore don't need to work to support themselves and indeed can't influence their command over the ability to purchase things very much with any work that they're able to do.

**[0:21:50] Larry Summers:** And I'm not sure that those lives are on average more satisfying lives than those who are less apparently fortunate in their inheritance. So I think the question of purpose amidst abundance is a potentially large question. I have a bit more reservation about the UBI concepts that some in the AGI community are enthusiastic about for those kinds of reasons.

**[0:22:30] Arjun Manrai:** I think that's great. I want to switch gears just a little bit from the capabilities and the implications of the models to their oversight. So I want to zoom in on November 2023. This is just about a year ago. I think I got an alert on my phone that Sam Altman had been removed, the CEO of OpenAI. Of course, over the weekend, I was glued to my phone. We are using these models every day as researchers.

**[0:22:53] Arjun Manrai:** We're using them in clinical studies. There's pilots, there's big studies that are underway. And of course, patients and doctors are using these models every day, I think at a scale that is still vastly underappreciated. So many of us have come to rely on the technology and they've become central in our lives already. And so particularly in a sensitive domain like medicine and healthcare, this really got me thinking about what this temporary, we know that Sam Altman came back pretty soon to open AI and you were appointed to the board of directors, but this really got me thinking about the sort of stability of these corporations, of these companies, as we think about how we can apply these models in medicine

**[0:23:30] Arjun Manrai:** and as they're being used. And so you, as part of that period in November, 2023, you joined the board of OpenAI. And my question for you is, what made you say yes to that job?

**[0:23:43] Larry Summers:** Raj, in the wake of the corporate governance transition, I'll call it, at OpenAI, I was approached by the people who were involved in forming new arrangements to ask whether I would take on a position on the board. I think they came to me precisely because I was outside the situation and didn't have extensive prior loyalties in any particular direction and was thought to be someone who could grasp the various issues, both technological and social, and who had a certain amount of experience between academic life, the private sector and government.

**[0:24:32] Larry Summers:** with complex situations, I asked myself really two questions. Did I think that I could make a contribution in this way? And did I think it would be intellectually fulfilling? And And since I answered both those questions affirmatively, I decided to take on that responsibility. And I've been very glad that I did and feel proud of the little bit that I've been able to contribute to OpenAI over the last year. I should say to your listeners that the first thing that the new board did, or that the new members of the new board did, was review in a very extensive way the circumstances surrounding that transition.

**[0:25:38] Larry Summers:** Millions of dollars were spent. Tens of thousands of documents were reviewed. Witnesses were questioned for many hours by a major law firm that had substantial experience with this kind of thing. And I can tell you with an extremely high degree of confidence that none of the issues that were involved in the request for Sam Altman's resignation went to anything about the safety or the safeguards surrounding OpenAI products. There were complicated issues of personality between him and members of the prior board that led to that decision.

**[0:26:36] Larry Summers:** And there was a kind of collective judgment about how the institution could be best taken forward that led to the reversal of that decision. But you needn't worry or needn't have, with the benefit of hindsight, worried during that weekend about the legitimacy or the quality of the products that you were using in your medical work.

**[0:27:09] Arjun Manrai:** Got it. Thank you. So I think we want to transition now to the lightning round. We always do this on each of these episodes. Larry, the rules are simple. We're going to ask a series of kind of rapid fire questions. Some are very trivial. Some are less trivial. You can decide which ones are trivial, which ones are not. And our only guidance is that we try to have you respond in just one to two sentences, quick, rapid fire reactions.

**[0:27:45] Arjun Manrai:** Does that sound all right? Are you ready for this? Sounds good. All right. Okay. So the first question is, is the portrayal of your meeting with the Winklevoss twins and Andrew Sorkin's The Social Network at all accurate?

**[0:27:58] Larry Summers:** It is not literally accurate, but it conveys the nature of that meeting. And I would only say this. You learn certain things as a university president. One of them is that if an undergraduate is wearing a coat and tie on a Wednesday afternoon, there are two possibilities. One is that they have a job interview. The other is that they are an asshole. I don't think those guys had job interviews that Wednesday afternoon.

**[0:28:33] Arjun Manrai:** Fantastic. Okay, that might be the most memorable lightning round answer we've ever gotten. All right, I'm going to hand it over to Andy.

**[0:28:39] Andrew Beam:** So that was great. Great. Okay, so now we're going to do a riff on Tyler Cowen's overrated, underrated for you. Overrated or underrated? Arrows and possibility theorem. Underrated. Underrated. So it's interesting because I feel like most folks in my circle, if you don't know anything about economics, you know arrows and possibility theorem and you use it to shut down any attempt at consensus making. So in what way is it underrated?

**[0:29:01] Larry Summers:** I think it speaks to the difficulty in a, it speaks very, very powerfully to the difficulty of any kind of collective decision making, particularly in an increasingly complex and multidimensional world. and I think it is understood by a limited number of social scientists who understand it, but it is not as universally part of the canon of human knowledge as it should be. And I should say I also have a bias. Kenneth was my uncle.

**[0:29:41] Andrew Beam:** I didn't know if that was family allegiance, but I think that that was a very well-stated case for the underrated nature of Error's impossibility theorem.

**[0:29:48] Arjun Manrai:** All right, the next question. Which is a harder job, president of Harvard University or treasurer secretary of the United States?

**[0:29:56] Larry Summers:** President of Harvard University, it's got a lot more politics in it than working at the treasury in Washington, given the extreme decentralization of Harvard and of universities in general.

**[0:30:15] Andrew Beam:** All right. If you could have dinner with one person dead or alive, who would it be?

**[0:30:20] Larry Summers:** Probably John Maynard Keynes, because he embodied the practical, intellectual, economics-oriented life that I have tried to lead. And he could express himself so cogently, powerfully, and eloquently.

**[0:30:46] Arjun Manrai:** All right. This is our last lightning round question. Which is the best Harvard undergraduate house and why is it Leverett House?

**[0:30:54] Larry Summers:** I was a tutor in Lowell House, so I'm going to stick with Lowell House.

**[0:31:02] Arjun Manrai:** Excellent. Thank you, Larry. You have survived the lightning round. You've passed it with flying colors.

**[0:31:08] Andrew Beam:** So we want to ask just one or two questions that kind of zoom out a little bit to wrap up. So you're probably aware of this essay called Situational Awareness. Again, like Tyler Cowen and some other folks have really been big on this. It's written by this 21-year-old named Leopold Auschenbrenner. But it's an economic analysis of the next five years of AI. And in it, he makes the conclusions that power will be limiting, that essentially scale is going to keep working and take us to AGI.

**[0:31:37] Andrew Beam:** So I don't have a question about necessarily the article specifically, but more how useful are the tools of economics going to be for understanding the next decade? Are we, as ML researchers, we would say, are we in distribution or out of distribution? Can we make reliable predictions about what comes next? Or is your sense that the next 10 years is going to be beyond our predictive capacity from an economic perspective?

**[0:32:01] Larry Summers:** I don't think of the test of economic analysis as being the ability to make predictions. For example, one of the great ideas of economics, the efficient market hypothesis, essentially has as its central idea that you can't predict the evolution of a future speculative price, because if you could predict it, it already would have moved. And therefore, in a properly defined sense, speculative prices are random walks. So I'd reject the way in which you framed that question.

**[0:32:41] Larry Summers:** But God, I think the principles of scarce resources, thinking at the margin, recognizing the importance of opportunity cost, understanding that there's no such thing as a free lunch, that incentives shape behavior, I think those principles are going to be as important as they've ever been. And the contexts are likely to change in a variety of ways. AI and digital technology more generally promote economies of scale. They promote what economists call non-convexities. And that's going to make the nature of the mathematical analysis different and in some ways more difficult than it has been in the past.

**[0:33:35] Larry Summers:** It may make the pure invisible hand less effective in getting to the best possible outcomes. But there's nothing that I see that would suggest that economic analysis is not going to have impact. And I would rather expect that with more actors, more perspectives, some of more competition, some of the forces on which economics tends to focus are likely to become more important. While everybody likes to criticize economics, I am struck by how much the other social sciences increasingly emulate economics and emulate methodological approaches that economists take, I think, to their substantial benefit.

**[0:34:37] Arjun Manrai:** I think just one last question here that builds directly off of that. I think Andy brought up a few moments ago, arrows and possibility theorem. So maybe this is a good one to close on. So, you know, I think a lot about how these models are trained and there's this kind of heavy compute phase where they're doing, they're trained essentially to do next token prediction with massive corporate of data. But then there's this kind of lighter compute, but very important phase where humans are brought in to label examples of good or helpful outputs and then to rank outputs.

**[0:35:06] Arjun Manrai:** And so this sort of transmutes the question of what values are embedded in these models to whose values are embedded in these models. And I think a lot about what those human values are that are embedded in these models. And I think a lot of work has come out of the United States, but we're seeing increased activity outside of the U.S. as well in building some of these models. And so, again, thinking about what Arrow's impossibility theorem teaches us generally, we have a few different parties in medicine and health care, right?

**[0:35:32] Arjun Manrai:** We have the payer, we have the patient, we have physicians. and the question that I really think about a lot, and maybe you can give us some sort of parting words about this is what are lessons about studying values and preferences? Again, I think in economics, this is very, very old and has been done for many, many decades. And my guess is that we're gonna start borrowing some of those methods for evaluating, for thinking about how we influence what comes out of AI models.

**[0:35:59] Arjun Manrai:** But what are the lessons from thinking about values and preferences from economics, including, of course, Arrow's impossibility theorem, to help us think about what human values are embedded in these AI models?

**[0:36:11] Larry Summers:** It's a very deep question, and I'm not sure I could give you a good answer. My instinct, Raj, is that for a very large number of the questions that one's likely in medicine to be looking to AI models for, the values are issues are likely to be somewhat secondary. I've said of AI that House, as portrayed in the TV show, was an enormously powerful figure who was able to contribute a great deal. that in some sense, what he did is the kind of thing that an AI system will be able to do before an AI system is able to hold a patient's hand as they're fearfully going into surgery.

**[0:37:14] Larry Summers:** And the ability to make more accurate diagnoses more quickly and more accurately and more precisely suggests steps forward in the treatment of a patient is not something that I think is fundamentally more difficult around values. When there are judgments that are reached, then there are human choices that will have to be made. But I think that is likely to be something that remains in a human domain for quite some time to come. So I rather suspect that we're going to have some substantial time before we're going to have to face the issues that you are describing.

**[0:38:15] Arjun Manrai:** Amazing. I think that's a great note to end on. Larry Summers, thank you so much for being on AI Grand Rounds. Thank you so much. Thank you.

**[0:38:25] Andrew Beam:** This copyrighted podcast from the Massachusetts Medical Society may not be reproduced, distributed, or used for commercial purposes without prior written permission of the Massachusetts Medical Society. For information on reusing NEJM Group podcasts, please visit the permissions and licensing page at the NEJM website. you
