# From Petri Dishes to Pitch Decks: Cultivating Health Care’s AI Future with Vijay Pande

- **Show:** NEJM AI Grand Rounds
- **Published:** 21 Aug 2024
- **Source:** https://ai-podcast.nejm.org/e/from-petri-dishes-to-pitch-decks-cultivating-health-care-s-ai-future-with-vijay-pande/
- **Transcript:** https://podcasts.opennash.com/shows/nejm-ai-grand-rounds/from-petri-dishes-to-pitch-decks-cultivating-health-cares-ai-future-with-vijay-p-7c7ee8/
- **Provider:** OpenNash Podcasts (machine-generated)

## In brief

Vijay Pande, a former Stanford professor who now leads health care and life sciences investing at Andreessen Horowitz, argues that technology's real contribution to medicine is engineering. Drug discovery and care delivery can move from one-off artisanal work to steady, compounding improvement. He believes AI will make this possible and will eventually give everyone access to top-tier specialist care. The firm backs startups on that thesis.

The central tension is between big promises and hard limits. Pande is bullish on AI nurses, preventive care and cheaper, fairer health care. He is also skeptical that today's language models will reach superhuman intelligence by 2029, because they learn existing knowledge rather than discover new things. He sees academia as the home for decade-long or exploratory work, and startups as the faster route to implementation.

## Key insights

1. **Engineering mindset, not AI alone, drives the thesis** Pande says A16Z's bio fund bets on turning discovery into engineering that improves about 20% a year, which compounds like Moore's law. AI is one example of this, not the whole idea.
2. **Biotech platform companies tend to collapse into one drug** Pande says that once a platform yields a first valuable drug, there is strong temptation to pile all resources behind it. That is why true platform companies like Genentech, Amgen or Alnylam are hard to build.
3. **Prevention, not sick care, is where costs bend** Pande argues that treating the sick is inelastic, because people will pay anything to save a loved one. Costs fall only by keeping people from getting sick, for example through diagnostics and avoiding hospital readmissions.
4. **Academia suits long timescales; startups suit implementation** Pande says work needing a decade or two, or open-ended exploration like CRISPR, fits academia. For AI in drug design and health care, raising a $5 million pre-seed round is now easier than winning a grant of similar size.
5. **Pande doubts language models will reach AGI soon** He says progress in AI has come as a series of S-curves that plateau, so the 2029 forecast assumes an exponential that may really be a sigmoid. LLMs, he says, are like a strong undergraduate who has read the books but cannot yet discover new things.

## Questions this episode answers

### What does Vijay Pande mean by bringing 'engineering' to biotech and health care?

He means moving from one-off, artisanal discovery to designed systems that improve a steady amount, about 20% a year. Compounded over decades, that is how Moore's law and falling genome-sequencing costs worked.

### What is Hippocratic AI and why does Pande like it?

Hippocratic AI makes AI nurses that talk with patients, for tasks like preparation for procedures. Pande likes that it avoids diagnosing or prescribing and targets the nursing staffing shortage, where AI can help now.

### Will AI make health care cheaper, according to Pande?

He says care for the already sick is inelastic, meaning people will pay almost anything, so technology alone won't lower that spending. The big savings would come from prevention and from avoiding hospital admissions and readmissions.

### Should a talented researcher stay in academia or join a startup?

Pande says to ask how long your impact will take. Decade-long or exploratory work fits academia, while ideas that can be built into products now are easier to fund in a startup.

### Does Pande think AGI will arrive by 2029?

He doubts it. He says current language models predict the next word and learn existing knowledge, and AI progress often plateaus in S-curves, so the forecast may be too fast. He expects AGI eventually but not necessarily that soon.

## Facts

- **Vijay Pande** [0:01:01]: "So I came in 2015 and I launched our first life sciences and healthcare fund, first bio fund."
- **Vijay Pande** [0:05:41]: "Yes, I started in 99 and I started at A16Z in 2015, so 15, 16 years."
- **Vijay Pande** [0:05:41]: "And I was primarily in chemistry, but had appointments in computer science, structural biology, and I was chair of biophysics."
- **Vijay Pande** [0:01:01]: "And so we're now on their fourth fund and now it's about over 50 people on the team."
- **Andrew Beam** [0:30:20]: "I think one of the sort of like blue chip game developers now, they develop things like The Last of Us and Uncharted."
- **Vijay Pande** [0:24:29]: "And even Genesis spun out of my lab is a really beautiful example of that."
- **Vijay Pande** [0:12:01]: "And so InCitro is her vision for bringing AI to drug design."
- **Vijay Pande** [0:09:22]: "And when we talk about engineering, what we really like about engineering is the fact you can make it 20 % better year over year."
- **Andrew Beam** [0:10:12]: "we often talk about Eroom's Law, which is just Moore's Law spelled backwards. And it points to the fact that actually drug development is getting longer and more expensive."
- **Vijay Pande** [0:10:50]: "The funny thing is like the timescales for IPO for biotech is faster. The timescale to revenue is slower, but the revenue ramp can be really fast."
- **Vijay Pande** [0:15:36]: "The quote that's usually brought up is that even curing cancer would lead to three years of added lifespan."
- **Vijay Pande** [0:16:22]: "So what Hippocratic does is that it provides essentially AI nurses."
- **Vijay Pande** [0:20:49]: "healthcare as sick care, basically dealing with you once you're sick, that is inelastic from an economic point of view."
- **Vijay Pande** [0:22:40]: "Devoted Health, which has a Medicare Advantage plan and dual plan, but more broadly a healthcare company both as an insurance company and as a provider."
- **Vijay Pande** [0:25:41]: "I think for someone to raise $5 million in a pre-seed round is relatively straightforward, especially someone who's well-known at the caliber of a strong academic professor."
- **Vijay Pande** [0:29:39]: "And I was at Stanford during the UCSF Stanford merger and unmerger. I was chair of biophysics then, which is in the med school."
- **Vijay Pande** [0:31:36]: "So my advisor's advisor advisor was Lev Landau, the storied Russian theoretical physicist and so on."
- **Vijay Pande** [0:33:06]: "VJ Iyer, the famous jazz pianist and pianos, my instrument too, had the email VJ at Berkeley, physical Berkeley to do right before I did."
- **Vijay Pande** [0:41:53]: "And if you remember the early days of microprocessors, there were a few like the, uh, 4004 and the 808 and then 8080"
- **Andrew Beam** [0:43:07]: "So he's been making lots of rounds on the Twitterverse for writing this 183-page essay on what the next five to seven years are going to be like."
- **Andrew Beam** [0:43:33]: "So first, he says that we're going to have AGI by 2029. And by AGI, he essentially means superhuman intelligence."
- **Vijay Pande** [0:44:33]: "And I think the answer is a relatively large fraction considering the implications of this. And so back of the envelope calculations, 10%, 20%, 30%."
- **Vijay Pande** [0:47:33]: "And this 2029 number would be a very natural thing if the S curve were an exponential. But what if it were a sigmoid?"

## Transcript

**[0:00:02] Vijay Pande:** So many faculty are involved with startups and students from Stanford are involved in startups, some very famous ones. And so I wanted to be in that ecosystem and I was. I was involved with being on scientific boards, being board directors and companies came out of my lab and so on. And that was exciting and the part that I was gravitating the most to over time was venture capital. And so very much finding the fit was a key part of my mindset and it took some time for that, but that first meeting with Mark and Ben, I think their mindset of really thinking about the future, being very intellectual about that, you know, how to put it, I think they reminded

**[0:00:39] Vijay Pande:** me when I joined the firm in 2015, the way, you know, Stanford was in 1999, that the real desire to really put an impact in that landscape, but still building and still growing. And so it was something where tech was a key part of the mindset for driving A16Z and Mark and Ben, this was something I think that was a key part of, could see the value in tech and life sciences and tech and healthcare.

**[0:01:01] Vijay Pande:** So I came in 2015 and I launched our first life sciences and healthcare fund, first bio fund. And so we're now on their fourth fund and now it's about over 50 people on the team.

**[0:01:13] Arjun Manrai:** Welcome to another episode of NEJM AI Grand Rounds. I'm Raj Manrai and I'm here with my co-host Andy Beam. And today we are thrilled to bring you our conversation with Dr. Vijay Pande. Andy, this was really a lot of fun. You know, Vijay has this amazing journey from being a Stanford professor of chemistry, structural biology and computer science to now a general partner at Andreessen Horowitz, where he leads investments in health care and life sciences.

**[0:01:41] Arjun Manrai:** It was really fun to sort of pick his brain about that transition from academia to industry. and I have to say I thought he was really balanced and thoughtful in articulating why someone might want to stay in academia versus trying to impact healthcare from outside of academia. All in all, this was a lot of fun and really, really great to get a chance to talk to

**[0:02:02] Andrew Beam:** him. I really enjoyed this conversation. Vijay has these two sides of his personality. He's a general partner at Andreessen Horowitz. He's done amazing work leading their bio fund, so he opened up this entire new investment area for A16Z. It has done a lot of amazing work there. But it's still really easy for him to tap into this like scholarly academic side too. So he can give you very thoughtful, very grounded answers on scientific questions and how they think about investment in these really hard areas.

**[0:02:29] Andrew Beam:** Like investing in healthcare is a very hard thing to do. And he's able to articulate this very first principles, very well motivated investment thesis. So I really loved talking to him because you get to learn a lot. You sort of get some inside baseball knowledge about how these deals get made, but he's also able to pull it back and give you these very thoughtful answers to very hard questions. The NEJM AI Grand Rounds podcast is brought to you by Microsoft, Viz.ai, Lyric, and Elevent Health.

**[0:03:00] Andrew Beam:** We thank them for their support. And with that, we bring you our conversation with Vijay Pande. Vijay, thanks for joining us on AI Grand Rounds today. We're super excited to have you here.

**[0:03:11] Vijay Pande:** Absolutely. Happy to be here. Thank you.

**[0:03:13] Arjun Manrai:** Welcome, Vijay. So this is a question that we ask all of our guests to get started. Could you tell us about the training procedure for your own neural network, how you got interested in AI, and what data and experiences led you to where you are today?

**[0:03:25] Vijay Pande:** Yeah, so here I ended up going kind of far back in that I started programming at a pretty young age, like when I was 11, and I was just doing things that were fun. I ended up doing things a little more seriously. Later on when I was 15, I was in Noidog software, a computer game company with just me, Andy and Jason, the founders and so on. And so that was real. But between then I poked around a lot of things.

**[0:03:49] Vijay Pande:** And I don't know if you guys remember Shrewdlu, I forget how it's pronounced. The Terry Winograd AI thing where you could have the computer pick up this and that. And it was very old school AI. But that got my excitement and I coded some probably very simple-minded version know, that early on. And then later on in college, neural nets start to get very hot and neural computing was getting hot. So this is like 1990 or so.

**[0:04:10] Vijay Pande:** And so I was coding up neural nets and doing the math for heavy and normal nets. And the thing that most of us saw at that time, there was a lot of excitement, but neural nets couldn't really do that much because as we know, in hindsight, they were just single layer neural nets that they hit a limit. And so I think most of us put things down to do real things that seemed like a toy. And then things changed a little later.

**[0:04:31] Andrew Beam:** Yeah, I remember when I was in grad school, the saying was that neural nets were the second best way to do almost anything. And sort of the implication there was that they weren't the best way to do anything. So what was the serious thing that you picked up after you decided that neural nets were still in the toy phase?

**[0:04:46] Vijay Pande:** Yeah, so a lot of what I did from grad school, postdoc, and early days at Stanford were physical simulations. So, you know, go down to the physics of atoms to understand how molecules work and so on. The real benefit of physics is that you're hopefully not overfitting and you have real generalizability. The fantasy from the days of Newton is that you can watch an apple falling down from the tree and then you can predict planetary motion.

**[0:05:10] Vijay Pande:** Something that seems very far from overfitting, right? That you really understand the fundamentals. And I think the big concern with ML was always overfitting, especially in an age where we didn't have really much data. And so that was a natural thing to do. But I think probably 2012, 2013, 2014, things start to change. both in terms of data, but also many of us, and this was a key thing on my mind at that time, were pushing for more compute.

**[0:05:34] Vijay Pande:** And so that combination really changed things.

**[0:05:36] Andrew Beam:** And correct me if I'm wrong, you were faculty at Stanford for about 10 to 12 years in this lead

**[0:05:41] Vijay Pande:** up to the sort of deep learning renaissance that we're in now. Yes, I started in 99 and I started at A16Z in 2015, so 15, 16 years. And I was primarily in chemistry, but had appointments in computer science, structural biology, and I was chair of biophysics. So a lot of the work I did was at the intersection of those different fields.

**[0:05:58] Andrew Beam:** So I think we're going to circle back to this at some point, but could you tell us a little bit about the decision-making for leaving your prestigious, presumably cushy academic job to transfer into the exciting world of investment and venture capital?

**[0:06:13] Vijay Pande:** Yeah, so even from the beginning, very much the rationale for me to go to Stanford, one of the things I really got excited about Stanford was to be in the middle of the startup ecosystem. And for those of you that aren't familiar with just the geography of the area, Stanford and Sandhill Road, which is the home of venture capital in the area and to some extent the world, you could in principle walk. It was like a five minute drive between the two.

**[0:06:36] Vijay Pande:** And the ecosystems merge very much. And so many faculty are involved with startups and students from Stanford are involved in startups, some very famous ones. And so I wanted to be in that ecosystem. And I was involved with being on scientific boards, being board directors and companies came out of my lab and so on. And that was exciting. And being a part of that ecosystem, the part that I was gravitating the most to over time was venture capital.

**[0:07:01] Vijay Pande:** And it was something that I'd been thinking about. But, you know, venture capital firms are about as different as people are different. And so very much finding the fit was a key part of my mindset. And it took some time for that, but that had been on my mind ever since the beginning.

**[0:07:14] Andrew Beam:** And so what was it about A16Z specifically that made that sort of VJ market fit feel so good?

**[0:07:21] Vijay Pande:** Yeah, I think first meeting with Mark and Ben, I think their mindset of really thinking about the future, being very intellectual about that. How to put it, I think they reminded me when I joined the firm in 2015, the way Stanford was in 1999, that a real desire to really put an impact in that landscape, but still building and still growing. And so it was something where tech was a key part of the mindset for driving A16Z.

**[0:07:46] Vijay Pande:** And Mark and Ben, this was something I think that was a key part of, could see the value in tech and life sciences and tech and healthcare. And that combination was very, very exciting to me. And I think a lot of other venture capital firms, I think, took a more traditional mindset that tech and life sciences and tech and healthcare were not going to mix.

**[0:08:03] Andrew Beam:** And again, correct me if I'm wrong, but I think you came there to start their biotech fund that essentially you originated that sort of whole arm of A16Z.

**[0:08:11] Vijay Pande:** Yeah, yeah. So I came in 2015 and I launched our first life science and healthcare fund, first bio fund. And so we're now on their fourth fund and now it's about over 50 people on the team. And that was part of the other excitement was to actually really build something. And that's something I very much enjoy, but especially to build it in this new mindset that it would not be looking backwards the way traditional funds are built, but really looking forwards.

**[0:08:31] Andrew Beam:** Okay. So I think I'm going to take this in chronological order here. And can you just talk to us about what your biotech investment thesis is? So I think that A16Z does have this unique perspective, like how do you understand value in this area? How do you understand good companies? And I think also like, how do you identify good founders? Because I believe that's a huge component of investing in successful companies.

**[0:08:52] Vijay Pande:** Yeah. So this is something where I think there's, this was probably more unusual 10 years ago when I started the fund and it's fun to see that I think the rest of mainstream investing, I think has come a long way, but especially when we launched the first fund, the concept of technology having an impact on life sciences or healthcare was pretty radical and even debatably heretical. I remember people telling me that machine learning or AI would never have an impact in drug design and that, okay, we've seen this before and people have talked about this before.

**[0:09:22] Vijay Pande:** And that was a key hallmark, but I think I don't want to over-rotate on the AI side. I think the true nucleus of what tech brings is AI is an example of, but not the only example of, I think the true nucleus is a concept of engineering, that we're going from bespoke artisanal discovery to something that's designed, engineered. And when we talk about engineering, what we really like about engineering is the fact you can make it 20 % better year over year.

**[0:09:49] Vijay Pande:** And that sounds actually relatively modest, right? But if you compound that over decades, that's what Moore's law is. That's what the cost of genomics going down exponentially is. Once you can get something improving with that regularity, and that regularity comes from an engineering mindset, that now things change. And so the idea of bringing engineering to life sciences and engineering to healthcare, that was a really foundational aspect.

**[0:10:12] Andrew Beam:** I wonder though, if there's an important difference here that you had to grapple with, especially in the early days. I think this is appreciated now. So you mentioned like Moore's Law for the cost of sequencing, but in drug development, we often talk about Eroom's Law, which is just Moore's Law spelled backwards. And it points to the fact that actually drug development is getting longer and more expensive. And so you're often working on radically different time horizons, especially for return on investment when you're thinking about a biotech than you are for a traditional tech company.

**[0:10:38] Andrew Beam:** So it was like some type of expectation adjustment, something that you had to do in those early days. Again, now I think this is appreciated. There are some similar theses that you could identify between tech and biotech, but the timescales are just so different.

**[0:10:50] Vijay Pande:** Yeah. The funny thing is like the timescales for IPO for biotech is faster. The timescale to revenue is slower, but the revenue ramp can be really fast. To put it in tech words, like the product market fit is perfect, right? If you have cancer and this is the only first in class, it's going to do well, right? And so it's just, it's a very different mindset. I think the key thing that we very much have tried to stay away from though is something that has a lot of single asset risk, something that's really hard to predict.

**[0:11:20] Vijay Pande:** And the benefit of a platform company is that if the first asset doesn't work and the platform is really productive, you can have many beyond that. In practice, I think one of the big challenges, even for modern platform companies, is that once you have that first asset, that's where most of the value is. And so there's a very strong temptation to pile behind that asset. And so building a true platform company, modern day Genentech or Amgen or even more recently Alnylam or something like that, those are hard to do.

**[0:11:48] Vijay Pande:** They're truly hard to do because of the temptation to pile into the asset.

**[0:11:51] Andrew Beam:** Yeah, there's always a tradeoff between exploration, exploitation and all of these things. I wonder if you could tell us about a couple of companies that you've been involved with that you think sort of embody a successful platform approach.

**[0:12:01] Vijay Pande:** A natural one, and this is a fun one investment, an investment I'm on the board of, is a company called InCitro. We've had Daphne on the podcast. There you go. So Daphne is a true OG in AI. And so InCitro is her vision for bringing AI to drug design. I think she's primarily especially tackling the challenge of using AI to unravel biology and especially human biology. The fact that drugs work so well in mice and so poorly in humans is obviously the fact that we can run experiments on mice.

**[0:12:31] Vijay Pande:** We have lots of data on mice, and it would be naturally unethical to do the analogous experiments on people. So how can you do that? And it's a perfect role for AI to gather all that data and to build models that are predictive. They're not perfectly predictive, but they're way more predictive of human beings than a mouse would be, is the bar. And so for better or worse, the bar is actually not crazy high. Right. And she very much wants to build a true platform company where there's not going to be a single asset, multiple assets.

**[0:12:57] Vijay Pande:** And what's intriguing about what she's built is that the ability to understand biology has implications for the whole drug design process for not just finding targets, but you can imagine what you could do with that for trials and beyond.

**[0:13:08] Andrew Beam:** Got it. Got it. So I'd like to now. So we've gotten you through biotech investor. Now health tech investor, I think, is your most recent arm. are. And I think something that even though I'm deeply involved with this, I have less clarity on than on biotech. As you pointed out, the markets are exceptionally clear and well-defined. It's very easy to understand value pools and biotech. In healthcare, it's not even always clear who the consumer is.

**[0:13:39] Andrew Beam:** You know, you've been on record as saying that the biggest company in the world in the future will be a healthcare company. Could you walk us through sort of the investment thesis for healthcare companies, especially as they interface or interact with AI platforms?

**[0:13:52] Vijay Pande:** Yeah. So the healthcare part of the fund is a key part of it. And I think one of the unique aspects of the fund as first constructed is that we would do both. That typically life sciences and healthcare investors and tech investors, those are typically three different firms, if not three different funds. And I think one of the rationales for especially including healthcare is that I was expecting then, and I think we're very much seeing now a blending of these areas, that modern drug design companies, biotechs, have to really think about care delivery in their choice of therapeutic areas and so on.

**[0:14:23] Vijay Pande:** And then if you're a care delivery company, the things that are coming down the pipe in terms of new pharmaceuticals radically change things. I mean, GLP-1s are just one of many examples. So in terms of healthcare linked to a huge company, I think the opportunity here is that we've yet to see a healthcare company that is built the way a consumer tech company is built. And if you think about it, the impact of these companies could be way bigger than any fan company, way bigger than Facebook.

**[0:14:49] Vijay Pande:** In terms of what you care about, it's hard to put something more important than your health or your parents' health or your spouse's health or your children's health and so on. The challenge is, I think, that's what you've alluded to is that the current healthcare system is complex and actually who pays for what and how things work is fairly complicated. Healthcare companies with a consumer mindset, and that could be a couple different things. It could be in principle who pays.

**[0:15:11] Vijay Pande:** And that's one thing we could talk about. But I think the key thing about a consumer mindset is from a tech perspective is changing consumer behavior. And one thing that tech companies are particularly good at and tech is particularly good at is changing behavior. And for better or worse, you think about all the things that I do, my colleagues do, the world does to try to impact life sciences. In the end, there's many things on care delivery that you could do that have as big or bigger impacts.

**[0:15:36] Vijay Pande:** The quote that's usually brought up is that even curing cancer would lead to three years of added lifespan. And cancer is something that we are very excited to have a huge impact in and is a horrible disease. But I think this really paints the fact that there's many other things that we should also be paying attention to. And that's, I think, part of the opportunity for health care is to think about how can we motivate people in consumer-oriented experiences that we have in tech to be able to actually really take control of their lives.

**[0:16:03] Vijay Pande:** And we've made several investments in this space as well. And it's still brought up to the early, but I think even the early days have been fairly exciting.

**[0:16:11] Arjun Manrai:** Could you talk about some of those investments in this space? I think Hippocratic AI is one that comes to mind and some of the others. So maybe you could tell us about that and how you see this space evolving.

**[0:16:22] Vijay Pande:** There's a couple different categories we could talk about. One is AI plus healthcare going, providing to the healthcare system. And Hippocratic is a great example of that. So what Hippocratic does is that it provides essentially AI nurses. And they've been very clever in terms of going after areas that could have still a big impact on the healthcare system, but for now avoid challenges such as diagnosing or prescribing drugs that a doctor would do. And also actually one of the big surprises is that I think we'll see in hindsight when we look back at COVID that as much of a mess and horrible COVID was, there were actually some interesting healthcare tailwinds that were created during COVID especially in terms of

**[0:17:01] Vijay Pande:** virtual-based care. And so anything that you do with a nurse on the phone or on a Zoom, in principle, you could do with AI. And right now, Hippocratic has AI nurses that one can talk with. They can be used for prep or other procedures. And if you think about one of the crises that we have right now is that there's a huge nursing staffing crisis. This is a very natural role for AI to play where it can do something that could have a huge impact.

**[0:17:26] Vijay Pande:** Maybe we'll get into clinical on time, but not maybe immediately, but still today drive a lot of value.

**[0:17:31] Arjun Manrai:** And I think about primary care as well too, right? Even situated as Andy and I are here in Boston, where we're attached to a major medical school and university and many hospitals, I think it's still hard to have time with your physician, right? Just to actually discuss your care, go through the shared decision-making, what is your personal values? What are your goals? And I think this is why there's a lot of excitement amongst a lot of us that AI might help actually bridge some of this gap and fill this gap in counseling and talking to patients and thinking about their care.

**[0:18:03] Arjun Manrai:** And ideally in a preventative and forward-looking manner as well. With Hippocratic, I think LLMs, obviously, now these are, you hear about them all the time. The concerns are hallucinations, confabulations, safety, bias, integration with the existing healthcare records and context and all that. We're very familiar with this sort of set of challenges. What do you think is the sort of primary thing that Hippocratic is solving? I mean, there's so many ways to kind of attack this problem, right?

**[0:18:31] Arjun Manrai:** And you don't want to do everything at once. But what is their bet on where they will stand ahead, where they will stand apart in the next few years? And what are they really trying to solve amongst these challenges around LLMs?

**[0:18:41] Vijay Pande:** Yeah, so the challenges you're talking about with LLMs are not unique to Hippocratic. They're true for anyone using LLMs. And the thing that's different about health... And they're true for humans. Many of them are true for humans as well. So that's a very interesting point. That's worth getting to. I'll get to that in a second. If you think about hallucinations, LLMs, if you're doing this for poetry, that's not a problem. That might even be seen as creative.

**[0:19:03] Vijay Pande:** If you're doing this for art and a cat has six fingers or I have six fingers or three fingers, that's just artistic license. It's not a big deal. If I have a surgery and I come back with three fingers, I'm going to be really, really pissed. That's going to be a problem. And so the healthcare, we have to get it right. And we don't have that room for creativity. And what we're seeing today broadly is the use of LLMs as user interface and as a means for answering questions.

**[0:19:28] Vijay Pande:** But on top of that, you'll have a mixture of experts of many types of models, some of which may be LLMs, some of which may be more traditional machine learning and so on. That would make sure that if the LLM is hallucinating, that's something that we can just be on top of. And in a sense, this may be a poetic analogy, but I think it's deeper than that. It's essentially a care team where you have one member that's good at one thing, another member that's checking on the results going out.

**[0:19:52] Vijay Pande:** And that team approach is something that can be done now with low latency, which is kind of amazing. And that you're getting this team of experts speaking to you when you're talking to an AI. And that part is really unique to today.

**[0:20:04] Andrew Beam:** Raj, I don't know if you have any more questions to that line. I wanted to ask like one more sort of big picture health care question before we go to the next section. So, again, the biggest company in the world of the future could be a health care company. However, we're currently spending about a quarter of GDP on healthcare costs in the U.S. And your friend and colleague, Mark Andreessen, has this blog post about how the cost of the TV has gone way down.

**[0:20:24] Andrew Beam:** The cost of healthcare has gone up faster, multiples of the price of inflation. So I guess a question that we often ask guests on this podcast is like, will technology make healthcare more affordable and better? Or is it just going to increase the spend? Is this like a new sort of spending mechanism on healthcare? How do you see that playing out? And if you see it driving down costs, how do you reconcile that with sort of Mark's take on this?

**[0:20:49] Vijay Pande:** Yeah, I think the fundamental resolution of this is that healthcare as sick care, basically dealing with you once you're sick, that is inelastic from an economic point of view. What would you pay to save your spouse? Everything, right? There's, I don't want another spouse. So I would give everything for that. And if that's the case, that something that's inelastic like that is going to be hard and you'll just pour whatever money you can into that. And technology will create more options, but doesn't change the fundamental elasticity of that.

**[0:21:14] Vijay Pande:** Where I think this gets interesting is something that is easier said than done, but where I think the future of healthcare really lies is not in sick care, but in keeping us from getting sick. And that's something that's very natural for tech. That's something that obviously will bend the cost curve on the sick care side and will change things. That's where I think tech has to go. And we're going to use tech to develop new therapeutics for rare diseases and cancer and so on.

**[0:21:40] Vijay Pande:** And that's going to be part of that sicker cycle. But I think where it gets really interesting and where the curve gets bent is where ideally you never go there. And so from a healthcare delivery point of view, that's getting on top of things. That's running diagnostics. Companies like Function is a great example of that. If you're a care delivery company, that's avoiding admissions or readmissions and using that as your North Star. Trying to avoid the sick care system as much as you can.

**[0:22:05] Vijay Pande:** That's the intellectual goal. how to get that done is the real challenge and something that I think it's easy to poke at. And I think there's a lot of work to do, but that's, I think, the real goal.

**[0:22:14] Andrew Beam:** Is there an opportunity from what you've seen just to deliver care more efficiently? So even if you look at GDP per capita spend on healthcare versus mortality, we're awful by that metric. So even outside of like healthcare versus sick care, can we just like be, deliver healthcare more efficiently? And you mentioned some tailwinds of COVID for telehealth and things like that. Is there just a way we can like, even if we're not keeping people out of the hospital, once they're in the hospital, not spending $500 on an aspirin or something like that?

**[0:22:40] Vijay Pande:** Yeah. So this is where I look to companies like Devoted. Devoted Health, which has a Medicare Advantage plan and dual plan, but more broadly a healthcare company both as an insurance company and as a provider. What they do is really handle all the logistics and thinking about the right care at the right place at the right time. If you think about maybe a non-medical analogy would be something like Amazon and the cost of things before Amazon.

**[0:23:04] Vijay Pande:** Amazon's an amazing logistics company. and is able to drive the cost down through a marketplace as well. So in that sense, there's no silver bullet algorithm that makes Amazon Amazon. It's about that mindset everywhere. And Devoted has that very much as well. I think their ability to bend the cost curve, I think, is a great example of that. And actually avoiding readmissions are on their mind and handling things ahead of time is something they're incented to do as being a payer and a provider.

**[0:23:30] Arjun Manrai:** Great. So Vijay, I want to transition us a little bit. And we want to spend a few minutes just digging into academia versus industry. So Andy mentioned this, you know, you were a tenured professor at Stanford. You've made it and you decided to leave that position to join A16Z. And I think you've clearly done very well there. But maybe you can take us into your mindset. I think this was back in 2015. Your mindset behind that decision.

**[0:23:56] Arjun Manrai:** And maybe I can even ask more provocatively, thinking about today, where should a smart person who's interested in impacting AI for biomedicine be academia or a startup and why?

**[0:24:09] Vijay Pande:** Yeah. So there's a question very dear to my heart. And I think there's a couple different aspects of this. So first off, I think just purely intellectually forgetting about any sort of macro arguments or anything like that. I think the first question is, what is the timescale for the impact that you want to do? So if what you want to do is going to require a decade or two decades, that's not something you do in a startup.

**[0:24:29] Vijay Pande:** That timescale is really only available in academia. And so when I started in 99, I wanted to really make computational drug design a reality. That was something that wasn't going to get done in three years. And it wasn't ready to roll out to design drugs. That's something that companies are doing today. And even Genesis spun out of my lab is a really beautiful example of that. That needs some time. And so that was the reason to be in academia.

**[0:24:51] Vijay Pande:** And the other reason to be in academia is, let's say you don't even know what you want to do, you want to explore. And I think there's very few places where you can just go and explore and you think about some of the most fortuitous discoveries like CRISPR or something like that. That's something that I think could probably only be found through a love of basic research and exploring and finding things and seeing what happens. And it's impossible to even put a timetable on those types of things.

**[0:25:17] Vijay Pande:** And then finally, it's your mindset, right? Some people, I think, have much more an academic mindset. The academic mindset is what do you get excited about doing? Do you prefer to read nature or the wall street journal? That type of thing. Uh, and actually the funny thing is like, we generate, we generate PDFs. Yes. We generate PDFs. Yeah. Yeah. There's also that it's like, what do you, what also, what do you hate less? Like, you know, yeah.

**[0:25:41] Vijay Pande:** Uh, proofreading papers and so on. I think you'll be gravitated to, you'll see yourself being gravitated to one or the other, but now macro wise, I think the one thing about academia today is that it's a lot more complicated than when I started in 1999. And I think for someone to raise $5 million in a pre-seed round is relatively straightforward, especially someone who's well-known at the caliber of a strong academic professor. And to get a $5 million grant has a lot more work and a lot more strings, a lot more complexity.

**[0:26:11] Vijay Pande:** And so if you're in the space that we're talking about, let's say machine learning, AI for drug design and healthcare, the opportunities from a macro perspective are really quite juicy right now, very exciting on the startup side. Now, obviously, you have to build a company. And so if you don't want to build a company, that's not the place for you. But if this is something that now can be taken from the world of ideas to the world of implementation, something where I think this is useful to like, actually, I can really positively impact patients' lives, that I think is the reason for the transition.

**[0:26:41] Vijay Pande:** And finally, one last point is that I don't know if this is the best way to characterize it, but I think it's not uncommon and for people to start in academia and then move over. And you learn a ton being a junior academic. The one challenge is like if you're there too long, sometimes you get comfortable with one type of approach to another. And I think if you're there for long enough, you may just be content enough and stay.

**[0:27:03] Vijay Pande:** So there's a balance there too.

**[0:27:05] Arjun Manrai:** I see the physicists and the kind of the chemists just come out there in a little Michaelis-Menten separation of timescales as a way to think about this. I was trying to guess what you would say as sort of the first axis, first dimension to think about this. And that wasn't what I was expecting, but it makes total sense. And your other point about exploration, kind of ambling, wandering through idea space without something very tangible, immediate in mind, but really trying to have the room both in time and in what you even ask, right?

**[0:27:37] Arjun Manrai:** Like what you even sort of evolved to ask over the next few years. I think academia is still very wonderful that way, even with the grants and with everything else and all the pressures that we face as junior faculty. That is very, it's honestly very encouraging as a junior faculty member to hear that and to hear a vote of confidence for certain ideas as being uniquely, in certain paths, being uniquely academic. I was wondering, as a follow-on, maybe I can get you to talk more about medicine versus biotech.

**[0:28:03] Arjun Manrai:** And so medicine is set largely by clinical practice guidelines, clinical societies, major clinical bodies that I think still largely exert influence via kind of academic channels or conventional academic channels. And I think this is probably, there are analogs for sure in biotechnology broadly, but I think biotech seems to me the first brush and probably oversimplifying here, moving more as driven by industry and driven by currents that are happening in outside of academia. And so if you are someone who's interested in influencing medicine via what is considered best clinical practice, Do you see that as something that is still uniquely academic?

**[0:28:45] Arjun Manrai:** Or is that even something that is changing and that you should contemplate industry a little bit more? I'm asking clearly for myself right now, but I think there are many people who are also in my bucket.

**[0:28:54] Vijay Pande:** No, it is a good question, an important one. And I think you make a useful distinction between life sciences and care delivery because there's not a life science biotech equivalent of academic medical centers. There is not like academic biotech centers where...

**[0:29:10] Arjun Manrai:** That's the much more eloquent, that's a much more eloquent way of what I was just trying to say.

**[0:29:14] Vijay Pande:** Well, yeah, I think we're very much in agreement there. And the role of academic medical centers is really critical, right? And that's where a lot of innovation still come from and so on. And that may change, but that's not, that's very much the way today. I think a lot would have to change for that to be there for the way providers work. So I think from that perspective, there is a huge opportunity on the healthcare side for driving innovation in AMCs.

**[0:29:39] Vijay Pande:** The real question is like, to what degree will the reality of running a medical system also complicate things? Because it's a rough time to be running a hospital right now. And I was at Stanford during the UCSF Stanford merger and unmerger. I was chair of biophysics then, which is in the med school. So I got to have the delight of watching that, you know, from the chair's perspective. You know, that's a huge business proposition to have to deal with.

**[0:30:06] Vijay Pande:** And that's different than like what a lot of academics want to be dealing with. And so the future of AMCs from a business perspective is also, I think, going to be important part of this. And how can we keep the best and keep it sustainable is the question I always have.

**[0:30:20] Andrew Beam:** Awesome. Thanks, Vijay. So I think we're going to run you through the lightning round next if you're up for it. Sounds good. Awesome. The first lightning round question requires a little bit of setup for our listeners. But you sort of mentioned in passing that you're one of the first employees at Naughty Dog. I think one of the sort of like blue chip game developers now, they develop things like The Last of Us and Uncharted. And I think what Naughty Dog does uniquely well that other game designers try to emulate is storytelling.

**[0:30:52] Andrew Beam:** So they have these amazingly cinematic games that have these well fleshed out characters. And so I guess my first lightning round question is, is there something in the DNA there that you learned about storytelling that has served you well as both a professor and venture capitalist?

**[0:31:06] Vijay Pande:** Yeah, I think so. I mean, in the early days, it was me, Andy, and Jason. And I think a lot of what you're describing came after, even after somewhat significantly after. But I think the storytelling that is perfected later is true of all video games and video games as a media, a medium for. And so I think that was very much on my mind. And I think though, part of it too, is that I think part of being a physicist is a physicist culture and being trained as a physicist is that there is storytelling there too, you know?

**[0:31:36] Vijay Pande:** And even one thing that doesn't happen as much in biology is like even family trees and academic family trees and the stories associated with your academic family trees. So my advisor's advisor advisor was Lev Landau, the storied Russian theoretical physicist and so on. And so like hearing about Landau's culture and all these things, it's a different type of storytelling and narrative to live up to. So I think there's many different traditions there. In terms of venture capital, the fun thing about venture capital storytelling is that it's both a bit about predicting the future and a bit about making the future.

**[0:32:11] Vijay Pande:** And that if we can lay out a future that's plausible, but who knows what the future is really going to bring, right? So a future that's plausible and we can rally brilliant people to come help us and help our founders and we can put billions of dollars behind it. That future could become a reality. And that part's particularly intriguing, especially in health care where the stakes are so high and the potential is so great for change.

**[0:32:36] Vijay Pande:** Thanks.

**[0:32:38] Arjun Manrai:** Vijay, if you weren't in science or engineering or science or engineering or investing, what job would you be doing?

**[0:32:44] Vijay Pande:** Yes, I've thought about this. And like, one of the delights about my family is that I have a lot of cousins. And, you know, so obviously my cousins have the same grandparents. And so like one of my cousins is a chef, I could totally imagine being a chef, that would be like fantastic. And I like cooking. Another one of my cousins is a psychologist and is quite famous in that. And so I could imagine doing that.

**[0:33:06] Vijay Pande:** And so I look at my cousins and imagine all the different lives that I could have had. And these are sort of things that I enjoy, but probably the deep, deep fantasy, which I've not made a ton of progress on, I've made a little bit of progress on would be something like some sort of musician, like a jazz musician or something like that. And so I have music as a key part of my life. It's too late to be a jazz musician, but actually briefly, when I was at Berkeley, VJ Iyer, the famous jazz pianist and pianos, my instrument too, had the email VJ at Berkeley, physical Berkeley to do right before I did.

**[0:33:39] Vijay Pande:** So I got all this VJ Iyer fan mail, which was obviously not intended for me, but was inspirational and was fun to get.

**[0:33:47] Andrew Beam:** Yeah, our sound engineer, Mike, who is a professional jazz musician, is nodding along in approval, I believe. Excellent, excellent.

**[0:33:54] Vijay Pande:** Absolutely, yeah. I'm a saxophonist, so, you know. Well, and so my daughter, my middle daughter is a saxophonist, and so we try to do stuff, yeah. How's she doing? She's doing well. I think she has a lot of things going. We have, Doug Ellington has a band here. He's the grandnephew of Duke Ellington. Wow. And we often have him at our house, and we'll step in and they are very kind to play around us and make us sound way better than we do.

**[0:34:18] Vijay Pande:** That sounds great. Yeah, yeah, absolutely.

**[0:34:21] Andrew Beam:** All right, so next question. Maybe I have some sense, but maybe I'm also way off base. So obviously, again, your colleague Mark Andreessen is a prolific generator of opinions on certain things. And so I'm wondering if there's something that, what's the thing that you most disagree with Mark about?

**[0:34:38] Vijay Pande:** That's a good question. What do I most disagree with Mark about? Part of the draw to the firm was actually, we actually agree about most things. And he and I are fairly similar in terms of also our pre-ASYCZ experience in that I was never a CEO of a company, but I've been a chair of companies and so is he. And so, and I like that role and he likes that role. That's a great question. There must be something.

**[0:35:04] Vijay Pande:** Maybe diet. Like there's, there's a bunch of things on the diet.

**[0:35:07] Andrew Beam:** He's given up, he's given up booze, I think if I remember correctly.

**[0:35:10] Vijay Pande:** Yeah. Okay, so if you asked me this question six months ago, it would totally be booze. But recently, and he was actually somewhat of a catalyst of this, because I was at his house and he showed me this hop water stuff, which was surprisingly not as bad as I was expecting. So my wife and I have greatly diminished alcohol, but I think the difference is that he's gone zero and I've gone like a little bit. And so the fun thing there, and so maybe that's where you disagree.

**[0:35:35] Vijay Pande:** And I know he likes scotch and so on, but now like the scotch is so much better when you have it much less frequently. And I was making that pitch to him. I don't think he'd want to hear about any more of that.

**[0:35:45] Andrew Beam:** So he's dry, but you're still a little damp, it sounds like. A little damp. A little bit. A little bit. Got it.

**[0:35:52] Arjun Manrai:** Amazing. Vijay, will AI and medicine be driven more by computer scientists or by clinicians?

**[0:35:58] Vijay Pande:** Yeah, so this is a great question. And you're going to feel like this is a cop-out answer, but this is really the right answer. The right answer is that there are clinicians that are going to be AI specialists. That's what it's going to have to be. And I think this probably for you too, this is not a shock, right? That it can't be somebody with just one mindset or the other. And actually the other thing it would be hard to be, it's not impossible.

**[0:36:17] Vijay Pande:** It's hard to have co-founders where one's the AI guy and one's the doctor. Even that's hard because they don't have telepathy. It's really different when it's all in one mind. And so one of the unique things about doctors today is that freshly minted MDs have been around computers their whole lives, which is different than people like 20 years ago or even 10 years ago. And so I think we're going to have that. And there's plenty of exemplars of this.

**[0:36:40] Vijay Pande:** The MedPOM team is a great example. There's plenty of exemplars of people who are brilliant in both domains. And I think that really has to be the future.

**[0:36:48] Arjun Manrai:** I totally agree. And this has been a big theme of the conversations we've had on the podcast, too, where we're asking people about their background, physicians who are having a lot of impact. And it really has been, I think, a common story that the latency is too high when the skills exist in two separate minds. And they just sort of get together and you don't really have anything to talk about, as opposed to rapidly eliminating all these ideas and then coming up with the right path.

**[0:37:11] Arjun Manrai:** And it's kind of eliminating those thousand ideas along the way to quickly get to where you need to go. So that's great.

**[0:37:18] Vijay Pande:** So maybe actually the question I'd ask you guys, if I may, how's that going to work? Is that going to be someone with an MD learning AI or is that a computer scientist learning medicine? Andy, do you want to go first or you want me to go?

**[0:37:30] Andrew Beam:** Yeah, I think it's not either or. So I think like I came into medicine through the side door, but I think, I think you have to have a deep appreciation of both. I think that it's very easy to be a computer science person and tell me like what AUC should my model be calculating? And that's going to be superficial and only get you so far. So I think that like, as long as you're willing to be a nerd about both, you're going to have a lot of success, but you can't have a superficial interest in either side of the equation.

**[0:38:01] Vijay Pande:** Yeah, I think that's right. And you can imagine someone who's like a CS pre-med undergrad. You know, it's easier said than done, but not impossible. And then they go to med school and they're like the master of two worlds.

**[0:38:11] Arjun Manrai:** Yeah. Or some MD PhDs who just take time to study both subjects. I have to, this is my obligatory, Andy's heard this like seven times, so he's going to, he can simulate me fully at this point. But I have to give my obligatory nod to this PhD program I went through here in Boston. So this is the HST program, the Harvard-MIT Health Science and Technology program. and basically the PhDs take the first, you know, a good chunk of the first two years of medical school and then spend a couple summers in the clinic where you're taking histories and physicals, rounding with the teams, presenting, really understanding how doctors think.

**[0:38:42] Arjun Manrai:** And then the MDs are very technical and they do an extra year or two of research. One of my friends in the program actually is at A16Z now, Vinita. I'm sure you know where I was, Vinita Agrawala. And so it's just a, it's a great program and it's like a, you know, the core thesis there is that we can't really have one skill set or the other, but you really have to invest in kind of education in both.

**[0:39:06] Arjun Manrai:** And so I think we need more of those printing programs of real domain expertise

**[0:39:10] Vijay Pande:** alongside the technical skills. I agree. And I think there's real potential for that. I think at Stanford, the MSDP group was a little bit like that, but HSD is really special.

**[0:39:20] Andrew Beam:** Awesome. All right. Thanks. So this is a question that now has almost become cliche because we ask it to everyone, but it's elicited such interesting responses that we're going to keep it going. So if you could have dinner with one person dead or alive, who would it be?

**[0:39:31] Vijay Pande:** Oh, geez. I should have like a stock answer for this. But I believe it or not, I've probably done like 100 podcasts. No one's asked me this yet. Nice. So yeah, no, no. But like, so I feel like I should do better with having an answer for it. Like, it's such a hard question. But like who the people who come to mind are the real old school people like Claude Shannon, John von Neumann, Alan Turing, that generation where I wish just for them, like I could tell them like, actually, all this cool stuff came from like the seeds that you planted, the ideas that you had that.

**[0:40:10] Vijay Pande:** And it would be so much fun to just sort of hear their view of what building the foundations was like and just to get their take on where we are now. And there are few people that were such the polymaths, like Von Noemans might be the canonical example. And I think I'd be probably if I had to pick one, maybe he would be the one that would be super interesting. That was a fun time. I mean, I think today is an amazing time, too, for sure.

**[0:40:33] Vijay Pande:** But like someone like that, I think would be would be just fun to see the direction. The discussion is going in both directions.

**[0:40:40] Andrew Beam:** Yeah. Yeah. I, it's your choice. I, I always worry about meeting someone like that in real life though, because whenever you humanize them, the legend gets instantiated as an actual person and you no longer have the legend in your head. So.

**[0:40:53] Vijay Pande:** Yeah. I've seen this where like, what was, it was a comedian or a sports figure. Oh, it was, it was when Willie Mays dies. I died. I was watching PTI and I've seen part of the interruption. Part of the interruption. Yeah. Yeah. Yeah. And they're talking about, Kornhais were talking about meeting Willie Mays and he's like, just for your sake, never meet your legends. It's not going to go the way you think. So it's kind of the way it is.

**[0:41:13] Vijay Pande:** But like in my mind, it could be amazing. And like probably with AI, we can make a fake version that would keep me quite happy. All right. This is our last lightning

**[0:41:20] Arjun Manrai:** round question. Given recent progress by Anthropic and Google, do you think OpenAI will

**[0:41:26] Vijay Pande:** have the most capable foundation model in one year? Yeah. So it's a good, good question. And a year timescale is well chosen because you asked me in one day, I think I would say no. If you asked me in one decade, I would say it'd be open AI for a day. A decade is much more open. A year, probably in a year, I think there's going to be, there's all this talk of cloud doing well. And so it's possible things have switched.

**[0:41:53] Vijay Pande:** I think the one big challenge is going to be is like, what is the right metaphor for AI? And I think my favorite metaphor for AI is probably the microprocessor in terms of business. And if you remember the early days of microprocessors, there were a few like the, uh, 4004 and the 808 and then 8080, and then there was a little bit of explosion with others and then, uh, basically Intel again, uh, and so on. And so I think short-term there's only a few people that have the technology midterm, a lot of people have the technology and then long, long-term, I wouldn't be surprised if maybe there's reasons that it would converge back again.

**[0:42:31] Vijay Pande:** I think we're going to see a bit of an explosion. And we already see that to some degree with all the open source stuff with Lama and Mistral and so on. I think the other thing is that we're probably going to get less hung up on one LLM to rule it all. And that there's going to be lots of different things, much like you don't just work with one person or talk to one person or so on.

**[0:42:50] Vijay Pande:** So I think we're going to have lots of different uses and that will be part of the explosion as well.

**[0:42:54] Arjun Manrai:** Back to your mixture of experts and agents all operating together. Yeah, exactly, exactly.

**[0:43:00] Andrew Beam:** Exactly. So well done, Vijay. You've passed the lightning round with flying colors.

**[0:43:04] Vijay Pande:** Thank you. It was so much fun. Thank you guys.

**[0:43:07] Andrew Beam:** So we want to just wrap up with some big picture questions. And I think the last lightning ground question was a natural segue. The purpose of this line of questions is to just get your sense of how the next five to seven years are going to go. But we're going to anchor it on this essay by Leopold Ashenbranner called Situational Awareness. I don't know if you've had a chance to read this, No. So he's been making lots of rounds on the Twitterverse for writing this 183-page essay on what the next five to seven years are going to be like.

**[0:43:33] Andrew Beam:** And what's helpful is he makes some specific claims. So I'd like to throw some of these specific claims at you and sort of get your reaction to them. So first, he says that we're going to have AGI by 2029. And by AGI, he essentially means superhuman intelligence. I think we already have AGI now. I think that by any reasonable definition, LLMs are a general kind of intelligence. they're not superhuman in lots of different categories. So he thinks 2029 essentially is the singularity, the event horizon.

**[0:44:00] Andrew Beam:** We're going to cross over it there and not ever going to be able to come back. Getting there, though, he says that the rate limiting factor is going to be energy, that the GPUs that we need to train these models are going to be so power hungry that we're going to need gigawatt power centers and that essentially we're going to have 1 trillion dollar data center that's a combination of these huge compute clusters along with a nuclear power plant that's hooked up to it to power it.

**[0:44:26] Andrew Beam:** So I guess maybe I'll just throw all that at you and sort of get your reaction to it and then we can like sort of pull on some individual threads.

**[0:44:33] Vijay Pande:** Yeah, yeah. So let's take the power thing first because I think that's easier. And I think you can think like what fraction of the world's energy should go to AI? And I think the answer is a relatively large fraction considering the implications of this. And so back of the envelope calculations, 10%, 20%, 30%. That's a lot of energy to add on top of things. And it actually has obviously real geopolitical implications because you just can't make energy just anywhere.

**[0:44:57] Vijay Pande:** And so places with large-scale energy production, whether that be oil or natural gas or solar or nuclear, become appealing with obviously nuclear becoming appealing because of low CO2 generation and so on. But also you want to do this someplace where there's cooling. And so places with oil maybe not be the coolest place is to have this. So I think all of that becomes logistical problems, infrastructure problems, but I'm excited about spending more energy for AI.

**[0:45:22] Vijay Pande:** I think that could be one of the best uses of energy that we could use as a society or as a, as a world. In terms of AGI, I think this is where it gets very complicated because well, first off, like even just intelligence, like, I don't know how deep you want to go, but you could talk about IQ. You could talk about G factors, but even G factors is very human centric. Like AI has intelligence that's just really different.

**[0:45:43] Vijay Pande:** in that even like LLM right now, I can ask it physics questions, which I know the answer to. I can ask it music questions. I can have it do things like, it can do things that probably no individual could do, but like a group of people could do. And to some extent, it's trained on a group of people. So it's reproducing a group of people. And so that's a kind of super intelligence. And then we've already seen with things like radiology, another type of super intelligence is where AI is better than any individual radiologist, it, but it's comparable to the group of experts and that's considered to be super intelligence.

**[0:46:16] Vijay Pande:** And then I think what we really are looking for is something where AI comes up with some new physics or some new medical breakthrough or something that is just as different as Einstein was, or as something that is that level of creativity. And even Einstein is such a hackneyed example, but it's just the obvious one because like his general relativity is something, or even special relativity is something that was such a major leap of thinking, albeit built on work of others as well.

**[0:46:43] Vijay Pande:** So that part, I don't know if we're going to see that or not. And I think what could easily happen is that LLMs are very much a next token predictor and next token prediction does really well at these current games. But is that the thing to really take us to the next level? I do think that learning is building latent spaces and this could be jazz. The reason why you do scales and jazz and all different types of scales is that's a latent space.

**[0:47:07] Vijay Pande:** I do martial arts. All the martial arts stuff is learning latent spaces and a language for combat and so on. Learning latent spaces and then doing direct products of these latent spaces and all these things, that's a very natural thing to do. LMs can do that to some extent, but I wouldn't be surprised if there's an algorithmic shortcoming. And if we were to study the history of AI, it's a series of S-curves where eventually it's going to solve everything.

**[0:47:33] Vijay Pande:** Single layer neural nets are going to solve everything except for XOR, except for this, except for that. And then we get to a plateau. It would not surprise me if we get to a plateau before HEI. And this 2029 number would be a very natural thing if the S curve were an exponential. But what if it were a sigmoid? And if it's a sigmoid or logistic, it's going to bend over. Maybe we just don't get there and that extrapolation doesn't work.

**[0:47:58] Vijay Pande:** I would not be surprised if there's something really missing. And that's the cool thing because I think we'll get it, but maybe just not this soon.

**[0:48:06] Andrew Beam:** So I think one common rebuttal that I hear about AGI by 2029, I think you were kind of alluding to there, is that they are just trained on internet data, and internet data is only going to get you so far, and we've already extracted all the signal from internet data. Do you have a sense of how true that is? So the models that we're using, have they actually extracted all of the information that humanity has produced so far, or are we still at some small fraction of that?

**[0:48:31] Andrew Beam:** Because I think that would suggest how much room we're going to have for improvement on the current paradigm?

**[0:48:36] Vijay Pande:** The one thing, though, is that like the way computers learn is not the way we learn new things. It's the way we learn existing things. So like, I don't know if you ever had friends that like grew up in foreign countries and moved here. I've had a few that they learned English from watching TV. It was shocking if you imagine it's even possible, but it's a common thing. And so that's kind of very LLM-ish, right?

**[0:48:57] Vijay Pande:** You're just watching and absorbing. And maybe there's a little RLHF in there when your parents or your teacher says that's wrong, that's wrong. But it actually reminds me a lot of learning English as a foreign language. But that's different than learning like in a PhD, where you're into a new discipline where nobody knows the answer. And it's a whole different process. And I think a lot of things that we're excited about are things that nobody knows the answer to.

**[0:49:20] Vijay Pande:** And that's a different paradigm. That's maybe even learning is not the right word. That's exploring or creating or discovering. and that's not what LLMs have really been geared up for. And even building tasks in Qstar and so on, that's not gonna, I think, teach it how to do that. And there may be something to do on top. In a sense, LLMs are like a really good undergrad that's read all the books, but is not ready to be a grad student yet, maybe, I don't know.

**[0:49:46] Andrew Beam:** Yeah, I agree with that. I think that there's something to being embodied and interacting with the world that's missing with the current paradigm. So one thing that I always think about is LLMs are great at selecting from a set of hypotheses that are compatible with what we currently know. But often the only way to know which one of these hypotheses is correct is either to assume your way there. So I assume that I know how the world works and therefore I can rule some of these out or to do an experiment or interact with the world or push the cup off the table and falsify or confirm your hypothesis.

**[0:50:18] Andrew Beam:** So that does seem like I don't have a sense of how big the fraction of that missing piece is, but it definitely seems to be a missing component.

**[0:50:24] Vijay Pande:** Yeah. So towards that end, it could be that the human feedback that LMs get through massive chatbots could be, but like that's different than still like the type of advanced learning that we're talking about. So I don't know. I mean, I'm very curious to see, and it could be, you can imagine creating different types of bots that are the professors and that create students and you cycle over. I don't know, reproducing academia and AI may not be the ultimate end goal, but that is an interesting paradigm to consider.

**[0:50:53] Andrew Beam:** I guess, Faraj doesn't have any questions, just one sort of like forward-looking thing that I'd like to get your take on. My experience has been that when you're talking to people about AI, especially people who are hearing about it for the first time, there's either elation or fear. And that like it seems to be pretty polarizing along those two axes that, oh my God, this is amazing, or oh my God, this is the most terrifying thing I've ever heard of in my entire life.

**[0:51:16] Andrew Beam:** How could you possibly be working on this? At least externally, A16Z seems to be formally, very firmly in the optimist camp. So maybe you could give us the bull case for optimism and about why AI is going to give us the sort of future that we all want. Yeah. And I can also

**[0:51:30] Vijay Pande:** give you what my understanding of the psychology of the bear case is. I think this is something that has happened over and over again. Part of predicting the future isn't like you're a genius. Like I can predict what time the sun's going to rise tomorrow. It has a daily cycle. Some things have monthly cycles, some things yearly cycles, technology and industrial revolutions people have studied, historians have studied, and they have like 25 year cycles. And we're in the middle of industrial revolution.

**[0:51:55] Vijay Pande:** This is not our first, this is our fifth or sixth, depending on how you count them. And in these cycles, there are all these people that are scared of the new technology. And there's a lot of reasons to be scared. It changes things like when, before cars, if you were a master horse greeter, like you worked really hard to be good at this really important thing. And then that goes away. That is scary. And there's a lot of reasons, the fear of that.

**[0:52:16] Vijay Pande:** And if cars, the first time cars on the market, like cars kill people, they run them over. They're this new thing that you're not used to thinking about. And not in a way that horses run people over is just different. And sure, cars are ambulances too. But if you're just looking at the negative side, being run over a car is more scary than having cars to help you and all the things that you can do. And so every fear that we could attribute to AI, we could also attribute to electricity.

**[0:52:42] Vijay Pande:** You know, you put this thing in everyone's house and that could kill you if you touch it, you know, or the positive electricity or the negative of the cars, the positive of cars. And so if you harp on the negatives, it can, anything can look really bad. Cars and electricity can look really bad. If you consider the net positives, the net positives are dramatic. Nobody wants to go back to a world without cars or without electricity.

**[0:53:02] Vijay Pande:** If you go that direction, you're in a hunter-gatherer society where, you know, the bully beats up everybody and that's the person who runs the little village. I mean, technology is the great equalizer that democratizes everything. That the technology we have today gives us things that like a royal king 100 years ago would never have. We all have the same Spotify and the same iPhone. I think on the medical side, I think the exciting thing is we will all have the same specialist.

**[0:53:28] Vijay Pande:** We will have the best doctor, just like we have the best Spotify or the best iPhone. We can all have that. And the democratization is something that just doesn't exist in something like healthcare today with such disparities of quality access and care and cost. I think that's the real hope. And I think that's what gets me excited about AI in healthcare. But I think this is AI broadly and it's technology broadly. And as a firm, we're very excited about technology because we've seen all the positive things that it's done.

**[0:53:56] Vijay Pande:** Got it. Thanks.

**[0:53:57] Arjun Manrai:** I think that's a great note to end on.

**[0:54:00] Vijay Pande:** Oh, fantastic. This was so much fun.

**[0:54:01] Arjun Manrai:** Thank you. Thanks for coming on, DJ. Thanks so much, RJ. This was great.
