OpenNashPodcasts

Invest Like the Best

Des Traynor - Real Talk about AI and Software - [Invest Like the Best, EP.340]

8 Aug 2023 · 1h 5m · Patrick O'Shaughnessy, Des Traynor · 22 quoted facts

▶ Play episodeOriginal source ↗

In brief

Des Traynor, co-founder of Intercom, argues that AI helps existing software companies more than it helps startups, provided the incumbent moves fast. Most products are mainly a database with a user interface on top, so an incumbent can add AI quickly. The real prize is removing whole workflows, as Intercom's Fin bot does for customer support, rather than adding small copilot features.

The episode's tension is between speed and durability. Intercom dropped its roadmaps within hours of ChatGPT's release and saw Fin resolve large shares of support volume. Traynor also says software has few lasting moats, goes stale within about three years, and gets worse for each user as it grows. His answer is relentless shipping, then turning that momentum into a brand.

Key insights

  1. Fast incumbents can beat AI-first startups

    Traynor says a startup must rebuild everything an incumbent already has, such as deliverability and email rendering for Mailchimp. A startup may build the AI part in three months against the incumbent's thirty, but it still needs the other twenty-seven months to catch up on everything else.

  2. Removing work beats adding a copilot

    Traynor says features that suggest text are 'basically dead in the water'. The value comes from taking tasks out of the support formula of inbound volume times handling time. Fin's automatic resolutions do this, and customers saw 15 to 25 percent of volume vanish just by switching it on.

  3. Fin's quality depends on what you feed it

    Fin searches a company's help docs and past conversations to build answers. Traynor says the gap between strong and weak setups is simply how much knowledge the bot can read, and many customers found their help docs were out of date once Fin exposed them.

  4. Intercom abandoned its roadmaps almost immediately

    Instead of forming a task force and waiting weeks, CEO Owen deleted roadmaps for several teams within about fourteen hours of ChatGPT's release. Traynor credits this decision speed, plus years of earlier AI work, as the biggest factor.

  5. Software's strength is also its weakness

    Traynor says software is easy to copy and goes out of date in about three years. A product also has to add settings and workflows to serve a big market, so it becomes worse for each individual user while its market grows.

Questions

What is Fin and what does it do for businesses?

Fin is Intercom's customer-service chatbot, powered by OpenAI. It reads a company's help documents and past conversations to answer customer questions without a human, and Des Traynor says some customers saw support volume fall by up to 50%.

Will AI make startups beat older software companies?

Traynor says usually not, if the older company moves fast. The startup still has to rebuild everything else the incumbent already has, so the AI edge may not be enough. Startups win mainly when AI makes the incumbent's whole design obsolete, as in automated ad management.

How much does Fin cost, and is that cheap compared with human support?

Intercom charges 99 cents per resolved conversation. Traynor says that is below what most companies pay human reps, and it also delivers an answer instantly, which he says keeps users from drifting away.

Why did Intercom say it could not offer some AI features yet?

Using GPT-4 is expensive. Traynor says that summarizing every conversation live, across about 500 million conversations a month, would bankrupt the company at today's prices, but cheaper models could change that.

How do you stop an AI support bot from making things up or going off topic?

Traynor says Intercom constrains Fin to refuse topics unrelated to the business and uses careful prompting to reduce hallucinations (made-up answers). For high-stakes topics, a separate non-generative product called Custom Answers uses fixed, controlled wording.

Facts

Stated by the speakers. Each quote matches the transcript, which shows what was said, not that it is true.

Intercom was founded in 2011 and, according to the episode introduction, its products operate within 25,000 businesses including Amazon, Lyft and Atlassian.

“The business was founded in 2011 and their products operate with 25,000 businesses, including the likes of Amazon, Lyft, and Atlassian.”

0:04:00 · Des Traynor · Intercom · 2011

Des Traynor says Intercom began experimenting with AI in 2016 and has had AI products on the market since.

“We have dabbled in AI since 2016. We've had AI products live in market.”

0:04:23 · Des Traynor · AI history · 2016

Intercom released its first ChatGPT-era AI feature in beta in December and announced it publicly in January; it assisted human support agents.

“Well, we had our first release in beta in December, and then we talked about it publicly in January.”

0:04:50 · Des Traynor · Product launch · 2022

Intercom launched the customer-facing Fin bot in beta in March and made it generally available around late May or early June.

“We launched that in beta in March, then we went to general availability, I think, in late May or early June.”

0:05:28 · Des Traynor · Fin launch · 2023

Des Traynor says some Intercom customers saw their support volume fall by 50% after using Fin.

“We've seen customers see 50% of their support volume drop.”

0:05:59 · Des Traynor · Fin results · 2023

Des Traynor says Intercom handles about 20,000 support conversations a month, roughly a quarter million a year.

“If you take intercom, we do 20,000 support conversations a month, so about a quarter million a year.”

0:21:19 · Des Traynor · Support volume · 2023

Intercom released a bot buyer's guide to help customers tell apart AI support bots that look similar in simple tests.

“And even yesterday, we released a bot buyer's guide because we're trying to teach customers about these differences.”

0:17:16 · Des Traynor · Competition · 2023

Des Traynor says Fin had been available to all Intercom customers for only about eight weeks at the time of recording.

“And then ultimately, we've only really been live to literally everyone, I think about eight weeks.”

0:19:47 · Des Traynor · Fin rollout · 2023

Intercom planned a feature in which Fin writes its own knowledge snippets by learning from a company's past conversations.

“We will very shortly have live in market this Fin generated snippets feature where Fin will read your entire conversational context for your business going all the way back.”

0:20:30 · Des Traynor · Fin snippets · 2023

Intercom's stated mission since 2011 has been to 'make internet business personal'.

“Our mission from 2011 has been make internet business personal, and that's really what we're about.”

0:23:30 · Des Traynor · Mission · 2011

Intercom charges 99 cents per resolution for Fin, and Des Traynor attributes the price to the cost of GPT-4.

“So GPT four is expensive, and as a result, Fin is perceived to be expensive. We charge ninety nine cents a resolution.”

0:25:16 · Des Traynor · Fin pricing · 2023

Des Traynor says summarizing all of Intercom's roughly 500 million monthly conversations in real time would be unaffordable at current model prices.

“To give you a simple example, summarize every conversation in real time as they happen. We have 500 million conversations a month. That would bankrupt us.”

0:25:59 · Des Traynor · AI costs · 2023

Intercom offers a separate product called Custom Answers for sensitive topics where exact wording must be controlled.

“I can tell you what we do in Intercom is we have a separate product to Fin called Custom Answers.”

0:42:31 · Des Traynor · Custom Answers · 2023

Before ChatGPT, Intercom had a live automated support product called Resolution Bot.

“We'd been dabbling in AI for years. We had a live product called Resolution Bot, et cetera.”

0:32:31 · Des Traynor · Intercom history

Des Traynor says Intercom began working on its AI response about fourteen hours after ChatGPT was released.

“I think, like fourteen hours after ChatGPT dropped, we were able to go, and we started working on it.”

0:32:31 · Des Traynor · Intercom response · 2022

Des Traynor cites the spreadsheet tool Equals as an example of a chat interface that lets users write formulas and SQL in plain language.

“So equals is basically a spreadsheet tool. One of the things they have built in is AI, another thing they have is live data sources.”

0:40:03 · Des Traynor · Chat interfaces · 2023

Des Traynor says he has invested in Kettle, a tool that generates editable vector graphics from text descriptions.

“there's one I've invested in called Kettle, where like again, you just describe the visual of what you want, and they produce a vector.”

0:36:38 · Des Traynor · Investing · 2023

Des Traynor describes a Zoom competitor with AI meeting notes that failed to find buyers because it charged about $7 per person on top of Zoom and Google's suite.

“But if you try and take it to a company and say, well, you pay seven a head for this on top of your Zoom fees, and you're already probably buying the G suite anyway.”

0:46:08 · Des Traynor · Investing

Intercom publishes a public changes page showing how frequently its product team releases updates.

“If you go to Intercom dot com slash changes, you'll see the rate of release from our product team.”

0:49:13 · Des Traynor · Product velocity

Des Traynor says that in 1988, at age seven, he became obsessed with the Commodore Amiga 500 computer.

“And in 1988, when I was seven years old, I basically was obsessed with this computer called the Amiga 500 by Commodore.”

1:02:55 · Des Traynor · Personal history · 1988

Des Traynor says his mother bought him the Amiga 500, which cost about 700 Irish pounds, roughly a thousand dollars.

“So whatever costing 700 Irish pounds, which is probably like a grand or something like that in dollars.”

1:04:22 · Des Traynor · Personal history · 1980s

Des Traynor says he met both his wife and Intercom CEO Owen at the same meetup, which Owen had organized.

“I met my wife at the same meetup that own had organized, where I met him for the first time.”

1:03:57 · Des Traynor · Personal history

Chapters

  1. 0:04:50Intercom reacts to ChatGPT

    Traynor describes how Intercom dropped other work to rebuild around ChatGPT's abilities, starting with tools that assist support agents.

    “It wasn't quite code red, but it was as close to a can be from a offensive point of view.”
  2. 0:09:21Do incumbents or startups win with AI?

    Using Mailchimp as an example, Traynor explains why a fast incumbent can absorb AI while a new entrant must rebuild everything else.

    “Let's assume that you and me and our super hot new startup can move ten times the speed of Mailchimp.”
  3. 0:15:58How Fin is built and tuned

    Explains how Fin searches company knowledge and why the quantity of source material drives answer quality.

    “When we see people with like amazing fine instances and like weaker fine instances, it's literally how much have you fed it?”
  4. 0:25:59Pricing, costs and model providers

    Covers the 99-cent resolution price, the expense of GPT-4 and why some features are not yet affordable.

    “We have 500 million conversations a month. That would bankrupt us.”
  5. 0:31:50Moving fast and deleting roadmaps

    Shows how fast leadership decisions let Intercom start on AI within hours.

    “What we actually did practically was abandon multiple projects, deleted multiple roadmaps for our automated support group, for our ML team, for our inbox team.”
  6. 0:33:46Remove work instead of adding copilots

    Traynor's main product advice: target whole tasks that can be eliminated, not small suggestion features.

    “If you can just chomp out a massive amount of one of the numbers in that formula, that changes the optics of the business entirely.”
  7. 0:46:27What Traynor looks for as an investor

    He explains how he screens startups, including his four-part test for a unique pitch.

    “what is the single thing you can say that is unique to you, valuable to your user, true and simple.”
  8. 0:55:23The case against software businesses

    Traynor argues software is easy to copy, goes stale fast and gets worse for individuals as it grows.

    “for a product to be big and successful, it has to get worse.”
  9. 1:00:33Hot take on startup runway

    He urges struggling founders to set a short deadline rather than spend years on a business that is not working.

    “The worst thing is that you stay in business, banging your head off a wall.”
  10. 1:03:57The Amiga 500 and a mother's gift

    In the closing story, a childhood computer set off the chain of events that led to Traynor's career and Intercom.

    “The entire history of my career goes back to that one machine.”

Transcript

0:01:20
Patrick O'Shaughnessy

I know firsthand how complex the tech stack is for asset management firms. And seemingly every new tool and data source makes the problem even worse, adding more complexity, more headcount, and more risk. Ridgeline offers a better way forward one unified platform that automates away the complexity across portfolio accounting, reconciliation, reporting, trading, compliance, and more, all at scale. Ridgeline is revolutionizing investment management, helping ambitious firms scale faster, operate smarter, and stay ahead of the curve. See what Ridgeline can unlock for your firm.

0:01:52

Schedule a demo at Ridgeline dot ai. I can't tell you how many deals I've seen get bogged down for weeks by lawyers nitpicking details while charging clients by the hour. Crosby is the first AI law firm that builds custom agents for its big law attorneys. They work incredibly fast so you can close deals faster. One of our sponsors asked us to sign an NDA before showing us a new product. A Crosby attorney sent us thoughtful, detailed

0:02:55
Des Traynor

redlines in forty three minutes. She identified several important issues we needed to negotiate and gave us excellent advice on exactly how to push back. That's the kind of high quality, fast legal advice that makes good deals happen quickly. It's no wonder that the fastest growing companies like Cursor, Cognition, Ramp, and Ro go use Crosby. Learn more at Crosby dot ai slash invest. Hello and welcome everyone. I'm Patrick O'Shaughnessy, and this is Invest Like the Best. This show is an open ended exploration of markets, ideas, stories, and strategies that will help you better invest both your time and your money.

0:03:49

Invest Like the Best is part of the Colossus family of podcasts, and you can access all our podcasts, including edited transcripts, show notes, and other resources to keep learning at JoinColossus dot com. Patrick O'Shaughnessy is the CEO and founding partner of Positive Sum and the CEO of O'Shaughnessy Asset Management. All opinions expressed by Patrick and podcast guests are solely their own opinions and do not reflect the opinion of Positive Sum or O'Shaughnessy Asset Management. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions.

0:04:00

Clients of Positive Sum or O'Shaughnessy Asset Management may maintain positions in the securities discussed in this podcast. My guest today is Des Traynor. Des is the co-founder and chief strategy officer of Intercom, a customer service solution that helps businesses answer product questions, offer instant support, and automate sales. The business was founded in 2011 and their products operate with 25,000 businesses, including the likes of Amazon, Lyft, and Atlassian. Our conversation is roughly split in half.

0:04:09

First, we talk about AI and how it's actually changing businesses like Intercom through products such as their OpenAI powered bot called Fin. We then talk about Des's views as an investor, which includes an answer about software that I'll remember for a long time. Please enjoy my conversation with Des Traynor. So I've been so excited for this because I think it's the perfect excuse to talk to a real practitioner builder entrepreneur about what it's been like to feel the explosion of AI and its impact, both exciting, maybe even scary, on an existing product, an existing software product that's always been very cutting edge in terms of its architecture, et cetera, and how you approach this new opportunity slash threat.

0:04:23

Everyone I think is this bomb that went off in the technology scene. And I'd love you to begin by just giving me your high level thoughts on what it's been like to see chat GPT, GPT four, all the open source models, all this explosion of new technology through the lens of an existing, really successful software business. It's been a good roller coaster, a fun one. We have dabbled in AI since 2016. We've had AI products live in market.

0:04:31

I think the world changed with ChatGPT, both capabilities of what AI could do changed, and also I think people's willingness to engage with a bot was a lot different after their first experience of ChatGPT. For us, I met with our head of ML, I think the day after ChatGPT dropped, and we had a pretty long conversation where he was pretty firm that this is the single biggest transformation he's seen in AI, and he's spent his entire career in it.

0:04:39

The more we played with what we realized was, hey, this thing is very conversational. It can learn, it can summarize, it can extract the main pieces, and given a query and given a set of information, it can actually propose an answer. And that is basically what customer support is. So the implications for customer support and Intercom's, we're customer service platform, the implications are pretty obvious. It sounded probably more like a prophecy at the time, but I think looking back, everyone's like, yeah, no, it's pretty obvious that the entire world, the customer support was going to change.

0:04:50

So the question was, how quickly can we do it? We downed tools, a lot of projects. It wasn't quite code red, but it was as close to a can be from a offensive point of view. Was let's go hard. AI, the team worked insanely hard and we produced our first release. Well, we had our first release in beta in December, and then we talked about it publicly in January. And that was all about assisting the customer support rep.

0:05:03

Because we weren't yet sure that the tech would actually be good enough to face end users, but we knew it was definitely good enough to augment the customer support agent. GPT four was on its way around then. As soon as we got our hands on that, that was where we were able to say, hey, we can constrain this agent to not go off topic, to not take opinions about whatever politics, or to not recommend your competitors, or to not do anything you wouldn't want a support rep to do.

0:05:28

And we can also, we believe, curtail the vast majority of the hallucinations by basically with the right amount of prompting. So we started to play with that. We launched that in beta in March, then we went to general availability, I think, in late May or early June. And that's been a wild ride. Just seeing how the bot almost always is outperforming what our expectations of it are in terms of, like, the complexity, the nuance. Customers will send us seven questions, not knowing they're talking to a bot, seven questions with nested if this, then how do I that?

0:05:59

Fin just blitzes through it. Genuine conversations that might have taken a support rep an hour to aggregate all the information for Fin is just blitzing it. And there are some shocking stats. We've seen customers see 50% of their support volume drop. We've seen on average, most customers who turn Fin on with no other work, literally clicking an on button, are getting fifteen, twenty, twenty five of their support volume just going away straight away. And it's just been crazy to see a product where we knew we had done all the right stuff on our side, but you're still crossing your fingers going, I hope it works well in the aviation industry.

0:06:34

Sure enough, it does. So it's been wild to see it up front, and we've continued, and obviously we can talk more about it. But yeah, we're now asking ourselves, what's the next tier of this? How do we make it more powerful? How do we make it interoperate with humans better, et cetera? Do you think that this technology is actually more powerful for existing companies that have pre built products and big data stores and big teams, et cetera, versus de novo startups that are trying to let's say, for example, someone wanted to build a from scratch intercom competitor starting tomorrow, and they've got all this great new technology.

0:07:35

Often in the history of technology, if you're using new, you can counter position using new technological platforms or whatever and really stick it to incumbents. My experience so far has been it feels different in this context, in that actually fast moving incumbents, as long as they recognize it, are better positioned. Do you think that's right? Has it felt that way to you? Any big thoughts that you have on that idea? I've been thinking about this a lot, both from an intercom perspective, and there are a lot of people trying to do customer support startups based on OpenAI's tech at the moment.

0:07:45

And then I've also been thinking about it as an investor as well, just looking at the startup scene and seeing what's new. The way I've concluded is, and by the way, in your example, let's just assume we'll take off the table the idea that GPT can write the code to make it the intercom competitor. Like, let's assume all those things are true for everyone. I think if the way in which you would rebuild the competitor, let's say I'm trying to build a competitor to Intercom to make it not personal for lack of a better word.

0:08:05

Let's pick, say, I don't know, Mailchimp or something like that. An email newsletter tool, everyone understands the gist of it. The question I would have is does the way in which you'd build the competitor, is it substantially different to how Mailchimp is architected? Are there some fundamental assumptions made in the code base of Mailchimp that are now entirely invalidated? They just make no sense anymore. And if that is the case, then I think, yeah, the opportunity is with the new startup.

0:08:32

Because what Mailchimp has to do if they want to compete is actually build a whole new thing. But I think in most cases, and if we just keep pulling the email Mailchimp example, if you and I say, all right, hey Patrick, let's go build a Mailchimp competitor. And we're going to use AI, and it's going to do AI to write your newsletters and AI to generate your designs. Brilliant. So we still have to build a massive deliverability platform.

0:08:55

We still have to build link attribution. We still have to build email rendering and testing email rendering across a dozen different clients. We still probably have to build up a brand credibility and all of that stuff. And all Mailchimp has to do is shout out to OpenAI for augmenting the text you're writing. So in that world, I think you might be in some eighty twenty, 80% of the existing text still stands, and 20% is going to be new stuff coming from OpenAI or coming from Anthropic or whoever we lean on.

0:09:21

So I don't really see an advantage now. And the calculus I actually do when I talk to companies about prospective investments, or when I assess intercom threats, is basically how fast can they move? Let's assume that you and me and our super hot new startup can move ten times the speed of Mailchimp. And let's say we conclude it takes us three months to build all the AI stuff, and it might take Mailchimp thirty months. The question is, is twenty seven months enough for me and you to go and build every other feature in Mailchimp to the same standard?

0:09:50

And if it's not, then we're goosed. We don't really have a play to make there. To give you just one counterexample, let's say me and you said, hey, we're going to build a tool that's one of these advertisement management optimization tools. You log in every day and you see what ads are working, and you change your spends and you cancel some ads and tweak some ads. You could imagine how a LLM powered tool could basically optimize itself, consistently create new versions of ads, run those instead, run A B tests amongst itself, and literally entirely manage your entire ad inventory directly without anyone ever having to log in.

0:10:28

And in that world, I think a lot of the assumptions of the incumbent are totally invalid. They might have dashboards and reports and lovely funnels for configuring ad campaigns, but it's all unnecessary. The AI is going to do it all for you. So in that world, if we're going to go after a space where, hey, we would actually build this thing substantially different than we're building it today. I think all the advantage is within the entrant.

0:10:46

That's when it gets exciting. So talking again about intercom, if with stats up to fifty of customer service requests is handled end to end without a human in the loop. The whole thing you just described is a gradient. It's never one or the other, it's somewhere on a spectrum. So where do you feel like you fall on the spectrum of this is an entirely new thing versus, oh yeah, to build the rails underneath the delivery of this thing is like the Mailchimp example, it takes four years.

0:11:22

I think we're somewhere in the middle where whole workflows are removed in Intercom's case, but not the entire platform. So there are still humans doing support, and they still need a pretty rich and powerful support help desk, and they still need a messenger to communicate through. All of that needs to be available through APIs. You still need a knowledge base. There's a lot of other stuff that still has to be built. And then obviously, Intercom also has proactive support, so there's messaging pieces as well.

0:11:40

So I think what we have had to do is reimagine and throw away parts of Intercom that assumed, say, our reporting infrastructure is very different in a world where fifty of the responses are going through AI. All of a sudden, people care a lot about the AI reporting, whereas they didn't before. Measures like first response time are now no longer really valid because you have to subtract out AI and all that stuff. So I think if you can imagine of all the support work that happens, X percent of it's gone.

0:12:06

The remainder still needs a what we would call like a classical, high quality help desk. A good chunk of the work just disappears entirely. And then there are some features or some workflows. We'll see how we play it out, where we'll probably heavily augment them with AI. So you could imagine analyzing what are the most common complaints from customers today. I can imagine we'll throw a lot more AI at that feature to remove the needle in a haystack approach.

0:12:28

And actually, maybe the new version of that report is just a summary paragraph that tells you here's the biggest issues going on today. So I think that would be an example of workflow displacement. But I think in general, we believe the future of customer service will still involve humans and bots, and we care a lot about making sure that they can work together really well and they can interoperate. And we have this idea of a flywheel where the humans help the bots and the bots help the humans.

0:12:49

If we're right, anyone who wants to beat us also needs to have a pretty high quality help desk too. Can you help me understand the nuts and bolts of working backwards from a thing that I think everyone wants, and I'll call that thing an agent that is context specific to their business or themselves or whatever?

0:14:15

Where the feeling of chat GPT, which is so magical, or GPT four is so magical, but with all the context and the knowledge trained on me or trained on my business. And what you just said, people helping bots, bots helping people, sounds like this is a process to take the generic, broad artificial intelligence, whichever provider you use, and make it context specific or really helpful to me specifically. There's this process of retraining it or narrowly training it.

0:14:23

So can you just literally tell me the steps of what you've learned about how that works? Because it seems reasonable to me that we're going in that direction. Everyone's going to have an agent that is tailored and aware of their specific circumstances and context and data and so on. And you're one of the first to actually build this process of training this thing. And I think of Fin as okay, Fin's the intercom agent. It is a multipurpose thing, but it's very context specific to your product and your world.

0:14:31

So what have been the steps, the mistakes, the considerations? The details of this are really interesting to me if this is where the world's going. There's a lot to this, but the biggest things I think, we lean on OpenAI mostly to power Fin's decision making, ultimately, like its judgment, and also its conversational capability. So we don't have to build stuff like, hi, how are you? Oh, I'm good, how are you? All of that type of boilerplate salutation and all that.

0:14:39

OpenAI is just really good at and it's really good even when we want to get to a point where our customers can have Fin speak in their own brand and tone of voice. So, like a surf shop and a bank can sound appropriate for their domain. So I think our biggest challenge initially was how do we get it to stay on topic and how do we get it to not apply knowledge that has nothing to do with your business.

0:14:48

So if you go to any Fin instance and ask it, like, who is the president of America? It actually won't attempt to answer because there's a slippery slope and you'll see a lot of people go down this slippery slope where you can force it to then take opinions that the company doesn't want to take. Getting the bot, despite all its infinite wisdom, to refuse to engage in topics that are anything other than this bank or this surf shop or this podcast or whatever, it's an important step.

0:15:11

And then removing hallucinations so it doesn't do its best to, how would you say, please the user by making shit up. They're the first two things. In practice, how does that happen? Well, we discern this most important pieces from the user. So when they come on and say, hey, how do I whatever reset my password or open an account or whatever? Look for the guts of what they're actually asking. You perform some vector searches across all the docs that you've gathered, and that can include everything from your public knowledge base, the entire conversation that's led up until this point in the thread.

0:15:39

So it can do things like, hey, how do I do that? And it can infer what that means, et cetera. So you have to perform a search of, given that this is the question, drinking in all of this context, what do we suppose is the right answer? And then how do we package that answer in a way that sounds again on brand and appropriate for where the conversation is at right now, depending on the tone it's taking.

0:15:58

So that's most of the work. It's about the vector search is really important. The knowledge sources are the single biggest variant. When we see people with like amazing fine instances and like weaker fine instances, it's literally how much have you fed it? How much have you given it access to everything about this user, everything about your product, your product docs? It's been impressive how fin can even read stuff we didn't expect, be it like API docs or things like that, to actually suggest extra answers or further reading for the users.

0:16:26

But that's a lot of what it's been about. And for us, one of our challenges was coming up with a ability to benchmark where different versions are at. Because we can tweak and change prompting, or we can change model and point it at GPT 3.5 turbo versus four. And it's nuanced a lot of the time to see the differences until you spot them and then you realize, oh, this thing is actually going to go and recommend our competitor, or it'll go off topic or whatever.

0:16:52

One thing we've learned of late is there are so many people who have built the wrapper around GPT 3.5 turbo. And if you just test them all by asking a really obvious question and getting a really obvious answer, you're going to conclude they're all the same bot. It is unfortunate, and I say unfortunate for us because it's in the nuance and in the more likely scenarios. That's where you realize some bots are very good and some bots are very bad.

0:17:16

They can all say what does X do or what does this company do? It's really when you get into specifics about like a refund request or you try and make it go off topic. That's where you see its underperformance, or you see the lack of prompting, the lack of training, et cetera. And even yesterday, we released a bot buyer's guide because we're trying to teach customers about these differences. Obviously, you hate having to market nuance. We'd rather we were the only Fin in town, but that's not the case.

0:17:38

It was the case for three or four months, but now there's a lot of YC startups doing it. Now we're into who's got the most, who's taught this true the most. Ultimately, I still think, though, as I said earlier, the battle will really shift to being who has the right platform, who is the holistic solution for customer service. If you think about the examples you've seen so far, some of which have crazy staggering numbers that you quoted in terms of how much of the previous product that was human focused is now end to end handled by a machine.

0:18:33

Where do you think the natural endpoint of this is for your business? I'm curious what the adoption's been like, how many of the normal intercom customers are using Fin in some way, shape, or form? So what's the friction to getting on this train? And where does it go? Is the natural endpoint that customer service is eighty, 90% handled by AI, and there's just those strange edge cases get spit out to a much smaller support desk.

0:18:41

Where do you think this goes and what have been the frictions to adoption? The largest barrier is the people aspect. So it's customer support, generally speaking, is a human operated industry. And if we move a button in Intercom's inbox, we get our support team just get fed fire by our customers. Because they're like, yo, if you're going to make a single change to this inbox, we have to have an offsite to retrain our entire staff. And when you realize that that could be hundreds of people, we have customers who have thousands of intercom seats.

0:18:56

So one single change of, hey, it used to say send and close, and now it just says send. That could literally set a large intercom instance back weeks in terms of support volume. So we're very delicate about how we make these changes. The other side of that friction is our customers are very, very slow to adopt for a very good reason. Because they say, okay, we will try. So what we're seeing a lot in, say, Fin's case, we have money, money, money, hundreds, if not thousands of Fin users spitting out tens of thousands of answers on a regular basis, et cetera.

0:19:24

But what we're seeing is everyone wants to dip their toe. They don't want to say, let's point Fin at the entire support volume. What they say is, hey, let's turn Fin on on the weekends, or they say things like, let's turn Fin on. If and only if the question regards resetting a password or something like that. And they're doing that because they want to get a sense of how is it performing in a smaller use case.

0:19:47

And then ultimately, we've only really been live to literally everyone, I think about eight weeks. We have a lot of planned larger migrations where our customer support teams are going to switch over to a massive amount of volume going to Fin. But they're busy working on their knowledge bases and they're busy working on their snippets, et cetera. The snippets being the things that Fin reads to produce answers. So I think what we're seeing is a lot of people preparing for this world.

0:20:10

But the friction is definitely, how do I get my support team on board? How do I make sure that we're doing all the right stuff? Even in a lot of cases, all our help docs are out of date and we didn't realize it, but our customer support team were saving our ass. And now we need to update our help docs before we let Fin in. The other question you asked is where does it stop? And I think that's genuinely something we don't really know the answer to.

0:20:30

We will very shortly have live in market this Fin generated snippets feature where Fin will read your entire conversational context for your business going all the way back. And it'll learn from every live conversation that happens, and it'll produce snippets, little nuggets of knowledge to augment its own understanding of your business along the way. Our vision for that will be that your customer support team deals with any common query they see, they should see it for the first time and the last time.

0:20:54

They should basically answer it once and believe that they'll never see it again. Where we want them to spend their time is on high value brand building, high urgency, high impact conversations. We want them spending time on proactive support. We want them reaching out rather than like dealing with customers when stuff goes wrong. We want them reaching out to make sure that everything goes right. That's the future world we want for support. In terms of what percentage could actually of raw inbound could go through, it will vary vertical by vertical.

0:21:19

If you think about, say, an e commerce store, there's really only ten questions you ever ask. It's where's my order, why is it late? I want a refund, it arrived broken. What's most exciting to us is what will this snippets feature do? Because you're just going to keep aggregating knowledge. If you take intercom, we do 20,000 support conversations a month, so about a quarter million a year. If we just look back two years, that's half a million conversations on top of our entire knowledge base and our API docs and all of our training material and our education material.

0:21:43

It's a huge amount of information about the product for Fin to consume. I can't yet tell you where we will be, but I suspect it's still going increasing. Our own resolution rate and all of our customers' resolution rates only go upwards. And then what the question is, where does it start to asymptote? We've yet to see it, but we are only at about eight weeks, so we're still at the precipice of a lot of these changes, I think.

0:22:03

What is your overarching product philosophy that sits behind all this stuff? At the end of the day, this is just new technology. It's all like any technology, it's just something that lets you do something for someone else. Do you have a overarching product philosophy that is the bedrock on top of which you make all these decisions? Yeah, we have a customer service manifesto, which is our set of beliefs about how the world of customer service will change over the next few years.

0:22:29

And we've had one before, but before AI, we were mostly about conversational. We pioneered the idea of the chat thing inside your product and on your website, and that was we went hard on conversational. Today, our manifesto really has four core ideas in it. The first one is bots and humans will work together. That's a very firm belief we have. We believe humans are essential. We want to supercharge humans with AI, and we want AI powered chatbots to reduce a lot of the work for the humans.

0:22:55

Our second belief is that support should be proactive and reactive, which means you should be able to get out ahead of problems. Our third is so all support needs to be conversational and omnichannel. So we talk to customers any way they want to talk to you, anywhere, any way. And then lastly, all of this has to work together. So you can't try and stitch together three or four different tools. We often save customers from a world where they have a ticketing tool, a docs tool, an outbound tool, a different messaging live chat tool, and they have some Zapier powered or something, one of those cool integration powered things where they try and stitch it all together and get themselves some

0:23:30

source of truth. But it really doesn't work very well. And we do all of that. The higher level thing is in service of an internet full of better customer service. Our mission from 2011 has been make internet business personal, and that's really what we're about. If you think about the choice between providers underneath all this, which is something I don't think you and I have talked about yet. How do you approach that problem? GPT four has it's won the Kleenex battle or something.

0:23:39

It's the thing everyone thinks of. But the reality is there's lots of tissue providers, and you know, seem to there'll be more every year. How do you assess these things? They're so complicated and nuanced and interesting. You mentioned Anthropic earlier, there's open source ones out of Facebook. Yeah, there's all these cool things happening. So talk us through that part of all this. If I think about Azure versus AWS, you can build your software on any of the big three cloud providers or something, with little differences.

0:24:35

Is it the same story here? Is it just subtle differences, or is there clear leadership from OpenAI or someone else? From our perspective, I suspect it'll end up a lot like the Azure versus Microsoft type thing. Certainly, it's trending that way. We started with OpenAI because they were first out of the gates, and we've been partners with them for quite a while, and we've had early access to previous versions of all this tech. They do seem to be leading the way too.

0:24:49

GPT four, when they released it was definitely ahead and shoulders above everything else that was out there. So I think we're going to partner with whoever we think is going to give us most access to the best tech. The reason we change will be probably more of either somebody else has better tech, which has yet to happen, or it'll be like some later day optimization of, hey, you could imagine something like Anthropic is available in an EU instance of Amazon, and we can't get GPT over there, so let's swap or let's.

0:25:16

You could imagine some version like that where we do it for business reasons. So we'd either, if we were to go and chase anyone else, it'd probably be like accessibility or availability reasons. It could be tech reasons, we just haven't seen it yet. The last one where I just I'd be surprised if it shakes out this way is just price. So GPT four is expensive, and as a result, Fin is perceived to be expensive. We charge ninety nine cents a resolution.

0:25:36

It's way cheaper than you'd pay a human, but way more than you'd guess. Because if we get an off, a lot of people will just say, but it's just an API call. How can you charge that much money? The reality is that's what OpenAI charge, so that's why that's how it shakes out that way. But I could imagine if prices continue to run hot and people start to release substantially cheaper versions. There are genuinely features that would be prohibitively expensive for us to build today.

0:25:59

To give you a simple example, summarize every conversation in real time as they happen. We have 500 million conversations a month. That would bankrupt us. However, if somebody gave us a substantially cheaper version, all of a sudden that's back on the table. There are pricing implications here. We haven't bumped into them yet, and right now we're still in the innovating and pioneering phase. We're trying to do as much cool stuff as we can, so it doesn't feel like we're yet in the mode to optimize.

0:26:23

But I will say, I'm very, I take a lot of comfort in the fact that there's so many strong competitors here. It tells me that price will go down, availability will go up, and the competition to improve the tech will be pretty high. Ninety nine cents per resolution. How does that stack up to the cost on average across intercom's customers for a human led resolution? Do you think? So, the first variable is is your support done by a citizen of the United States working in San Francisco, California, or is it outsourced to an agency?

0:26:51

And if so, where is that agency located? We've never seen anyone get it substantially cheaper than those ninety nine cents. There is a nuance to this. If the answer to the question is no, then an agent can do sixty no's in an hour, and you're probably not paying them $60 an hour. But that's rarely the case. Most of the time, it is a lot of time taken to onboard agents, train them up, get them to be able to deal with the complexity, get them to manage multiple back and forths.

0:27:16

But for sure, some people will show me an example and say, that's definitely not worth ninety nine cents. And that's true. We don't know a priori whether or not the thing is worth answering until we answer it. But in general, we see most support reps paid somewhere between, like, the floor here would be, I don't know, eight, nine, $10 an hour or something like that. We haven't ever outsourced to extreme low cost providing areas. We've never outsourced support at all.

0:27:37

But I'm sure if someone will tell me you can get it for like $2 or $3 an hour, well, let's see. But in all these cases, I think most of our customers who are B2B tech companies, generally speaking, they're paying more for their actual support team. And then the other aspect that people often forget is there's a behavioral difference between a user getting an answer in zero seconds versus in seven minutes. So if the question was, hey, I've just signed into Asana and I wanted to know how to create a project.

0:28:04

If you answer that question immediately, they go and create the project and they continue to expand and growth goes up. If you answer that question eleven minutes later, they're on a different tab signing up for a different project. So there is value in instant support that goes beyond simply job doing. Yeah, it's totally fascinating. Obviously, you would expect the ninety nine cent thing to come down. And also, the customer support agent sitting in a call center just all of a sudden feels like dystopian or something.

0:29:19

That it's just a job that, but for the most valuable conversations, should be automated on top of a knowledge store that a company has. And I wonder why there hasn't been a company that does this for everyone. So you talked about your problems, like, okay, we got to solve, you got to make it not answer irrelevant questions and start having opinions and hallucinating and all this stuff. And then we need to train it on the customer's knowledge store.

0:29:28

There's a process that you've built that lets your customers work. Why isn't there a company that you could just hire to do all that for you? Given that it seems like everyone's going to want one of these agents in their business. What matters is the data. It's not. It seems to me like what's valuable is the companies that have great data, not the flow. So why isn't there just a provider that just does that part for everybody?

0:29:35

You know that phrase that people are too optimistic about what's possible in the short term and too pessimistic about what's possible in the long term. That's very much how I see the commentary around AI. If you said, all right, drink in all the S ones that are published every year and produce stock tips or something like that. The drinking in piece isn't actually hard. It's hard to find a moat there. I think basically what is proprietary and easy to differentiate on is either your data store or the actual workflows that you build on top of the LLM's interpretation of the data.

0:29:46

So it is definitely easy to point an LLM at a large source of information and even point it out. I'd say like true, something like Pinecone, point it at a vector search across that so we can filter it down and really get to the specific bits you want to see. What's genuinely hard is making it useful and making it do something that actually displaces a large amount of work. And if you take an area like finance or legal, I think the threshold or the requirements you'd have are pretty high in terms of trustworthiness.

0:30:14

And I think the challenge would be being able to make a bold enough claim that you can stand over to say, hey, this thing will not get your conclusions wrong. If you could package that up and then integrate it into an existing workflow, I think you would actually have a great opportunity. But I think simply the ability to filter information and consume it and then given this thing, answer this question. That's not the hard bit. The hard bit is make that into a product.

0:30:35

We're touching on the difference between a feature and a product, if you know what I mean. The ability to consume information and spit back some stuff is a feature. The product around it is reporting, accuracy, collaboration, all of the other stuff that actually makes it into something that a business would adopt. That's, I still think, a challenge that you have to take on if you do a startup in this space. You said earlier that this was on the borderline of being a red alert or something for intercom.

0:31:19

Talk about how that gets managed inside of a company. I imagine there's lots of companies that are looking at this as both an existential risk and opportunity. So what do you think you did well, poorly? What advice would you give other people facing down this seismic change in terms of just managing and steering an existing company through it? I think the thing we got most correct, and I put a lot of credit to this, although he won't take it, Owen, our CEO, was just the speed of decision making.

0:31:28

I think it's very, very easy for a company to say, hey, it looks like this OpenAI stuff is going to be a thing. Let's form a small cross functional team. We'll do an investigation, we'll get a readout from them in three or four weeks, and then we'll finish out the quarter's roadmap as we planned, and then we'll take stock and see where we're at. And I think that's probably the norm behavior for a lot of companies is to work in that methodical way.

0:31:50

And that's not what we did. What we actually did practically was abandon multiple projects, deleted multiple roadmaps for our automated support group, for our ML team, for our inbox team. Literally binned everything they were working on and worked on this thing instead. So startups often talk about how important speed is or whatever, and I certainly do this. I often feel when I'm talking to founders that I've invested in or whatever, I'm always trying to say, it's not their speed, it's your speed.

0:32:15

How quickly are you going to make this decision to unlock them? If they know you take a week for a decision, they're not going to come to you quickly with stuff. So in this exact example, Owen was like, let's go. We weren't going to wait for the data, we weren't going to wait for the evidence, we weren't going to wait for our competitors to say that they're also looking at this. We were just, it's go time.

0:32:31

So I think that is probably the single biggest unlock. We were able to fire the starter pistol that quickly, as in, I think, like fourteen hours after ChatGPT dropped, we were able to go, and we started working on it. And then we probably also had a small advantage. We'd been dabbling in AI for years. We had a live product called Resolution Bot, et cetera. So anyway, my advice to other companies, I think if we go back to the topic I said about the ratio of in your new world, how important is AI and how important is everything you've already built?

0:32:57

I think you need to work out if there are core product assumptions that are just no longer valid, you need to down everything. Nothing else matters. If you get this wrong, nothing else matters. If you get this right, nothing else matters. It's the only thing. I think if it's not that, is it? Hey, there's significant workflows we can just cut out and rebuild that use AI, so like reporting or whether it's image creation or something like that.

0:33:21

Then I would say, like, it's almost too late if you're trying to be the first in your category to say we have blah, but with AI. I think everyone's over this idea of we also have a lightning bolt in our UI that if you click it can invent some text. It's a done deal at this stage. You need to look at, in my opinion, proper end to end workflow automations. I would start fixing my gaze a lot more on what pieces of work can we remove entirely.

0:33:46

Because that's where the actual formula changes. We often talk internally about the formula of support, which is number of inbound times the amount of time it takes to solve a conversation, divided by the amount of support reps and all that. We look at all that. If you can just chomp out a massive amount of one of the numbers in that formula, that changes the optics of the business entirely. And I would encourage other startup founders to say, like, of all the tasks that have to happen in our product, which can we remove as much of as possible?

0:34:12

Take away so much of the what would now be seen as undifferentiated heavy lifting. Where can we just delete it? And that's how you'll have a winning product. That's interesting. So if you think about the many of these things where it's, I'll call it co pilot for X, Y, and Z, I think that you're saying something very different. Don't build another co pilot. Everyone's doing that. Everyone's adding AI to their existing thing. Instead, say what part of the customer's workflow can we just literally kill, just have go away completely without them.

0:34:54

We almost don't want customers to interact with AI. We just want things to happen as a result of AI that they don't even think about. That's the highest order goal you can go for. And there are cases where you can achieve that end to end pure automation. I mean, you've done it. Yeah, exactly. I wouldn't say that, um, the co pilot style things are useful. If you take, say, I'll just take GitHub Copilot, the most famous of them.

0:35:04

It turns out finishing the sentence in code is something every programmer does dozens of times a day. So if you look at how often does the thing happen and how long does the thing take? If you start writing a for loop in code, sure, it doesn't take a lot of time for you to finish the bracketing and all that stuff. But you might do that whatever twenty times a day. So being able to hit tab instead of having to type anything.

0:35:22

There is a if you just multiply the two things out, frequency times time spent, you'll actually get a sense of where the value is. A non-AI example of this would be like spell checking or something like that. It's just like, hey, people type all the time, they have to go back and fix. If you can do it for them, that's better. I think you can look at it from that perspective, but I just think a lot of startups tend to go for the co-pilot thing because bluntly, I think it's the easiest thing to do.

0:35:44

Hey, write an idea for a blog post and we'll suggest the opening paragraph. Whoopity do. It's not really a huge thing. What might be a huge thing is find the most common SEO terms that we're not ranking for and suggest articles we should write. And write the articles and go to Dolly and create the images and then suggest them back and then criticize them. And now I sit down in front of twelve suggested articles that are fully specked out.

0:36:05

Now I'm starting to think, huh, this could be replacing a workflow. Everything else is just a little bit of nicety along the way, I think. As an investor, how much have you seen that is exciting in this spirit? I would have to say I see much more of the what I would call like the easiest API call type AI. That is honestly right now the majority of what I see is not amazing. It's very much just we also know how to summarize a piece of text or change the tone of a piece of text or whatever.

0:36:38

And that could be like we're a sales tool, but we can guess the opening introduction in your paragraph or whatever. And I think those things are basically dead in the water. I think stuff like, say, what rewind AI are doing, I think is far more powerful. Drinking in a massive amount of data and then giving me a natural query engine on top of it. I think that's like really exciting. I think some of the visual stuff I've seen, be it like mid-journey or be it like there's one I've invested in called Kettle, where like again, you just describe the visual of what you want, and they produce a vector.

0:37:05

And what's really cool about a vector is you can actually tweak it yourself then if it's not exactly what you wanted. I've seen really good examples of that type of thing. But I do believe that we have yet to get to the bottom of where the AI the high order stuff I'm describing where it's like complete automation I think a lot of that's still to come The question for me is will it come from the incumbents or not That's still I think an open question in a lot of these industries The biggest question I always try to zoom in on is I know AI is really important and it's core to this new workflow that you're going to automate or

0:37:53

whatever Talk to me about the rest of the products that you're building around it And this sounds like it's maybe perhaps not the sexiest answer to give you but I think a lot of folks have forgotten that you still have to build world class software these days and genuinely it's not I think you said previously on Twitter something to the lines of like strategies for amateurs and executions for winners and I think having a cool idea for an AI feature is genuinely can be unique and maybe you spot a capability that others haven't but in most cases you still have to go and build an incredible piece of software around it So you might have a unique twist on how

0:38:26

project management should be done, and it involves a bit of AI, and that's awesome. But you still need to have a PM tool that's as good as linear, and that's still going to be a huge amount of work. So what I try to do is shift a conversation to there just to make sure that there's actually something behind this. Because my fear in so many of these AI cases is that we're all just pinging text over to OpenAI.

0:38:49

And these prompts and these bits of text, they might be proprietary. You might have a bit of an edge there. You might do some clever shit client side before it goes over there. But it can't be that you're the only person who's worked out the right prompt. If you're investing in something that is built on AI, the thing that you're doing still has to be pretty brilliant, which might mean really good integrations, really rich platform, beautiful UI, et cetera.

0:39:11

The only other area I'd say I've had some interesting discussions in is, and again, I don't know if this will fall into incumbents benefit or startups benefit, is this idea of chat driven UI. So I'm sure there is at least one piece of enterprise bloatware that you use in your day to day life that is just awful. For me, it might be, say, Workday or Coupa, or one of those tools, where the tool is just so deeply complicated.

0:39:32

And alls I wanted to do was file an expense or request a day off or something like that. And the next thing, you know, I've nine tabs open and I've got three drop down menus and I'm still none the wiser. I really, really in those tools want to press Command J, book des October seventeenth return or something like that. I think chat UI will be a massive impact to that whole industry where the way I describe this is when the user knows what they want to do, but they don't know how to do it in your insanely powerful or complicated to be complimentary.

0:40:03

When the user knows what they want to do, but they don't know how to achieve it, that's when chat UI is really going to take off. And I don't know if you saw equals the spreadsheet tool. Yeah, a little bit, not much. So equals is basically a spreadsheet tool. One of the things they have built in is AI, another thing they have is live data sources. But the cool thing I like about the way in which they've used AI is I don't know Excel query language very well.

0:40:22

And with equals, I don't need to. I just say sum up all of these before that were expensed before January seventeenth and multiply it by the CPC return. And it works it out. So you can literally write Excel queries in natural language. You can also write SQL queries in natural language too. So what that does from my point of view that has made the spreadsheet an infinitely more accessible tool to millions of people who never were going to learn Excel.

0:40:46

And I think that's where you can blow up your total addressable market just through the magic of a chat UI. So I think that's another area of excitement for me, where when I see a sustainable advantage that the chat UI would open up, that's another thing that gets me excited. How do you think about the risk side of this? You mentioned earlier, like finance or banking or maybe healthcare, places where certainty is more important than in other places.

0:41:51

And in Excel, I guess it's the same thing. If this is lower stakes or approximations are fine, then that sounds amazing. But if this needs to be precisely right, then great. I'm glad I can write the query for them. But then I still got to go double check that the query's doing the right thing. And in customer service, I'm sure there's elements of this too, where some things are really easy to handle. You're just pointing someone at the right document or something.

0:41:59

But sometimes it's criticality rises and the cost of error goes up, and then you start, you start to then worry about these models. So how do you think about tail risk of a big, complex thing that we don't really know how it's working, but it just works most of the time, but we need 100% of the time. Yeah, and to make it more complicated, because you've unlocked a wider addressable market, the person will not identify the mistake.

0:42:06

I won't know if there's a bug in the Excel stuff because I didn't know what it was supposed to look like in the first place. I think that this is a genuine risk. So the answer I'm supposed to give you is, and that's why there's always going to be human in the loop. And you turn this around. So rather than doing it for the deses of the world, you do it for the person who actually builds spreadsheets for des.

0:42:13

And you said you speed them up. And I think that works to some degree. But we even see this with, say, assistive driving AI, where the person has their hands in a wheel, but they're not paying anywhere near amount the same of attention as they used to, because they know the car is actually driving itself. So you actually have this challenge of when criticality is high, should AI basically be left out? Do we need to have a higher threshold?

0:42:31

How do you define that threshold? When it is purely generative, it's hard to say. I can tell you what we do in Intercom is we have a separate product to Fin called Custom Answers. And what Custom Answers does is more of, how would you say an old school traditional AI existed before November. And in that case, its behavior is quite different. It works something like if this query looks like it's relating to an important topic let's say refund or locked out of my account or authentication then so that's your AI there it's just like if fuzzy logic matching then and then we have a very specific answer and what we do is we use custom answers to target really specific

0:43:09

things where we have a precise set of steps and we actually can't afford to have generative conclusions we actually need to control every word that is said A lot of our customers use Fin and this together and they just effectively splice out stuff that sounds incredibly important and let Fin take care of the rest. But even at that there's still going to be a weakness there somewhere. If you keep scratching and sniffing you'll find something that actually turned out to be more important than it sounded.

0:43:33

I think this is this fuzzy world we're all heading into where things will be possibly more wrong than they used to be. But they'll happen in real time as opposed to taking days weeks months depending on the task being optimized. I do suspect this is why you won't necessarily see GPT used in doctors diagnosis apps. They might speed up the doctor, but there'll still need to be a human in the loop. And we just have to hope that, say, the driver in the AI augmented car, that they're still fully switched on to what's actually going on and they're not just copying and pasting shit out of ChatGPT or whatever.

0:43:57

But I think this is a new world we're entering into. There's no denying it. There are gates and there are railings, but there are no, I don't think, any guarantees. It's hard to take new technology into society and prevent all its downsides. As an investor, I'm really curious how you are, whether it's different or the same as you've always viewed this as an investor. But the first time we talked, you had some really interesting thoughts on just the things you look for in young companies.

0:44:06

Even since intercom started, the friction and expectation for starting companies has changed. There's so many of them. YC batches are so much bigger. If there's a whiff of an opportunity, all of a sudden you get twenty people leaving their jobs to start a company. It's amazing. It's great. The world benefits from this, for sure, but I think it makes investing harder, especially given sometimes the prices are quite high. How have you evolved as an investor? What are the things you're looking for?

0:45:01

Any philosophical changes over your investing career? And then I'll obviously talk specifically about the change that LLMs have on that too. Early days, I used to get fooled a lot by just a great looking product. I mean, I would fill this probably the wrong word, because some of them actually work there pretty well. But just I thought if you could build software that that was enough almost. And in some cases, some of my earliest investments that actually turned out to be enough of a judgment, but not certainly in later years.

0:45:18

Beautiful UI and stunning landing pages became more commoditized, or like maybe more easy to do for people. And as a result, it was probably easier to fool me at least, but I'd suspect probably easier to fool half the industry. So I think I've learned now that a product can be a really, really nice, beautiful execution, and perhaps still just not work out. And I actually had one of those recently. It was a meeting like a Zoom competitor that was built with AI inside it for identifying action items and all that stuff based on what people were saying in the call.

0:45:49

And it would produce meeting notes afterwards, and it was incredible. It would produce a highlights reel of the conversations. You could zoom into the exact specific moments that mattered, et cetera. It sounds cool. Problem is, no one wants to pay for that on top of Hangouts on top of Zoom, full stop. But the product, if you saw the product today, you'd be like, that's insanely brilliant. It's awesome. It looks great, it works great. I've used it many times, et cetera.

0:46:08

But if you try and take it to a company and say, well, you pay seven a head for this on top of your Zoom fees, and you're already probably buying the G suite anyway. The answer just basically says no. So that's one thing that I've just become more wise to, which is, and it sounds so stupidly obvious when I say it like that. But the route to market times the user's propensity to put their hand in their pocket is a real thing.

0:46:27

And in those cases, Zoom already has the route to market and G suite is already there with their pseudo monopoly on all things productivity inside a company. Another change I've just been trying to distill of late has been, um, I find myself asking startups the same question a lot lately, which is what is the single thing you can say that is unique to you, valuable to your user, true and simple. And all four things matter, and most people fail on one of the four.

0:46:54

It's either too complicated the pitch, or other people can say it, or your users don't give a shit, or it's not true. And that has been a really impressive. And I often say this if it's a random company I've barely know or a light or weak intro. I often say it as a pre-qualifier to actually bothering to take a call or even sometimes reading a pitch deck. And that's a maturity that I didn't have. I would have heard the pitch five years ago and gotten really caught up in how nice the product looked and all that.

0:47:18

Whereas now I find if you fail at that hurdle, the chances of you being a really successful business, the outsized outcome that makes angel investing make sense is pretty slim. And then the third one I just continue to beat a drum about is just execution, and I won't say too much about it because I know you agree. If your idea is any good, you should assume it'll become commonplace and everyone will have that idea because they're going to see your version of it.

0:47:38

And then everyone's going to try and do it. And if someone does a lot better than you, or can do it the same as you, but faster, you're going to lose. It won't be close. You will definitely lose. First really doesn't mean a whole lot unless you helps you build a bit of a brand, maybe, but you'll get outpaced pretty quickly once somebody has a feature you don't. So I care a lot about do defenders get that?

0:47:56

And if the defending team isn't super technical, as in they can't design, build, execute their own software, then I always worry about that because they often don't. How did intercom itself solve that execution problem? Because I think relatively early on, people realized, oh yeah, this is a thing. This is a good idea that there's a simple digital way to interact and connect with my customer in the space that they are. I'm assuming I don't know much about intercom's early history, but I'm assuming that lots of people tried to do this, and you won.

0:48:37

So is the simple answer just execution? You just went faster and basically followed the advice you just gave about investing, but for building. I'd love to say yes, but it would sound arrogant. I will say, like, we had a shitload of competitors, copycats, people who are just literal right click view source, let's have some of that messenger code. And there are still many. There are people who literally just copy our source on a regular basis. I think ultimately what our customers know is that if you want the latest and greatest intercom, that's the company that has it.

0:48:54

And I think a bet on intercom is a bet on the persistent position as the people who are doing the newest stuff best. And that's why it surprised basically none of our customers when we launched AI ship. Because the tone we heard back from a lot of them was like, of course, you guys should go first. For a lot of our customers, that's why they signed up. And we talk a lot about this. We even publish.

0:49:13

If you go to Intercom dot com slash changes, you'll see the rate of release from our product team. We're just consistently grinding, making things better. I think I've heard it glibly referred to as like the gingerbread man strategy, which is run, run as fast as you can. You can't catch me. <ev:laughter> That's our thing. You can copy and you can copy, but it's going to be consistently yesterday's technology tomorrow. And that's not what customers want. They want the best stuff out there.

0:49:36

So I think we do talk a lot about speed internally. If you talk to any of the intercom folks, they'll be like, they're sick hearing about it. And it's not just speed again, it's encoded really hard, hands on the keyboard type stuff. It's speed is in processes, decision making, et cetera. I think for what it's worth, a pet theory, I have all saas is basically ui on top of databases. So everything is copiable pretty quickly. The goal is to get a position that looks daunting to copy.

0:50:00

If you're trying to build a project management tool and you're saying, hey, let's rip off linear, you're going, oh, well, there goes the first two and a half years of our roadmap. It's a tough one to take on. Same with Stripe, and I'd hope same with intercom or whatever. You just look at them, you're like, shit, we really have to build all that. We're going to be at this quite a long time. And by the time we've done it, those guys move fast.

0:50:17

So by the time we get to where they are today, they'll be long gone. And that's the hope that you can build with just raw product momentum as a moat, if you will. Do you worry about, I guess I'll call it the Red Queen effect of that style of building relative to, I'm trying to think of an extreme example, like Visa or something, which notoriously is an extremely good business because they built an unassailable competitive position, but there is no speed at Visa.

0:51:14

If anything, it's better to have more bureaucracy, like, don't screw up this position that we've carved out for ourselves. There's no product velocity at Visa. Running faster than everybody seems like a great way to win, and I think it is. But do you think it's necessary but not sufficient? And ultimately, you need to get yourself in a visa like position of, even if you wanted to copy this, and you also moved really, really fast and had unlimited resources.

0:51:21

There's something about it you just can't even copy, whether that's this is like classic moat question. How do you think about that for intercom? I think this to me is honestly where a brand comes in, and that's ultimately you need to build. And we're in the middle of undergoing pretty extensive distillation and rebrand, if you like, of what Intercom's all about. But I think you need to transfer the energy that's felt in a product momentum into being a sort of sustainable brand position.

0:51:30

To ultimately get to a place where it's just, why wouldn't you just use Intercom? That's, I think, the best way to turn a dominant product position into a sustainable thing where you become the. It would just seem odd to not use Slack or Stripe or Figma or Intercom or whatever. It's just, why wouldn't you? And I think because all those tools you have to assume will get caught eventually because in IDN or something like that will whatever Stripe release now they'll have it in two years so there will be some eventual there is not infinite runway in all feature sets eventually you start releasing shit just for the sake of it and that's a dangerous place to be so the

0:52:03

goal as you're doing this is to transfer the credibility that exists provably in your software into the brand and ultimately capture hearts and minds from that point of view And then there are other like more tactical things community evangelism advocacy making sure you reward the people who use your product the most then there's the technical version of that which is integrations and interoperability do you fit much better into the tech stack than everyone else does do you sign good partnerships and good data share agreements if you use intercom plus GitHub or Jira it works really well together and if you try and use new app with the same it'll be harder for them to get the same co promotion the

0:52:36

same partner status whatever so there's other aspects to it as well But I think job one is to honestly have the best product and the best way to do that is to move really, really fast. Job two is to transfer it out into being a brand position rather than a technical position. And then job three, I think, is to then expand your tentacles into everything else. Said, hearts and minds of your customers, partners, et cetera. One of the prevailing ideas in the business world is that the pure software business is the ultimate in business because it has very high margins, it can have very high retention, sometimes doesn't necessarily require a ton of upfront capital to get going.

0:52:52

It's a beautiful thing. If you're on like a debate team or something, and I force you to take the opposite side to say, actually, like, here's the bad things about software businesses. Here's why it's not a panacea. Here's why you should consider building something other than software. What would be your debate points? And I ask this as somebody obviously that's done this, that's succeeded in doing this at a company that's grown very large. What would be your contra points in that debate?

0:53:41

I think the two things come to mind, obviously, because the debate had prepared, but two immediate things come to mind. One is there are very few durable moats in software. So whatever it is you have, it's almost by definition going to be copied. Someone will infer the database structure and right click, copy the UI, and all of a sudden they have the guts of your product. So that's a challenge. And we don't really play the patents game.

0:53:57

Um, we don't really play the exclusive partnership game in software in general. We generally tend to put it on the internet for everyone. So whatever your piece of software is, assume everyone's coming for it. And then also the second piece, which is just as important. Software has a really, it's very perishable. What it took to be best in class in project management, even just three short years ago, is nowhere near good enough for today's standards. And there are not a lot of categories where you can have a great product and also know that it's going to be dated as hell in thirty six months.

0:54:29

But software is one of them, so you have to continually reinvest to maintain your position. That's the first. If you compare that with other areas, other non software areas you might go into, you'd find industries that don't have those two traits of insane perishability and lack of a moat of any sort, really. The third one is more of a perhaps a nuanced point, but there's a tension in software in general, which is the ideal software is one line of code that everyone uses in the exact same way and it's got a massive margin on it and needs no maintenance.

0:54:59

But in practice, in order to get a second customer, you usually need a second line of code, and the thousandth customer needs another line of code. And if you're chasing an actual trying to grow a business, the more customers you're trying to attract, usually the more at least settings and preferences that you have to add, so that you work a different way for enterprise than you do for startup or whatever, permissions. All that shit. Which means the product just keeps getting bigger and bigger.

0:55:23

And if you wanna have a large market, you generally tend to have to adopt loads of different styles of workflows. And that means loads of different code, and that means more complicated U I. So, in essence, for a product to be big and successful, it has to get worse. It get worse for any individual, but better from a market capture point of view. So you're constantly trying to find a sweet spot along the collision of those two lines.

0:55:44

How big is the market and how simple can the product be? And what you'll find is to maintain a large product, because in a very product with a large, total addressable market, you usually have to have a lot of software. And bearing in mind, as we just agreed, that software is both not protected by any moat and it's going to age, uh, pretty badly, pretty quickly. So you have this tension of the need to continually reinvest.

0:56:07

And now you reinvest lots because it turns out to go for a large market, we've built a shitload of software. And that is just a difference. This bottle of coke is the same one that Barack Obama would drink and the same one that Bill Gates would drink, and I'm drinking it and some rando on the street would drink it too. That's not the case in software. If we wanna say, hey, we do ticket tracking or we do customer support, or whatever, the YC startup, the fifty person company, the 505,000, the 50,000, they're.

0:56:32

It's a whole different ball game at every level. Yet if you say we wanna be it for number one for the entire industry, that's a lot of if statements to deal with all those workflows, and every one of those if statements has a team of engineers and PMS and designers behind it. So you have that tension of market size versus product quality, and it's a hard puzzle to solve. And again, there are other industries, in this case Coca Cola or whatever, where they don't actually have to pay that game.

0:56:55

So that's my other thing on software to invalidate my own career.

0:56:58
Patrick O'Shaughnessy

It's an amazing, amazing answer and list. Does it stand to reason then that the best software ever is Bitcoin?

0:57:05
Des Traynor

Oh, possibly. I actually there are a few software products I've seen. To give you a shitty example, just say, like, the notes app on iOS, where actually I know mega corp people and I know aged old grandfathers or whatever, and they all use notes. So there are some products that cut through and just say, we are one thing and we're that one thing for everyone, and you all like it. And I think that's really, really cool.

0:57:26

Another example would be, say, bear dot app, just a really nice note taking tool that I use, where they've just one product for everyone, but everyone uses the product and everyone uses it roughly the same way. So you get a lot closer to the idea of liquid profit because they just need to build one thing for one person and it works really, really well.

0:57:41
Patrick O'Shaughnessy

Maybe Craigslist belongs on the list or something.

0:57:44
Des Traynor

Yeah, for sure. I think there's a lot to be said about something like Craigslist in that regard, and that they dodged a lot of bullets by keeping it simple. And the flip side is, imagine if Craigslist had VCs, imagine the ways in which it would have gone wrong. Because they would have been pushed for growth, pushed for growth, they would have added features, they would have gone through pointless redesigns and rebrands and all that, and they probably would have honestly lost their way somehow.

0:58:05

So I can't comment on Bitcoin specifically. I always feel that I'm just I'm under going in terms of knowledge. But I do think a simple thing that loads of people use the same way is a really nice place to be. But I can't help but feel the wolves would be constantly at the door, trying to copy exactly your thing because it looks so easy.

0:58:20
Patrick O'Shaughnessy

Well, what's interesting is when you think about the different counter examples, maybe Twitter's an interesting one here. Not that it's ever been a great business, but it's more or less been the same. The product velocity is not high, so the value is the network. Or maybe the other examples would be vertical market operating system software, where the software also sucks there, but the data store that gets dumped into this thing is so valuable that no one bothers to switch because, oh, my whole business is built on this thing.

0:58:48

So maybe your point is right about, you know, all software is just a database and some U I on top, and you should think more about the database either as a network of people or critical information that a business is storing inside of it, and that's it. You just invest in one of those two things and avoid everything else. Avoid workflow, avoid nice U Is, like you said, it's a fascinating question.

0:59:08
Des Traynor

It is. It's unfortunately what we have to spend our lives trying to wrestle with. But yeah, I don't wanna the wrong way to parse all this is that he thinks the U I doesn't matter. It absolutely is not the case. It's just that does not think neat U I is a sustainable position, and to make it sustainable, you have to be maniacally investing in it all the time to keep it as the Michelin star project management app or whatever it is in order to stay at the top.

0:59:28
Patrick O'Shaughnessy

You have other worldviews that would be spiciest at a dinner table conversation or something to rile people up.

0:59:35
Des Traynor

Jeez, yeah. I have a whole folder of things that Des can tweet.

0:59:38
Patrick O'Shaughnessy

Give us one or two.

0:59:40
Des Traynor

Here's a hot take right now that I've seen a lot of my own portfolio go through, and it's not a positive one. But I'm sure you see a lot of investment reports that go like this, hey, we're a series A or series B. We've managed burn, we've executed a riff, we now have seventy four months of runway, and we feel really good about that. And what I translate that to is I am gonna piss away six years and two months of the best productive years of my entire career, pushing this boat up a hill to see if it gets to the top, and it's not going to.

1:00:10

And honestly, I wanna reach out to the founders and connect with them on a human level to say, hey, neither I nor I don't think many of your VCs, who are actually good humans, wanna see you do that. I think you should set yourself a time limit of like six months or a year to get this thing growing. And if it doesn't, wrap it up. It's not cause I want the money back. It really isn't. It's just it's such a waste of human capital.

1:00:33

I think what happens in an existential crisis is people try to preserve their life, and you have to realize your life is not your startup's life, and there's a line between them. And the worst thing that happens to you isn't that you go out of business. The worst thing is that you stay in business, banging your head off a wall.

1:00:49
Patrick O'Shaughnessy

Waste your time in your life.

1:00:50
Des Traynor

And in both cases, I'm not seeing my money back. But at least one of them, you're not emptying the best years of your career. And I think that's probably one where, even as I'm saying it now, it sounds still too blunt. But the point I don't think is talked about enough right now, there are a lot of companies that are dead by definition based on their last round or their last two rounds valuations. And honestly, I don't think that suits anyone.

1:01:11

I think even from a venture capital perspective, I think they'd rather take the scraps or the pennies on the dollar back. They'd probably back the founder again, just under a different market conditions. 2021 was a hell of a drug. We all lost our run of ourselves, and that's okay. You don't have to pay the full price of that. The last thing I always say to people is you have to measure the R O I of the time you spend based on the future expected value of it.

1:01:33

So go and arrange or with your friends and wake up hungover, that's fine. As long as you feel like those friendships and those memories are gonna be useful to you in the future. Great. Similarly, whatever you're doing with your business, think about it from a point of view of when you're like fifty, or take your age and double it or whatever. Will you value the things you've been doing right now? A lot of this is my way to get people to stop scrolling Instagram or TikTok or whatever, cause this is not a useful use of time.

1:01:56

But I think it's quite easy. I say this cause I probably regret most of my twenties in this regard, but it's quite easy to go through life just too much in the moment, such that you forget to actually think about the compound and interest of the time you're spending. And I think by the time you realize that that shit matters, you're like thirty. And I'm haunted by this quote that is I read it somewhere inside every eighty year old is an eighteen year old wondering what the fuck just happened.

1:02:18

And I think that's something that, That's Uh, haunts my mind. scary. Which, yeah, it is scary, cause I'm forty two, so I'm already starting to wonder what happened.

1:02:26
Patrick O'Shaughnessy

I've so enjoyed talking to you from the early days of when you were conceptualizing Fin, and it's been such an interesting example for me to watch of really talented team and company approaching something new that could be this disruptive innovation story, but in many cases, yours included, I don't know, it's always different, and it's always interesting to see how companies handle this. I've so enjoyed our conversations on this one, too. I ask the same traditional closing question of everybody, and I'm bummed we're out of time.

1:02:52

What is the kindest thing that anyone's ever done for you?

1:02:55
Des Traynor

I'll try and stay emotionally neutral as to tell this story. I wrote about this story on my blog, but when I was growing up, it was nineteen eighties Dublin, not a very rich place. My dad had left home. My mom was left. I'm the youngest of seven children, and I had three older brothers, three older sisters. And in 1988, when I was seven years old, I basically was obsessed with this computer called the Amiga 500 by Commodore.

1:03:16

I don't know if you remember it. And one of my friends, one of those just seemed like the coolest thing ever. And I just wouldn't shut up about it. Clearly, I just wouldn't shut up about it. And I guess I was still just at that awkward age where I was too young to work out why I couldn't have one, cause basically my friend had one, therefore it was gettable. So why didn't I have one? And I guess my mom didn't even know how to explain.

1:03:34

Per this nineteen eighties Dublin divorce, well, divorce wasn't even welcome in Ireland at that time. So it was just, why does this woman not got her husband anymore? That was how Catholic Ireland would have seen it. And then one day, for my birthday, I think it was my ninth birthday. I'm not even that sure. I think it was my ninth birthday, showed up. And at the time I was really thankful, but it was only really when I was like twenty five or something like that, that the actual penny dropped of like, how the hell did she pull that off?

1:03:57

And because of, genuinely, I can give you a full lineal history because of the Amiga 500. I learned Amiga workbench, I learned A M O S, I learned how to program bits of memory. I enrolled in computer science. I met a guy, we started a blog. I met own, who's the C E O of Intercom. I met my wife at the same meetup that own had organized, where I met him for the first time. The entire history of my career goes back to that one machine.

1:04:22

I still don't really know how she got the money together for me, but she did, and that was the kind of thing. I only hoped I could pay her back, but she passed away, unfortunately. So whatever costing 700 Irish pounds, which is probably like a grand or something like that in dollars. I would have loved to have, now that I've got some money, I would have loved to have paid it back, but that opportunity was never presented.

1:04:39
Patrick O'Shaughnessy

It makes me really interesting to think about what equivalent thing could you do to unlock a path like that for somebody else.

1:04:47
Des Traynor

I think about that a lot.

1:04:49
Patrick O'Shaughnessy

I think that is an incredible question to think about, and probably more often than not, it's something that's maybe doable. It's the thought about what it could be, and then going and doing. It is a magical, wonderful, awesome story. I've done a lot of these. I think around 400 or something, and I haven't heard a story quite like that in response to the question. So, what an awesome place to close. Thank you so much for your time.

1:05:11
Des Traynor

Thank you, Patrick.

1:05:13
Patrick O'Shaughnessy

If you enjoyed this episode, check out joincolossus dot com. There you'll find every episode of this podcast, complete with transcripts, show notes, and resources to keep learning. You can also sign up for our newsletter, Colossus Weekly, where we condense episodes to the big ideas, quotations, and more, as well as share the best content we find on the internet every week.