OpenNashPodcasts

The Cognitive Revolution

No Code Is Code: Zapier CEO Wade Foster on Headless Tools, Zapier MCP & Automation Bench

17 Sep 2026 · 1h 6m · Nathan Labenz, Wade Foster · 23 quoted facts

▶ Play episodeOriginal source ↗

In brief

Zapier CEO Wade Foster argues that most people now work from one 'daily driver' AI tool such as Cursor, Claude Code or ChatGPT. Software companies therefore need to be 'headless', meaning they plug into that tool instead of asking people to come to them. He also says AI should handle only the steps that truly need reasoning. Ordinary code should do the rest, because it is cheaper and more reliable.

The tension is between fast-moving AI hype and slow real-world adoption. Zapier's benchmark shows the best model completing only about 40% of realistic office tasks, and most people have barely tried AI. Foster's answer is structure: have AI build deterministic workflows, use several agents to cross-check each other, give AI the company's context, and keep humans accountable for what they ship.

Key insights

  1. Most AI agent work should be plain code

    Foster says about 80% of what customers use agents for would be better served by old-fashioned deterministic code. It is cheaper and more reliable, so AI should be reserved for steps that need reasoning.

  2. Even the best model fails most office tasks

    On Zapier's AutomationBench, roughly 600 realistic knowledge-work tasks, the top model completes only about 40%. Foster says Zapier aims to raise that score by giving the model tools and teaching it when to use code instead of AI.

  3. Several agents agreeing signals a correct diagnosis

    Zapier's support automation runs five independent agents on a problem, and when four agree the answer is usually right. Human thumbs up or down, with reasons, feed back in to improve the system.

  4. Seat-based software pricing is giving way to usage

    Foster argues that when intelligence is the product, a fixed per-seat price makes little sense. He expects usage-based pricing for commodity products and outcome-based pricing, such as billing per resolved ticket, where success is clear.

  5. Public-by-default communication makes AI more useful

    Zapier encouraged employees to talk in public Slack channels because its agents work much better when they can see company context. Sensitive matters such as HR incidents and active security issues stay private.

Questions

What does it mean for software to be 'headless'?

It means the tool works inside whatever AI app a person already uses, instead of making them visit its own interface. Foster says this is the winning approach, and Zapier's MCP server (a standard way to plug tools into AI apps) does this.

Why shouldn't I just let an AI agent run my business workflows?

Foster says most workflow steps are better handled by ordinary code, which is cheaper and more predictable. The AI should build and repair the workflow and handle only the parts that truly need judgment.

How well do today's best AI models actually do office work?

On Zapier's AutomationBench, which has about 600 tasks across marketing, sales, HR and operations, the best model succeeded on about 40%, according to Foster. He says the benchmark is far from saturated.

Is AI changing everyday life as much as people expected?

Foster and Nathan both say not yet. Foster notes his friends and family mostly use ChatGPT for things like meal and vacation planning and are not using the most advanced models.

How does Zapier keep employees from overspending on AI tokens?

It has no individual budgets yet, but it built dashboards so people can see their spending and compare cheap and powerful models. Foster says he expects token budgets eventually and often just talks to heavy spenders to learn what they are doing.

Facts

Stated by the speakers. Each quote matches the transcript, which shows what was said, not that it is true.

By September 2024, about 400,000 Zapier customers had used the platform to delegate more than 100 million tasks to AI, according to the host.

“When I last spoke to Wade in September of 2024, some 400,000 customers had already used Zapier to delegate more than 100 million tasks to AI.”

0:00:00 · Nathan Labenz · Zapier adoption · 2024

Zapier CEO Wade Foster says he mostly uses the Cursor AI coding tool as his daily driver.

“Yeah, so I mostly use cursor every single day.”

0:08:46 · Wade Foster · Daily driver · 2026

Wade Foster says the newest top model scores about 40% on Zapier's AutomationBench, the highest result on that benchmark.

“It performs about 40% of the tasks accurately, which is the highest that there is.”

0:10:21 · Wade Foster · AutomationBench · 2026

Wade Foster says Zapier's AutomationBench contains roughly 600 tasks resembling normal knowledge-work workflows across disciplines such as marketing, sales, HR and operations.

“So we have probably 600 tasks that are of that variety that describe like a normal knowledge work workflowy task”

0:13:45 · Wade Foster · AutomationBench · 2026

Wade Foster says about 80% of what Zapier customers use AI agents for would be better done with deterministic code.

“the vast majority of what people are using an agent for 80% in fact, they probably should be using actually old-fashioned deterministic code.”

0:15:08 · Wade Foster · Agents vs code · 2026

Wade Foster says building workflows with no-code boxes feels antiquated and that AI now does the building, summing it up as 'no code is code'.

“the idea of building a no code, it feels antiquated to me. It's like the new code no code is code.”

0:18:02 · Wade Foster · No-code · 2026

Zapier's automated support email program runs five independent AI agents to evaluate each troubleshooting case, according to Wade Foster.

“it spins up five agents, independent agents that evaluate the troubleshooting situation.”

0:25:23 · Wade Foster · Multi-agent support · 2026

Wade Foster says the automation market is far larger than he imagined when he started Zapier about fifteen years ago.

“The market for automation was like orders of magnitude bigger than I ever thought it was when we started the company fifteen years ago.”

0:33:32 · Wade Foster · Automation market

Wade Foster says he began a weekly AI review of his activity at the start of the year, and it has produced new tools that automate parts of his job.

“I started doing this workflow at the beginning of the year, and pretty much every week now, I have new tools, new systems that start to automate bits and pieces of my job.”

0:38:01 · Wade Foster · Weekly automation · 2026

Many Zapier employees run a weekly automation that gathers signals from their work across apps and suggests tools to build.

“they'll just have an automation that runs once a week and it just kind of collects all these signals across all the work they've done.”

0:39:40 · Wade Foster · Weekly automation · 2026

Wade Foster says it is very likely Zapier will offer its weekly activity-review automation to customers as a product.

“Yes, I think it's very likely that'll come in some form factor.”

0:40:57 · Wade Foster · Product plans · 2026

Wade Foster believes per-seat software pricing is largely dying in favor of usage-based or outcome-based pricing.

“for the most part, seat based pricing is dead, we're dying.”

0:42:27 · Wade Foster · Pricing · 2026

Wade Foster notes that many customer support AI tools use outcome-based pricing by billing for resolved tickets.

“you see a lot of the like customer support tools doing this. Where we're going to say, hey, and we're going to you're going to we're going to bill you for resolved tickets.”

0:43:21 · Wade Foster · Pricing · 2026

Wade Foster says that within about a year of ChatGPT launching, nearly all Zapier employees were using AI daily.

“we got within a year or so, basically of ChatGPT launching, almost like 100% of the employee base is using AI day to day.”

0:47:12 · Wade Foster · AI adoption · 2023

Wade Foster put Zapier's then chief people officer, Brandon, in charge of AI transformation because his team was already strong at job redesign, compensation and reskilling.

“it turned out Brandon, our chief people officer at the time, was, like, really good at doing a lot of these things.”

0:48:12 · Wade Foster · AI transformation · 2026

Zapier has long had a company value of defaulting to transparency, which preceded its push for public-by-default communication.

“Zapier's had this value of default to transparency for gosh forever, it feels like.”

0:50:03 · Wade Foster · Company culture

Zapier's executive team started a friendly competition to see who could put the most communications in public channels, which grew into a company-wide encouragement.

“one of the things we started to do on our executive team was we just had a little fun competition to see, hey, who can put most of their communications in sort of a public channel.”

0:51:05 · Wade Foster · Public by default · 2026

Wade Foster says Zapier has held customers' service credentials for fifteen years and treats protecting them as a core responsibility.

“we've held these credentials for fifteen years, right? So this has always been like a an important thing inside of Zapier”

0:53:07 · Wade Foster · Security

Host Nathan said Wade Foster had tweeted that some Zapier engineers were spending about $30,000 a month on AI tokens.

“I saw you tweet not too long ago that you have some engineers spending $30,000 a month on tokens at Zapier”

0:54:52 · Nathan Labenz · Token spending · 2026

Wade Foster describes Zapier as an organization of almost 800 people.

“when you have a almost 800 person organization, you're there's just a big education effort.”

0:56:37 · Wade Foster · Company size · 2026

Wade Foster expects companies, including Zapier, to eventually assign AI token budgets to individual employees.

“I do suspect that token budgets are gonna be a real thing, though.”

0:56:37 · Wade Foster · Token budgets · 2026

Zapier's guidelines for AI-assisted communication say employees must own what they send and spend more time authoring it than the reader spends reading it.

“you need to own what you sent. If you wrote it, you probably should be putting more time into authoring the thing than the reader is reading it.”

0:58:32 · Wade Foster · AI writing · 2026

Wade Foster says that because employees now do their own basic data analysis with AI, Zapier needs fewer data analysts, who work on higher-value problems.

“Similarly, data analysts, everyone inside of Zapier is kind of their own mini data analyst now, and so you don't need, quote unquote, as many data analysts.”

1:01:24 · Wade Foster · Team changes · 2026

Chapters

  1. 0:07:07Why the 'daily driver' AI tool matters

    Foster explains that people now pick one main AI tool, so platforms like Zapier must plug into it instead of competing to be it.

    “most folks seem to have adopted their own daily AI driver tool”
  2. 0:15:08AutomationBench and the case for deterministic code

    The benchmark shows models still miss most realistic office tasks, and Foster argues that most agent work should be plain code with AI used sparingly.

    “they probably should be using actually old-fashioned deterministic code”
  3. 0:25:23Multiple agents and feedback loops for troubleshooting

    Zapier uses several independent agents and human ratings to diagnose problems, a practical method for improving reliability.

    “when four of the five agents tend to agree”
  4. 0:32:04Competition and the 'sea of sameness'

    Foster argues the real competitor is non-adoption, since most people have barely tried AI tools.

    “sort of sea of sameness out there that is a real challenge”
  5. 0:38:01The weekly automation that suggests new automations

    Foster describes a weekly job that reviews his activity across apps and proposes tools to build, which Zapier may productize.

    “pretty much every week now, I have new tools, new systems”
  6. 0:42:27Why seat-based pricing is fading

    Foster predicts a shift to usage-based or outcome-based pricing as AI makes software resemble purchased work.

    “for the most part, seat based pricing is dead”
  7. 0:47:43Putting the chief people officer in charge of AI

    After near-universal AI use, Zapier's remaining problems were about jobs, pay and team structure, so the people team took the lead.

    “the challenges start to look like a lot more like people issues”
  8. 0:50:41Public by default and AI context

    Zapier pushed communication into public channels because its agents perform better with fuller company context.

    “our AI agents were just so much more effective”
  9. 0:58:32Token spending and owning AI-assisted writing

    Foster covers dashboards for self-policing token use and his rule that people must understand and stand behind AI-assisted work.

    “you need to own what you sent”
  10. 1:01:24How AI is reshaping Zapier's team

    Roles persist but management layers flatten, and humans increasingly design the 'factories' that do the work.

    “a flattening of management layers”

Transcript

0:00:00
Nathan Labenz

Hello and welcome back to the cognitive revolution. Today I'm excited to welcome Wade Foster, co-founder and CEO of Zapier, back to the show. When I last spoke to Wade in September of 2024, some 400,000 customers had already used Zapier to delegate more than 100 million tasks to AI. And YC President Gary Tan was calling Zapier the AI powered knowledge worker of the future. Since then, models have, of course, become dramatically more capable, and Zapier has built out a full AI portfolio, including agents, chatbots, an MCP server, an SDK, and an AI guardrails product.

0:00:41

And yet, somehow, white collar work and the world as a whole have changed much less than I would have expected. With that in mind, I wanted to hear not only about what Zapier has built and how it's continued to evolve as a company, but what Wade and team have learned about how businesses across the economy understand and use today's AI tools. At a high level, Wade believes that most people are now settling in to using a single daily driver, whether that's called code, chat, GPT, grok bot, or, in Wade's case, cursor.

0:01:13

And that platforms like Zapier will need to adapt by making their tools available and effective in those environments. Practically, he observes that models still struggle with many business tasks, as illustrated by Astra setting a new high of just 40% success on Zapier's automation bench, which consists of roughly 600 knowledge work tasks across marketing, sales, HR, and operations. He also argues that many tasks that people are delegating to AI would be better done with deterministic code, and that for a while longer at least, there is therefore tremendous ROI to time invested in structuring and validating workflows.

0:01:55

We then go on to discuss what Zapier is doing to help people recognize exactly what AI might be able to do for them, starting with his own weekly automation, which Wade says they will soon productize for customers. That reviews his activity across Gmail, Slack, the browser, cursor, and more, and then proposes specific tools and workflows that he should be building. We also talk about how Zapier is implementing recursive self-improvement loops internally and how much value they're finding in running multiple different AIs on the same problem.

0:02:27

Why Wade chose to put Zapier's chief people officer in charge of AI transformation, but wouldn't necessarily recommend that strategy to other companies. How Zapier is moving toward public by default communications to make more and more context available to AIs. Why they still don't limit individuals' use of AI, but have created dashboards to help employees better understand and manage their own usage. How Zapier, which holds a huge number of high-value user credentials, is thinking about security in the context of rapidly rising cybersecurity risks.

0:02:59

And finally, how Wade thinks about co-authorship between humans and AIs, with the upshot being that he believes individuals should use AI to help improve their writing and shouldn't be afraid of being pangrammed, but also that it's critical that people be prepared to explain and stand behind the work that they ship. With that, I hope you enjoy this very grounded and highly practical conversation about making AI automation work for people outside the AI bubble with Wade Foster, co-founder and CEO of Zapier.

0:03:33

The Cognitive Revolution is brought to you by Mercury, the fintech that more than 300,000 ambitious companies and individuals trust to run their finances. I've wired AI into nearly every corner of my life my email, my messages, my calendar. I even gave Mercury virtual cards to my agents, with low limits and category and merchant restrictions for their autonomous use. But still, my AI's access to my financial data has remained limited. With a normal bank, I might export a bunch of statements and have my assistant process them for me.

0:04:07

But for real time, up-to-date information, and certainly for taking any action, trying to get your agent to use the bank via the browser is just too hard, too slow, and too error-prone to be worth it. And that's why Mercury's new conversational interface, Command, is such a big deal. It's built directly into Mercury, which means you get natural language access to your finances without exposing anything outside of your bank account. No exports, no spreadsheets, no pasting your transactions into third-party tools.

0:04:39

I really think a lot of people are going to prefer it this way. And it can already help you take actions too, with everything bound by the permissions and approval policies that you've already set up in your account. I am genuinely impressed to see this level of AI integration in banking in 2026. And so I invite you to join me in the future. Visit Mercury dot com to learn more and apply online in minutes.

0:05:05

Mercury is a fintech company, not an FDIC insured bank. Banking services provided through Choice Financial Group and Column NA, members FDIC. Thank you to Mercury for supporting the cognitive revolution. And now, on with the show.

0:05:26
Wade Foster

Yeah, thanks for having me again, Nathan.

0:05:29
Nathan Labenz

Boy, what a difference a not super long period of time makes. I, you know, I can't believe it. Every time I have a returning guest, it's an opportunity to look back and look at what the state of AI was, models, outlooks, you know, what the what the possibilities were, what the capabilities were at the time. And suffice to say, obviously, a lot has changed. Well, We only have one hour today, so I'm gonna try to discipline myself, not talk too much and give you most of the airtime.

0:05:55

I would love to start off with just first of all, an observation that, like many ambitious software companies, you guys at Zapier have been really prolific, and I would say you've kind of built everything in the sense that you now have in addition to workflows, which of course can call out to AIs. You've got agents, you've got chatbots, you've got an MCP, you've got an SDK, you've got a guardrails product, and probably more, you know, that I didn't even notify, identify or mention.

0:06:22

What have you learned by building all that stuff? Like, what has taken off and resonated maybe better than you thought, what has been slower than you thought, and what's the sort of synthesis view that you have informed by these different product efforts and their relative successes?

0:06:37
Wade Foster

Yeah, well, I mean, shoot, I was on eighteen months ago, and if I think back to that time, what I don't think we knew yet is what the shape of these AI experiences that we're gonna take off. Or were we gonna see, you know, AI infuse into, like, all the products that we already knew and love? Were we gonna see these new products shape take up? Were we gonna see new stuff out of the labs that was that that was gonna be where AI was gonna take off?

0:07:07

What what would seem to have happened, at least when we look at our own usage, is that most folks seem to have adopted their own daily AI driver tool. Maybe this is Claude Code, maybe this is cursor, maybe this is chat GPT, you name it. But it's that's kind of where people do most of their work. And by and large, the way they what that means is tools like Zapier, MCP, or any MCP server, tools that bring your context, bring your data into that person's daily driver.

0:07:39

That feels like the way knowledge work is moving. This split in the market where there's some folks that are still trying to be like, ah, we're gonna force people to build agents on our own platform, or we're gonna bring them over here, and that's kind of where things are gonna get done. And then you see, like the sales forces of the world that are like, we're headless, you can bring it wherever you want, et cetera. And I definitely think that latter is the winning strategy.

0:08:00

It just feels like that's what us as consumers of these tools want, and that's where all the growth is. We kind of want our daily driver, we want to bring that context in, and we'll be able to manage it all in one place. Doesn't mean that there's not going to be tools that call out to all these third parties. I still think there's plenty of room for applications and tools that exist, but you kind of have to integrate with that person's core daily driver if you really want to be a part of their day-to-day workflow.

0:08:25

And that feels like pretty big new learning for me in the last eighteen months.

0:08:30
Nathan Labenz

Yeah, that's interesting. Do you so does that mean then, like, what's your daily driver? It sounds like you're kind of positioning Zapier not as being a daily driver, but more as being like an Uber tool for whichever daily driver you choose to use.

0:08:46
Wade Foster

Yeah, so I mostly use cursor every single day. We have a internal tool that a lot of our employees use as a sort of daily harness, but that also has an MCP associated with it. And so I have that pulled into cursor, so it's using the data from that, which has like virtual file system that acts as a context layer. It has automations that sit on top of it. It has apps that you can deploy, all the kind of things that you might expect from like a modern AI capable tool.

0:09:14

I just happen to use a lot of that stuff inside cursor.

0:09:17
Nathan Labenz

Very interesting. So okay, I I had a conversation with Andrew Lee from TaskRabbit. He advanced the, I thought, provocative idea that in his mind, only three kinds of software companies survive in the big picture. And that kind of everyone is building the same thing, which sometimes gets described as like the mecca suit for models. So he described himself as kind of trying to earn a place in a, you know, eventual winner circle of this like horizontal layer that sits on top of models, enables them greatly by providing all these different tools and access points and guardrails.

0:09:54

And you know, whatever else the case may be. And he thinks that there's like not a huge number of companies that win in that case, but that that layer, even if there's not too many companies ultimately in it, is super valuable. Because nobody wants to be beholden to just one model. They want to be overly locked into a single model provider. How would you compare and contrast your worldview against that summary?

0:10:21
Wade Foster

Well, I definitely agree with that last statement. I think it is becoming more and more obvious that these you don't want to be beholden to one model or one company's suite of models. We see this with our own Zapier's automation bench. We have a benchmark that measures all these models on automation tasks. And last week, Astra came out GPT six. It's the new state of the art on that model. It performs about 40% of the tasks accurately, which is the highest that there is.

0:10:51

Now it's more expensive than, say, something like Gemini three seven, which is does pretty good, but does it at a fraction of the cost. And you kind of have this this curve that sort of exists where you're trying to figure out how much am I willing to pay for incremental, you know, performance on certain tasks. And as a result, I think any modern organization wants the ability to make those trade-offs to say, oh, these tasks, it's good at a, you know, I can sort of pay this rate and get 100% of these types of tasks completed.

0:11:21

But for this type of task, I need to maybe move to a state-of-the-art model to do well on it. So on and so forth. And so I do think that companies are going to look for the, I don't know, you called it the mecca harness or whatever, the sort of tool that allows them to swap in and out for different workflows of their choice. Which to that end, I certainly believe that there's a lot of innovation yet to be had on the application layer.

0:11:46

But how those applications are used, I think looks very different than the last decade. The last decade was SaaS, and there's like all this sort of explosion of SaaS. But now it feels like there's this almost explosion of headless tools that is happening. And of course, you have this new thing, which is that your harness itself can build some of those tools. And so the the sort of build option is, uh, more readily available than it was in the past.

0:12:11

Now, what's not as obvious to me is, yes, it can build it, but should you have it build it? Because now you're accepting a certain amount of maintenance, a certain amount of reliability, a certain amount of uptime that, you know, may not actually be, like, the best thing for you in a given circumstances. And so I actually think there's still a lot of innovation to happen at that application layer that we just haven't seen yet. I think everyone's kind of trying to figure out what that looks like.

0:12:37

I think the the model companies have a little bit of a head start, but they're gonna struggle because they can't sell tokens from each other or from open source or all that sort of thing. And so it it does feel like there needs to be a third party that helps you wrangle all the capabilities that are out there.

0:12:52
Nathan Labenz

Obviously, Zapier came from a history of, like, very structured workflows, because if you didn't fully encode what the workflow was supposed to do, there was no ghost in the machine back when you started to figure it out on the fly. Now, I'd be curious to hear a little bit about, like, how would you describe the tasks of automation bench and like, where are the models good? Where are they not good? And then maybe you can describe how usage of Zapier is changing qualitatively, like how often are people still doing box by box, you know, defining of workflows, how often are they prompting an AI, which then turns their, you know, kind of thoughts into a structured workflow.

0:13:35

How often is it happening through an MCP where it's the model deciding, you know, to even use Zapier given a range of options, and maybe there's even more there that I'm not intuiting.

0:13:45
Wade Foster

You bet, you know, what automation bench measures is tasks that are kind of like the following. So here's an example from our site. We just closed the Meridian Core platform deal, uh, market it as one and route it to the win notice in the right team per our routing policy, confirm the account tier from the account hierarchy spreadsheet, convert the currencies if needed, and check for any open support escalations. So we have probably 600 tasks that are of that variety that describe like a normal knowledge work workflowy task across a very variety of disciplines marketing, sales, HR, operations, you name it, et cetera.

0:14:21

So that's kind of what it's trying to measure. And as you can see, the models are getting better at it, but this is by no means a saturated benchmark yet. And what we are doing at Zapier is we are making sure that when you install Zapier alongside of your agent, that you're actually getting better output on these benchmarks than you would if you were just using the models alone. And the reason you do that is you're teaching the model.

0:14:46

What folks are doing is they're in their daily driver and they're saying, Hey, I want you to go build a workflow. So they're calling Zapier MCP and it's going to say, Hey, I'm going to go build out that workflow. And in some cases, I'm going to write code to actually complete that task so that it is deterministic, which means lower cost, better reliability, et cetera. And then I'm going to invoke an AI or build an agent for the parts that really require reasoning.

0:15:08

And when we look across, like even our own like in customers usage of agentic products, the vast majority of what people are using an agent for 80% in fact, they probably should be using actually old-fashioned deterministic code. You really only want the AI to reason over the things that you need it to reason for. And so I still think there is a huge amount of work that is happening inside of these production workflows inside of a company that you shouldn't actually try and be delegating it to an AI.

0:15:37

And we'll see how long that lasts. Obviously, AIs are getting better and better. But I struggle to think of a world where there are just certain jobs that, like deterministic code, is still going to be more reliable and cheap. And there are certain jobs that it cannot do. And for those, you need the ghost in the machine, you need the AI that can tackle those tools. And so I think the right thing is you're trying to teach the agent how to go do that on its own.

0:16:04

And so when you talk to it, it goes and builds those things in an optimized way instead of saying, hey, I'm just going to build an agent that runs agentically every single time. It has a better sense of which is the right tool for which job.

0:16:16
Nathan Labenz

So in that one example that you gave, if I understood it correctly, first of all, it sounds like there's probably a ton of context that comes in the sort of test environment with that short prompt, right? It has to navigate, find the policy and parse that and all those other things kind of require additional information finding and understanding. Also struck me that that sounds like the kind of thing that only happens once. So, or, you know, you might acquire a handful of companies, but you're not going to acquire, like, the volume of companies that one would traditionally associate with a zap.

0:16:52

So, like, how are you seeing usage change? Or maybe what advice would you give if you're like, okay, I used to think that for me to go to all the trouble to make a zap for something, I need to at least expect that zap to run. I don't know what, 500,000 times.

0:17:07
Wade Foster

Well, that example is one, maybe I misspoke, but that example is one that happens every day, if not multiple times in inside of a company. You close the deal. If you're any good organization, you're closing deals all day, every day. There are so many workflows inside of a company that are kicking off all the time, perpetually, and in some cases, they're happening at a rate that humans can't keep up with. If you're operating at the scale of, like, some of these companies, they're C they're selling to consumers that are having purchases happen, like many times a second.

0:17:36

You have to use automation, you have no other choice, you cannot put humans in the loop for these tasks.

0:17:41
Nathan Labenz

So have you seen big shifts in terms of people moving away from blocking it out themselves and having AI do that? And have you also seen the scale threshold at which people start to think to use automation software come down substantially because the AI can do the setup?

0:18:02
Wade Foster

Yeah, I think the big new, uh, like, opportunity is to have the AI do the build. Like, you know, it is able to sort of work through the logic much, much faster than a human. And the idea of building a no code, it feels antiquated to me. It's like the new code no code is code. What I think is we have learned is that humans still very much benefit from visualization of those workflows, though. That visualization helps them, uh, verify is this thing doing what I intended it to do?

0:18:30

It acts as documentation so you can share with other people and say, Hey, here's the thing I built, here's what I'm doing. If you think of Zapier in the old school as like this thing that had a bunch of boxes and you're coming in and using that to configure it, by and large, I don't think that is the way people are doing it now or even in the future. Instead, they're talking to the agent and having the agent go make those edits for them.

0:18:50

And then the other nice thing that I is happening in the future is you're going to see that stuff that gets hardened into a deterministic workflow. But even when it fails, you can actually have then the agent go troubleshoot and get fall back and say, Why did it fail? What happened here? And then it can use its reasoning to fix the to fix the workflow or to fix that instance of the workflow. And so you start to see that the agent almost take over the human role of building and maintaining it.

0:19:18

But what is actually running is still a very deterministic workflow with AI interwoven in, like, the places that is most necessary.

0:19:26
Nathan Labenz

Hey, we'll continue our interview in a moment after a word from our sponsors. Today's episode is brought to you by Athena, the executive assistant company on a mission to improve how people work and live. If you want to increase your impact, you have to free up your time, and that's what Athena does best. They match you with a dedicated, full-time, top 1% executive assistant who can take over your inbox, calendar, travel, and everything else that's quietly eating up your week.

0:20:00

Athena is SOC two Type two certified, so you can rest easy knowing that your sensitive data is in good hands. And, as a former AI advisor to the company, I can personally vouch for how much they've invested in AI tools and training. In fact, one of the very best AI users I've ever met is an Athena client who delegated the exploration of AI tools and the development of AI workflows to his EA. Athena clients report saving an average of fifteen hours a week, and the average client refers more than two friends a year.

0:20:35

That, to me, checks out. I was an Athena client while running my startup, and to this day, I continue to refer friends. Go to Athena dot com slash cognitive right now and get matched with your EA. That's Athena dot com slash cognitive. Give yourself back a few hours this week. Go to Athena dot com slash cognitive and see who they pair you with this month. This episode of the Cognitive Revolution is brought to you by OutSystems, the leading agentic systems platform.

0:21:09

We've all seen the headlines. Companies are pouring money into AI, but the big question on every executive's mind right now isn't just how fast can we adopt this? It's where is the ROI? We're seeing a real trend toward AI chaos. You've got teams deploying standalone coding tools, random agent builders, and experimental scripts. It sounds innovative, but in reality, it's creating a massive headache fragmented tools, ungoverned data, serious security blind spots, and costs that are spiraling out of control.

0:21:42

If you don't bring those agentic applications under control now, while they're still embedding into your core processes, you are looking at broken systems and damaged customer trust down the road. That's where OutSystems comes in. OutSystems is the leading agentic systems platform for the enterprise. Instead of managing a patchwork of disconnected tools, OutSystems lets your team engineer, orchestrate, and govern your entire agentic ecosystem on one open, unified platform. It's built for the speed of AI, but with the reliability and security that enterprises actually require.

0:22:18

We're talking about real results, like Key Bank, who used OutSystems to deploy a customer-facing app that delivered 75% faster onboarding times. Or the global logistics leaders who built agentic systems to completely eliminate their engineering bottlenecks. You don't have to choose between speed and control, whether you're a small team or a massive enterprise. OutSystems helps you engineer, orchestrate, and deploy agentic systems that actually scale. Stop chasing the hype and start owning your agentic future. You can see how it works and learn more at outsystems dot com slash TCR.

0:22:57

That's outsystems dot com slash TCR. So when you go to the 40% or so success rate on automation bench, what can you bring that up to as you move from, you know, just asking Claude to do it to giving Claude Zapier and, you know, potentially iterating a little bit on initial failures, like what kind of lift do you see and and what sort of token savings do you see over time?

0:23:29
Wade Foster

You're gonna have to wait for AutomationBench V two for that, cause that is exactly the right question is to see, hey, what happens when you give these models access to tools like Zapier? How much higher can you get those efficiency and or how much higher can you get the the scores, but also how much can you pull the costs down? How much faster can they go? Because I think there's many dimensions when you a model access the tools and capabilities and certain things like that, where it's gonna score better on these benchmarks at the end of the day.

0:23:54

And that's where I think the application layer has a lot of room to go run is to say what happens when you give access to the model to these extra things and it the model just gonna get better at performing against a a whole host of tasks.

0:24:08
Nathan Labenz

How do you put the model in position to be successful when something goes wrong and the model has to come in and, like, troubleshoot, debug, you know, I'm sure that you've done who knows how many things over time to try to set the models up for, you know, within one generation of model, have it come back and, like, be able to fix the things that it got wrong the first time.

0:24:29
Wade Foster

Yeah, I think there's two places that are interesting to talk about here. First is when you think about building these workflows. So the the thing you wanna do there is you wanna make sure that the model can properly identify when it needs to be using AI versus where it should just be writing code. Uh, and there's many such examples where you don't want the agent to actually orchestrate the task. You just actually want it to run, uh, code that that exists before.

0:24:56

And so a lot of that is when the the agent is building its plan, you want to make sure that the plan encodes like, hey, this is like what the optimized workflow looks like, and it has a good plan to do that. The second place is then what happens when things break and how do you recover from that? Here we've done a fair amount of work, just even in our own support org, trying to figure out how do we actually troubleshoot on behalf of customers, and then how do we bake that troubleshooting back into the core product?

0:25:23

And here, a lot of it just boils down to one of the big learnings is we just have multiple agents run at it. And so our current we have this auto email program that's running right now. And for that, it spins up five agents, independent agents that evaluate the troubleshooting situation. And we notice that when four of the five agents tend to agree, there's a pretty good chance that's actually the the issue that it's hitting into it.

0:25:48

And so there's a lot of like data and measurement that just goes into that where you're just trying to, honestly, just hill climb and see, like, how do we actually try a different model, try a different prompting technique? How do we measure that stuff when we have humans that are editing, like auditing the output? And so when it fails to, and what those humans do is they basically either give a thumbs up approve or they give a thumbs up rejection and a reason why.

0:26:11

And so those reasons why kick back in and help improve the overall system. And so you're just kind of going through this loop over and over again to continue just optimize your ability for that workflow to have a higher chance at getting the outcome that you

0:26:26
Nathan Labenz

Is that loop and all the data that you've collected over time, which I guess must be quite massive, core to Zapier's defensibility these days? Like, how do you think about what the you know what, what is the hill that you've climbed that will be other be hard for others to follow you up?

0:26:45
Wade Foster

yeah, I think that's a big part of what it boils down to. It's trying to identify what are things that are unique to you, what are the things that others can't replicate easily. And so certainly for us, we're really good at automation. We have tons of data on what it takes to do. We hook into everything. And so how do we take that data to actually make our products better? And it has to be meaningfully better than somebody who doesn't have access to that could do.

0:27:10

And I think this is where a lot of the incumbents have an advantage is if they're able to yield that to actually build a better product at the end of the day that the models alone can't do. And there's so much room for this because the models are they're great generally out of the box, but all of us has even experienced this in our own just lives where you just you hook it up to your Gmail inbox.

0:27:29

And now you start asking, like, hey, tell me about help write an email. And it's like it automatically does a better job of writing email because it sees how you write email. And you've done very little in the way of trying to tune that workflow. It's just by hooking up your company's data, all of a sudden the models get better. And yeah, I think this using your own sort of company data to build an edge is a pretty spot on technique these days.

0:27:52
Nathan Labenz

So does that look like a big retrieval problem for you? Certainly in my email, right? It's like I've got a lot of history and finding the right example to take inspiration from is probably especially if it's just using Gmail APIs and doing keyword, you know, kind of constructions. That's probably just as hard, if not harder, than actually taking inspiration once you've found the right documents to take inspiration from. In my personal context, I've tried to help it out by, like, exporting all that stuff, doing embeddings, various kinds of, you know, alternate search approaches, so that hopefully the right content comes to the top more often.

0:28:35

If I'm putting two and two together, right, it sounds like at Zapier, you probably have, like, a database of, like, a zillion things that have gone wrong over time. And then to help the inform the model of, like, how to fix for this particular situation, you got to dig in and find analogous situations. What does that look like? Or is there an embedding model that would do a good job of that, or have you had to kind of innovate at the retrieval stack layer in order to make that work well for such a use case as Zapier?

0:29:05
Wade Foster

Yeah, coming back to the support example, a lot of it's just about taking the example that comes in, give it the old thumbs up, give it the thumbs down, provide a reason why, and just doing that over and over again. And so what that looks like for our customers is just like giving them the same tools to do the same. A lot of this is not particularly fancy at the end of the day. It's just take the example, did you like it?

0:29:26

did you not like it? and just rinse, wash and repeat.

0:29:30
Nathan Labenz

Interesting, okay? How do you think about competition in general? Like, it sounds on the one hand, we should, I think, all be worried about frontier model companies eating our lunch, even me as a humble, you know, AI podcaster. I look at, like, NotebookLM, and I'm like, they're coming for me in my, you know, rather unlucreative niche. But you could, you know, say, well, those guys, they're only going to sell their own models, so they're kind of a different type of animal.

0:29:58

We don't have to worry about them. There's, like, a variety of new tools that are coming online to try to be the Uber tool. I've done episodes with Composio, for example, zero X Y Z is kind of out there. And then there's like, you know, kind of other daily driver sort of agent builder type things. And then there's just kind of like other big incumbents, you know, that you've mentioned Salesforce. And it's to some degree, it's like, maybe just big incumbents with lots of data, lots of resources kind of all end up colliding with each other.

0:30:25

Like, which of those kind of classes of competitor do you think are actually the ones that you need to be most concerned with?

0:30:34
Wade Foster

You know, it's an interesting, we're in an interesting period for sure. I think, to your point, everyone gives a lot of attention to the labs and tries to understand what are they doing. And I think that is important. You want to understand what are they going to be great at, what are they going to hill climb at. But I still remember PG's advice when we were going through YC, where, you know, back in the day, it wasn't, hey, what if Anthropic or what if OpenAI builds you?

0:31:03

It was what would happen if Google built this, what would happen if Facebook built that was always like the question. And the thing that PG tried to instill in folks was you're not often competing directly with Google. You're not going toe-to-toe with Larry and Sergei, you're not going toe-to-toe with Zuck. Oftentimes, in the things that entrepreneurs are trying to build, you're going toe-to-toe with a potential mid-level product director who's trying to get a promo, might be there for two years and then bounce, et cetera.

0:31:32

And the reality is open AI, Anthropic, they're big tech now. These are not small, tiny startups. Yes, they're obviously built capable of building incredible things, and they're going to be tested the world at these foundation these models. They're going to be incredible at that, and they will have good products elsewhere, but they can't build everything. They just can't. And so that's where I think, you know, it gets really a wide open field. And I look around and it is a little confusing because you've got everyone that does seem to be building everything.

0:32:04

There's a there's a sort of sea of sameness out there that is a real challenge at the moment. While at the flip side, you go talk to the average user of AI tools, and they're candidly not doing much. They might have used ChatGPT or Gemini. And so, to me, I think most of us, our competition isn't each other. It isn't the tools that you've talked about. It's do people actually know what to do with these tools yet?

0:32:30

They just haven't adopted anything at this point in time. And the real challenge is, can you actually get your hooks in somebody whose only experience with AI is using Gemini in the default Google search? Uh, and or if they're using Microsoft Copilot at work, that that's where most people are. And I think that can get so easily lost in the shuffle if all if you hang out on X all day. Because on X, we're all just hyper aware of what model came out, what tool's gaining traction, who just raised a huge bunch of money.

0:33:02

And we're keenly aware of these micro differences between different products, and most folks just don't know that. And so I think the challenge we have is really making sure we're sort of keeping like those two competing challenge, like those competing thoughts in our head, which is yes, we do have to be better at some dimension than, like, all of the sea of sameness. And yet at the same time, the opportunity is massive to just go educate the masses on, like, how these tools can work.

0:33:32

And there's pl these markets are enormous. The market for automation was like orders of magnitude bigger than I ever thought it was when we started the company fifteen years ago. It's probably a thousand times bigger than what we set out. And so there's plenty of room for us to go solve problems for customers who, candidly, they don't know about any of the competition. You just rattled off. And so I think that's the biggest challenge for many companies today.

0:33:55
Speaker 4

Hey, we'll continue our interview in a moment after a word from our sponsors.

0:34:01
Nathan Labenz

Today's episode is brought to you by Anthropic. By now, you know my story. Claude drafts my intro essays, and I rewrite them. Not because the drafts are bad, but so I can stand behind everything I publish. Well, I have an important update. Claude Fable Five is the first model to have me rethinking my role. Today, I now think co-authorship, not sole ownership, should often be the goal. Where the model excels, rewriting its work can be more about vanity or a misplaced sense of duty than integrity.

0:34:36

I feel it most in songwriting. I'm no lyricist, but I'm good with a song concept, and Fable writes some amazing verses. I give it feedback on its misses, and I push it to aim for higher inspiration, add layers of meaning, optimize syllable density, and, above all, write a hit song. These days, I get compliments on just about every song we write together. Claude is the AI for problem solvers. It's the collaborator that understands your entire workflow and thinks with you, not for you.

0:35:08

Whether you're debugging code at midnight, building a financial model, or strategizing your next business move, Claude extends your thinking to tackle the problems that matter. For problems worth solving, get started with Claude at Claude dot ai slash TCR. That's Claude dot ai slash TCR. And check out Claude Pro, which includes access to all of the features mentioned in today's episode. Once more, that's Claude dot ai slash TCR. Yeah, certainly, this I I'm working a little bit on a episode where I'm just gonna do things I've been wrong about and things I've been right about.

0:35:44

And one of the things I've definitely been wrong about is I expected a lot more change to how things get done across the economy five years ago than we've actually seen. And if you, especially if you were to tell me then that, like, we'd have Astra, and, you know, that it would have been, roughly speaking, like a smooth ramp to these capability levels. And yet we still see, you know, revenue has exploded at the model companies, obviously, but, like, we don't see nearly as much change as I would have guessed.

0:36:12
Wade Foster

Yeah, life is kind of the same. I kind of go about my day and I talk to my friends, I talk to my family, and I watch what they do. And yeah, it's it, their days are the same. And yeah, they use ChatGPT some to help with things here meal planning or to help plan a vacation or to to do a workout or something like that. Certainly not taking advantage of Astra level model capabilities at all.

0:36:34
Nathan Labenz

Yes. So what did you learn then about what kind of help people need? You know, if you, I don't know, you know, do you do you like talk about this on when you're taking walks in your neighborhood? How do you? I'm interested in your method, but also even more so your takeaways. What is it that kind of gets people over the hump? How do you help them see a new way of working? Are there any patterns that, you know, seem generalizable, or is it kind of idiosyncratic for every individual and small company?

0:37:07
Wade Foster

There's definitely patterns, but there's a lot of the specifics matter a lot, and that's where it starts to feel idiosyncratic. And we've seen this for years. I remember for a long time, one of the hardest problems with Zapier, even till this day, has been helping people with recommendations. What actually should you use this stuff for? And if I personally sat down next to you and said, Hey, just show me what you do every day, I could come up with half a dozen examples of things that would immediately be things you were like, Yep, I want that.

0:37:32

Yep, I want that. Yep, I want that. But then how do you actually bake that in? Like, how do you give that experience of me or somebody who is knowledgeable about these areas sitting next to them, and how do you bake that into the product? And this is where I get pretty excited about where AI think can help cross that, I don't know, recommendations gap, use case gap, whatever you want to call it. Because if you're able to point the tools where you work, say, Hey, I want you to go watch what I do every day.

0:38:01

Watch what I do in Gmail, watch what I do in Slack, watch what I do in my browser, watch what I do in my chat. And just tell me, what should I be doing different? I started doing this workflow at the beginning of the year, and pretty much every week now, I have new tools, new systems that start to automate bits and pieces of my job. And if you do that on a perpetual basis, you start to feel the difference.

0:38:22

After a month or two, you're like, Wow, I. There's a lot that's kind of running for me now that I didn't have before. And I think, even though many of the things that are built are things that I kind of knew I should be doing before, it's the it's the specifics of where it's like. I literally watched the thing that you did here and here, and so I know exactly the tool that can get it done.

0:38:42

It's that idiosyncratic part that makes it click in. And so I get pretty excited about how do you build? How do you give these models like awareness of just how people go about their day? Because I think there's tons of ideas that are just kind of trapped, like latently lost inside of that that most of us just don't wake up and think about. We are creatures of habit, and so we wake up and we go about our day the same way that we did but the day before.

0:39:05

And we don't think, oh, there might be 5% better way of doing it, or there might be like 500% better way of doing this. It's just I have muscle memory, I know how to do it this way, and I'm comfortable doing it this way. So I might keep doing it that way, even if it's not the best. And so AI sort of has to be so good that it kind of knocks us out of our comfort zone.

0:39:24

And we're willing to say, you know what, I am going to go try it that other way because that sounds so, so much better.

0:39:30
Nathan Labenz

So how have you set that up for yourself, and how broadly deployed at Zapier is this sort of AI on your shoulder or screen recording? I'm kind of expecting like a screen recording.

0:39:40
Wade Foster

Most people are, yeah, most people use Zapier or MCP for this. So they just have all their tools hooked up into whatever harness of choice they use. Like I mentioned, we have our own internal harness, but it could be Claude Code, it could be CoCoWork, it could be ChatGPT work, it could be cursor, it could be anything, right? And so they'll just have an automation that runs once a week and it just kind of collects all these signals across all the work they've done.

0:40:04

It seems like the event streams, and it can tell, it says, Hey, I noticed you did this and this, and here's a tool that I think you should go build. And so most people have something like that set up, and then they just tell their agent, okay, great, I like that suggestion, go build it, or that suggestion's okay, or make it great is if you made this tweak and do that, I really want you to go do that.

0:40:22

And half half the battle is just getting you to react to something, even if the ideas aren't perfect, they only need to be like 50% good enough to get you to go. Oh, I see where you're going for. And now that brainstorm process kicks off and you're able to run with it.

0:40:38
Nathan Labenz

So do I understand correctly that it literally just uses APIs to look at your digital history for the last period of time and then kind of collates that together and comes up with ideas? Interesting. Is this something you think you'll productize for Zapier customers?

0:40:57
Wade Foster

Yes, I think it's very likely that'll come in some form factor.

0:41:01
Nathan Labenz

Interesting, and do you think, I mean, it's a very it's an interesting way of doing it. Obviously, you know, I don't need to tell you, but, like, one downside of going that route with your customers is they'll have to attach all these different platforms that they use. First, in order for you to have the access to get any, you know, insight as to what's going on across all these things. Whereas with, like, a screen recording type of thing, you know, you have kind of one install.

0:41:28

And you just like, look at what they do, click by click, and sort of, you know, make sense of it from a a kind of top down, I guess, perspective, as opposed to what you're describing sounds a little bit more bottoms up of like, oh, I saw this in Drive and this in Gmail and and what have you? Do you think that is there, like, a principled reason or a empirical reason for going doing one or or the other?

0:41:50
Wade Foster

We're good at APIs and we're good at that stuff. And so that was like just an easy natural, just was an emergent experience experiment and an emergent property. I think for this experience to be great, you should use all the tools that you have available to you.

0:42:03
Nathan Labenz

Yeah, it's interesting. I mean, it also just kind of reflects the alien nature of AI intelligence in some ways, where it's like, if I was going to try to advise you, I would definitely want to watch you work. I would not be so helped out by, like, your logs, but AIs are really good at reading logs. How do you think about pricing in today's world? This is obviously a very open question for a lot of companies.

0:42:27
Wade Foster

The point of view that, for the most part, seat based pricing is dead, we're dying. I think it may still make some sense in some small areas, but by and large, when you're when intelligence is such a core part of these product experiences, I don't see how a fixed seat based pricing mechanism really makes much sense for that at all. And so inevitably, I think that lands you in some sort of usage based or outcome based pricing world.

0:42:57

Uh, and I think products, you know, choosing which side of that fence they land on. I think if you're you know, going more the commodity route, you're probably closer to usage based pricing. This is the Sam Alm of we want to be a utility that's page that you can have intelligence on tap, et cetera. Um, maybe if you're like a little more enterprise oriented, you're going to try and say, Hey, I'm going to I'm going to price per out outcome.

0:43:21

And you see a lot of the like customer support tools doing this. Where we're going to say, hey, and we're going to you're going to we're going to bill you for resolved tickets. Where they have such a clear demarcator of what success looks like. And so I do think if you can, if the product you're selling has the ability to have such a clear agreed upon fixed outcome, I do think that's probably to your advantage. I think the challenge is, at least most of the products right now, it's way more messy than that.

0:43:46

It's you kind of stop one one or two steps shy of truly delivering the outcome. You are like part of delivering a piece of the outcome. And so I think that kind of pulls you back into a more pure usage based model. But either way, I think you kind of got this meter running where it's it's basically selling work of some portion at the end of the day. And yeah, I think that's kind of where a lot of this stuff is going is we're going to be having to think through what is our budget for work to be done.

0:44:16
Nathan Labenz

Do you worry about price discrimination from the model companies? Of course, you're, I'm sure, well aware of the ratio of tokens that you get with a Claude Max or an OpenAI pro plan, and how many more tokens you get, at least if you max them out, compared to what you can buy with the same dollars via the API. I've asked a number of entrepreneurs this question, and I just am kind of wondering, like, would you be supportive of some sort of rule that said, hey, you got to charge everybody the same for tokens?

0:44:49

So that, like an ecosystem, you know, has more of a fighting chance versus, like, with open AI giving, like, you know, twenty to one token advantage, you know, that could be hard for third party, you know, value add services to compete.

0:45:03
Wade Foster

Yeah, I mean, look, I, I definitely am, like, you know, kind of tend to fall on the side of like free markets. And these are companies that have the right to price how they like. But I think many of us lived through and are still living through, like Microsoft's dominance and how they use bundling to their advantage to box out better products. Can't quite candidly, but because it's all just bundled there, it like plays to their advantage.

0:45:27

And, you know, I'm, you know, I think this is where, like, countries and, um, you know, folks sort of get to decide, like, you know, what, what do they think is monopolistic practices and what do they think is fair a fair playing field? Um, yeah, ultimately, I, I, you know, I think I my job is to, like, play by the rules of the playing field, uh, and not necessarily decide. But I I definitely sort of lean more toward the like free market side and say, like, hey, if you know, our our job is to come up with an edge that sort of helps us to compete on there.

0:45:56

Uh, and I don't fault any company for sort of wielding the tools they have in their UM tool chest to sort of make products work for them, uh, work good for their customers and help them maximize revenue. That's well within their right.

0:46:09
Nathan Labenz

It's been interesting to see who's been willing to bite the bullet versus who has stuck to their free market principles. Kind of topic change toward operations and AI transformation within Zapier. One thing that caught my attention was that if my AI research agent is to be trusted, you put your chief people officer in charge of AI transformation. I believe last time we talked, you had kind of said, well, it's not any one person's job, it's kind of my job as CEO, but it's really everybody's job.

0:46:41

So I'm not going to say it's like one person's job. What changed, and how did you decide it would be the people officer who would who would shoulder that burden?

0:46:48
Wade Foster

I still agree that AI should be every person's job, should be my job. I think it depends on what stage you're at and what problems you're facing in terms of how you think about who you want to bear the like to tackle the next mountain, so to speak. And so for our first chapter, like a big part of Zapier becoming AI fluent, was everyone in the company, like getting up to speed on how to use these tools.

0:47:12

There wasn't an AI committee, there wasn't an AI group where it's like, oh, we're there, they kind of figure it out. The rest of you as business as usual is like, no, this is important for everyone inside the company, impacts everything we do, so all of us kind of need to get on that. Now, as time went on, there was a couple interesting things that we started to observe. First, the AI fluency inside the company went, well, basically, we got within a year or so, basically of ChatGPT launching, almost like 100% of the employee base is using AI day to day.

0:47:43

We are not having technical issues like adopting AI. That's not where we're staring in the front. What is starting to become one of the bigger issue is how do you take these models from individuals having success to actually using them to solve bigger and bigger production grade workflows across the company? And so the challenges start to look like a lot more like people issues, where it's like, okay, we kind of have to rewrite certain job descriptions, we have to rethink how we do compensation.

0:48:12

We have to think about how these teams stand up, where it's like, we got to move this group. We kind of don't need this group anymore, but we actually need more people over there. So how do we retrain and reskill these folks who have some of those skills but need to learn some new skills? And it turned out Brandon, our chief people officer at the time, was, like, really good at doing a lot of these things.

0:48:31

His team was on the forefront of some of this inside of Zapier. And so the thought for me was just like, Hey, you're doing a good job at this. Why don't you go help everybody in the company figure out some of these things? It could have just as easily been a CMO or a CPO or in any number of roles. It just that's how it was played out inside of Zapier. And it's been funny how much I get asked this question now because I think a lot of folks think I have a point of view on, oh, it must be a chief people officer or something like that.

0:48:59

And it's like, no, it was really just this was like, at this moment in time inside of Zapier, this sort of felt like the best person to go tackle it based on the problems we were facing. And I think that's the way you should do it inside your company. You need to look at what are your bottlenecks, what are your constraints, and go identify the person who is the right fit for that job.

0:49:16
Nathan Labenz

Yeah, echoes of, uh, Ben Horowitz's advice is tough. You've also done an interesting move of really trying to push people toward internal communications being public within the company by default. And I'm interested there in on a couple, like, finer points. One, how did you handle historical data? Did you, like, start that policy at a certain point in time and everything in the past was, like, left in the past, or did you try to reclaim some of that knowledge, which I assume would be, like, very tempting to do?

0:49:47

And then do you have, like, different tiers of public as well, you know, cause it it strikes me that, like, you might not want everyone to know everything, but you might want different groups to have certain, you know, different databases. So I'm just kind of looking for the double click on how you've operationalized public by default.

0:50:03
Wade Foster

Yeah, one interesting thing, Zapier's had this value of default to transparency for gosh forever, it feels like. And so, by and large, we were already working in public for many such things. And so we already had a culture where there was tons and tons of public Slack channels and people were, like, just talking about the projects and their day to day in those quite a bit. I think a lot of what we observed was there had been as the company grew, there were some pockets of work though that started to find their way into private channels or private DMs and things like that.

0:50:41

I think still, by and large, Zapier was very much more public than most companies. But you Slack gives you the the readouts, you can see what percentage of stuff is happening in private and public and all that sort of stuff. And we looked at that and thought we could use a little bit of a reminder. And the second thing that also encouraged us to do this is just the fact that our AI agents were just so much more effective when they were able to see the context inside of Slack.

0:51:05

And so one of the things we started to do on our executive team was we just had a little fun competition to see, hey, who can put most of their communications in sort of a public channel? There was no like, oh, you must do this, or anyone under this rate gets a bad review or anything. That it was just literally friendly competition. And we just noticed that, oh, more things can go in public than we realized, and this kind of seems to help the team.

0:51:30

People know what's on our mind, nothing is hidden, et cetera. And so we just started to encourage that all across the company. And there's certainly things that we still probably pull into private channels and things like that. If there's an HR incident or something like that, we're not resolving that in a public channel. If there is a critical security vulnerability, like we're not, those are happening in private channels, especially while the incident is active. Once they get resolved, we tend to share out the learnings and things like that.

0:51:57

So there's certain topics where, you know, you still need to set up these spaces where you can go resolve them in private. But I think, by and large, most people far overestimate the number of things where that is required, and definitely underestimate the power of what happens when both humans and agents have access to the full context of what a company is working on.

0:52:22
Nathan Labenz

So speaking of security, this is obviously top of mind. And as I was thinking challenges that AI might pose to you, like you're holding potentially more credentials to more different services for more different users than just about anyone in the world, right? So I would think this is kind of a scary moment where all of a sudden, you know, where's bedrock in terms of security? So how are you approaching that? And are you trying to, like, get into these sort of early adopter glass wing and other clubs?

0:52:55

Do you think that is like, actually maybe a big source of differentiation going forward? And how scared should I be about cybersecurity? Because I've got a lot of credentials all over the place, Zapier and otherwise.

0:53:07
Wade Foster

Yeah, we've held these credentials for fifteen years, right? So this has always been like a an important thing inside of Zapier that we said, hey, this the the credentials are like a a thing that we must, you know, treat with the highest highest of stewardship. And so we've always put a lot of effort into making sure that we do a good job of protecting those for our folks. But what feels different this this time is that you do have like these Nithos Caliber like security models that are able to patiently just loop over issue after issue and finding things.

0:53:40

And so that is definitely like every every software project has vulnerabilities, it's just someone found them yet. And the models just make it a lot easier to find those things. But the good news is they also make it easier to patch them. And so, yeah, I think what smart companies are doing is they're basically wielding them for offense and defense. They're trying to find this stuff faster, and they're trying to resolve them faster. And so I'm not exactly sure how all this is going to play out.

0:54:06

Every day there's kind of funky stuff going on. Obviously, the the hugging face incident is one that was like straight out of a sci fi book, right? But I think for most folks, my my my guess is it feels like there's this almost one time like investment to reacclimate and then you kind of get back to more steady state of like offense versus defense, like security posture as this stuff moves forward. But gosh, it's going to be really interesting to see because there's the every day we're seeing new stuff.

0:54:33
Nathan Labenz

Are you like taking steps as CEO to try to make sure you're on the inside of early access lists for Yeah, I mean, Models?

0:54:44
Wade Foster

Yeah, we wanna have access to the best capabilities as early as we can. I think everybody does, eh? And in the same shoes, would want to do the same.

0:54:52
Nathan Labenz

Yeah, it feels like that actually could be a pretty meaningful point of differentiation going forward. Like, if one company who's gonna hold my credentials is in all the clubs and another one's a startup that's not, I mean, that's a, you know, that's a big leap of faith to take on the company that, like, doesn't have the same kind of access to be trying to find and fix all these issues. In terms of spending, I saw you tweet not too long ago that you have some engineers spending $30,000 a month on tokens at Zapier, and it struck me that, like, we've kind of been on quite the yo-yo ride recently with token maxing and then, you know, budgets being

0:55:33

hit. And what do what do we do about it? What sort of process do you have, or governance do you have for who can, under what circumstances, with what approvals, spend tens of thousands of dollars a month on tokens?

0:55:46
Wade Foster

Right now, I would say that that individual, those individuals are a bit of a a outlier. But it still en encouraged us to start to put just build some tools to help people do some self-policing. And so mostly, we don't have budgets yet set up for individuals, but we do have tools where they can see their spending and they can better understand, oh, what happens when I choose a powerful model versus when I choose this cheaper model on certain workflows, and they can see what those cost differences are.

0:56:14

Uh, and we're as we see people starting to spend a ton and ton on tokens, usually the first reaction is I just wanna go talk to them and say, Hey, what are you doing? I'm just really curious. And in some cases, you have folks that are like doing some insanely productive stuff. And in other cases, you have some folks who have got a mix of things that are like pretty productive and places where it's, oh, you don't need to be using Fable for this or Astro for this.

0:56:37

There's a better way to do some of these things. And so when you have a almost 800 person organization, you're there's just a big education effort. I involved over time, I do suspect that token budgets are gonna be a real thing, though. And you're gonna have part of AI fluency is gonna be that we're gonna say, ah, like, this person is gonna get a higher budget than this person because they know how to get higher, like, output from those things.

0:57:01

How do you actually operationalize that? I we're still working through some of that stuff. But it seems pretty obvious to me, just looking across the employee base, that some people are, like, excellent at using increasing levels of spend, and some people are just not really thinking about it all that much yet.

0:57:16
Nathan Labenz

Another aspect of AI fluency that I'm really curious for your take on is what you think is the right model for co-authorship or co-creation with AIs. And this is not a gotcha because I'm in the same boat where, like, I've consciously tried to almost like shock exposure myself recently to put some things out that I didn't rewrite every word of. And so my pangram score at times, you know, says that my stuff is AI. Now I've seen also some stuff in various places from Zapier that has a high pangram score.

0:57:50

How do you Think about and how do you set the tone for others at the company? You want to be using these Things, but we don't want to be putting out slop, like, what's the line?

0:57:59
Wade Foster

The way I think about it is, I have no problems with people using AI for communication at Zapier. What I really have a problem with is low-quality communications. And we definitely where this becomes a bit of a problem is that we live in an era where AI can, like a person who is you exercising low judgment, can create a high volume of very low-quality stuff very quickly. And that can overwhelm a person. When you're still, we've tried to put a few guidelines in place that help people think through ways to go about that.

0:58:32

So, fun one, you need to own what you sent. If you wrote it, you probably should be putting more time into authoring the thing than the reader is reading it. AI use shouldn't be a way of transferring ship, transferring ownership of a task, where it's like, Oh, I was assigned this task. So now I have AI spin a prompt and I said, Hey, you now read it and deal with all this stuff and edit all this.

0:58:50

Like, that's not a great way of going about it. You need to understand what you send. If someone is gonna start asking you questions and you actually can't, you're like, I actually don't know what's inside of that. That's not good. You probably ought to be, like, making asks explicit. So if you need somebody to do something, if you need a decision, if you need feedback for labeling something as a draft and you want feedback on the thing, you need to do so.

0:59:14

You you need to go verify details. It's not uncommon for AI to hallucinate some of these details, or it maybe it's not hallucinating. It might pull dated information. Uh, so if you hook it up to an agent that has access to Zapier, Slack or, duh, I could pull, Oh, this project from three months ago is related, but not the exact same thing. And if you're trying to pass that off, that becomes a real issue where these AI summaries take an AI summary of a summary and of a summary, and all of a sudden, before you know it, it's actually passing on incorrect information.

0:59:44

And so you have to do a good job of verifying the details in there. So, to me, that's the real important piece is that you are still an active participant in the creation of the material. But if the AI is helping you structure your thoughts and structure the writing at the end of the day, go for it. I don't have any problems with that. What could be tedious if you're not scrubbing some of those slop that are a part of it, the it's not this, it's that, the em dashes, the honest truth, the load-bearing, all that kind of stuff.

1:00:12

I do think that is something that if you're doing that a lot, especially if you're doing in marketing material, it makes it hard to stand out. People get a little tired of reading that kind of stuff. So you do still need to have your own editorial hand on the steering wheel, so to speak. But, uh, to me, it's not using AI is not the problem. It's like low quality, that's the fight at the end of the day.

1:00:32
Nathan Labenz

How has your team composition changed over the last couple years? You kind of mentioned earlier, like, maybe we don't need this team, but we can reskill. And are there any thresholds for AI capability, something that you're like, well, they can't do this now, but if they could, I could see that actually making a big impact on our hiring plans going forward from that point.

1:00:56
Wade Foster

Yeah. What's interesting, I would say in some ways, our team looks very similar to how I I it has in the past, and that's maybe a surprise to me. But in other ways, it is pretty different. I think we still have engineering and design and product and stuff like that inside the organization, but the idea of, like, a classic, traditional EPD, like, that's largely gone. Um, you know, things are a lot more malleable, but the roles still exist.

1:01:24

Um, you know, there's definitely been, like, a flattening of management layers, uh, but strong management is still crucial. We're not getting rid of managers anytime soon, but managers can handle a higher volume. Those are, like, a handful of things that are, like, interesting. Similarly, data analysts, everyone inside of Zapier is kind of their own mini data analyst now, and so you don't need, quote unquote, as many data analysts. And yet, we still have analysts that are doing really critical, important work inside the company.

1:01:52

It's just they're working on higher-value stuff now. So the it's this you could feel like things shifting, and yet at in some ways, it still feels pretty familiar at the same time. So the the company, uh, feels quite a bit similar. But I what I think is gonna be you ask, what are the models not yet capable that I'm excited of is I I I still do this idea, you know, the team shifting more into building the factory that builds the products and the company and the marketing, all that sort of stuff.

1:02:22

And so you can start to feel where we are doing more and more of that, where it's like, we have a software factory, we have a support factory, we have these workflows that are getting stood up where they're handling the interloop, and the humans are more designing that piece of the puzzle. Inside those factories, there's all sorts of steps that are, like, you you come across areas where you're like, the AI's not quite good enough for this yet, we need a human in the loop.

1:02:43

But with every model release, with every just own iteration learning loop inside of Zapier, you can start to feel us chip away at that problem. Where you're like, we're just getting closer and closer to something that looks actually pretty different than the orgs of the past. And that's pretty exciting, I think.

1:02:58
Nathan Labenz

Anything else you would wanna leave people with? Anything I should have asked but didn't, or just inspirational closing thoughts?

1:03:05
Wade Foster

If I were to plug something, I'd say go install Zapier MCP. You get a wholly modern experience of Zapier. So if you still think of Zapier as the old school, no code, clicky-click boxes on a screen thing, I think you're in a in for a treat. If you install Zapier into any of your favorite harness and try it out as your daily driver, you're gonna get a whole bunch of capabilities that you don't get with just the harness out of the box.

1:03:28
Nathan Labenz

Zapier MCP, install it, folks. Way faster. Thank you for being part of the cognitive revolution.

1:03:34
Wade Foster

Thank you, Nathan.

1:03:35
Nathan Labenz

All right.

1:03:51
Speaker 3

When you say go, I don't say no. When you turn it low, I can take it slow. Same time each night, I run it as a watch what I do. I learned it watching you. Now let me do it for you. Watch what I do. You go get some rest. I'll do the rest. You don't have to say I know the way. Once or twice will do. I'll have it down by two. Watch what I do.

1:04:36

I learned it watching you. Now let me do it for you. Watch what I do. When you want some more, I've done it before. You just let it run, till the whole thing's done. Same time each night, till the morning light. Watch what I do. I learned it watching you. Now let me do it for you. Watch what I do. Same time tomorrow too. Watch what I do.