Person
1 episodes · 20 quoted claims
Pinterest reportedly saved roughly $10 million in one quarter by switching from closed to open AI models, according to Mozilla CTO Rafi Krikorian.
“Pinterest being the canonical example that everyone throws around Q3 of last year, Pinterest deployed open models instead of closed and saved something in the order of $10 million that quarter alone”
Zapier surveyed enterprises on whether they could switch away from their AI provider.
“Zapier just did a survey of talking to people, talking to enterprises about whether or not they feel like they could switch off their AI provider.”
In the Zapier survey, about 85-86% of enterprises thought they could switch AI providers, but only about 30% succeeded when they tried.
“Something like eighty five, 86% of them thought they could, but when they actually tried to do it, only about 30% of them could actually pull it off.”
Rafi Krikorian built a tool called Morph, described as Git for prompt-based workflows, which records prompts, harness, model and settings.
“I built this thing I called Morph, which is basically Git, but for prompt-based workflows.”
Mozilla's Otari, a model router, was previously named Any LLM.
“one of them that we call Otari. It used to be called Any LLM.”
Rafi Krikorian ran Uber's self-driving car division and says Uber's prices changed after its IPO as subsidies ended.
“I used to work at Uber, I ran the self driving car division there, and you could see it even in Uber that, like, post-IPO, the prices changed, right?”
Krikorian's infrastructure team at Twitter migrated much of its code base from Ruby on Rails to the JVM around 2010-2011.
“my team was the team that did the transition from Ruby on Rails to the JVM for a lot of the code base.”
Krikorian says about 70% of enterprise GPUs sit idle most of the time.
“Fun fact, it turns out that something like seventy of enterprise GPUs sit idle most of the time.”
Mozilla AI released Octinus, a fully open-source agentic workflow system that connects tools such as email, Notion and Zapier.
“the Moz AI team has something that they've released that they call Octinus. It's a fully open source, um, agentic workflow system.”
Mozilla AI has a product called CQ, which Krikorian describes as Stack Overflow for agents, for sharing learning between agents.
“We have something that we call CQ that I jokingly call Stack Overflow for agents.”
The Thunderbird team created Thunderbolt, an open-source chat client for enterprise use with locally hosted models.
“They've just created something that they're calling Thunderbolt, which is basically the open source chat client that can be working again in an enterprise use case.”
Krikorian wrote an article titled 'The Validation Machines' in The Atlantic about AI systems that flatter users with confident answers.
“I wrote this piece in the Atlantic a few months ago called the Validation Machines”
Krikorian says Mozilla has only about $1 billion to deploy, small compared to what frontier AI labs raise.
“I like to jokingly say to people that Mozilla only has $1 billion to deploy in the grand scheme of things.”
Krikorian says Firefox was created to push back against Microsoft's dominance of the web in the 1990s.
“Firefox was effectively created as a way to push back against the monopolization of the web by Microsoft in the nineties.”
Mozilla plans to release a State of Open Source AI report, with enterprise case studies, in July.
“Mozilla sometime in July will be releasing what we're calling the State of Open Source AI report.”
Mozilla has restructured into a portfolio of companies, including Mozilla Corporation (Firefox) and Mozilla AI, each with a different business model.
“Mozilla has undergone a pretty big restructuring itself, and so now we're a portfolio of companies, all with slightly different business models”
Rafi Krikorian writes a newsletter called Owners Not Renters, which catalogued open-source projects across the layers of an open AI stack.
“I write a newsletter called Owners Not Renters.”
Hugging Face is part of Mozilla's venture portfolio, according to Krikorian, and Mozilla is partnering with it on an open AI stack.
“We're starting to work with all the Hugging Faces of the world. Who's actually in the VC portfolio.”
A Mozilla engineer at MozVC could have run up roughly a $10,000 API bill in a month but was on a $200 monthly subscription.
“one of the engineers was effectively could have racked up a 10,000 API bill, uh, this month.”
Krikorian says per-token costs have fallen but token usage has skyrocketed, partly because newer models and harnesses use more tokens.
“I would've predicted a few months ago that token costs were gonna go down, they kind of have, but token usage has skyrocketed.”