Lenny Rachitsky says the head of Claude Code, Boris, said the team doesn't run evals on Claude Code and relies on feel.
“The head of Claude Code, Boris, was like, Nah, we don't do evals on Claude Code, it's all vibes.”
Person
Lenny Rachitsky
3 episodes · 9 quoted claims
- 11 Jan 2026Why most AI products fail: Lessons from 50+ AI deployments at OpenAI, Google, and Amazon1h 26m
- 21 Dec 2025The coming AI security crisis (and what to do about it) | Sander Schulhoff1h 32m
- 28 Aug 2025How 80,000 companies build with AI: products as organisms, the death of org charts, and why agents will outnumber employees by 2026 | Asha Sharma (CVP of AI Platform at Microsoft)57m
Lenny Rachitsky says the name 'continuous calibration, continuous development' is an homage to the software practice of continuous integration and continuous deployment.
“this, this naming is kind of a a ode to, uh, CI, C, CI, CD So, yes, continuous integration, continuous deployment.”
Lenny Rachitsky says Jason Lemkin replaced most of his sales team with AI agents, going from ten salespeople to one human and 20 agents.
“And he replaced his whole sales team with agents. He had ten salespeople, and now he has one, two and 20 agents.”
Lenny Rachitsky introduces Kiriti Badam as someone who works on Codex at OpenAI after a decade building AI and ML infrastructure at Google and Kumo.
“Kiriti works on Codex at OpenAI and has spent the last decade building AI and ML infrastructure at Google and at Kumo.”
Lenny Rachitsky introduces Aishwarya Reganti as an early AI researcher at Alexa and Microsoft with over 35 published research papers.
“Ash was an early AI researcher at Alexa and Microsoft and has published over 35 research papers.”
A researcher reported a second-order prompt injection against ServiceNow's Now Assist AI, in which a benign agent recruited more powerful agents to read and change database records.
“I instructed a seemingly benign agent to recruit more powerful agents in fulfilling a malicious and unintended attack, including performing create, read, update and delete actions on the database”
Lenny says ServiceNow's prompt injection protection feature was enabled when the researcher's attack got through.
“service now has a prompt injection protection feature, and it was enabled as this, uh, person was trying to hack it and they got through”
Asha Sharma was previously chief operating officer at Instacart and vice president of product at Meta, where she ran Messenger, Instagram Direct, Messenger Kids and Remote Presence.
“She was previously COO at Instacart and VP of Product at Meta, where she ran Messenger, Instagram Direct, Messenger Kids and Remote Presence.”
Asha Sharma sits on the boards of The Home Depot and Coupang and holds a second-degree black belt in Taekwondo.
“She also sits on the boards of the Home Depot and Coupang, and she is a 2nd degree black belt in Taekwondo.”