Person
1 episodes · 13 quoted claims
Anthropic asked Claude Sonnet 4.5 to recreate the Claude.ai chat application from scratch, and it worked overnight to do so.
“we asked Claude to recreate Claude.ai, like our our consumer chat application from scratch. And Sonnet 4.5 just like worked overnight”
Anthropic released its artifacts feature about a year earlier, built by hand by its engineers.
“we released artifacts a year ago. It was like artisanally created by a whole bunch of like wonderful engineers around me at Anthropic”
The Claude.ai rebuild took about twelve hours, and Anthropic has seen up to thirty hours of continuous development work before the model struggles.
“That specific one was like a twelve hour thing. We've seen like up to thirty hours of continuous dev work until the model would start to start to struggle.”
Anthropic's Justin built the chat app using the Claude Agents SDK, a more programmatic version of Claude Code.
“he was experimenting using our Claude Agents SDK, which is just sort of like, uh, more programmatic version of Claude Code.”
Hershey says Anthropic has made meaningful progress on sycophancy and that Sonnet 4.5 is more willing to push back on users.
“I do think we have made meaningful progress and this model seems to be a little bit more willing to, uh, push back”
Hershey says Sonnet 4.5 works by handling one small piece at a time, which he finds more like how a coworker works than earlier models.
“But it just like bites off one little chunk at a time, and that feels a lot more like what I want a coworker to work like”
Hershey says Claude still has poor spatial awareness and struggles to tell left from right.
“it's really bad at spatial awareness, still, and this it annoys me to no end. Like it, it just like, basically doesn't know the difference between left and right and up and down.”
Cognition published a post about how much its Devin product improved with Sonnet 4.5.
“They put out a post yesterday about how much their their product devin improved with the model and some of the work they did to to make that product better.”
Hershey says he is confident Claude Sonnet 4.5 is the best coding model in the world, citing benchmarks.
“I'm pretty confident that this is the best coding model in the world. We have a lot of benchmarks and other things to prove that out.”
Hershey describes Lovable as an enterprise customer of Anthropic that became a consumer hit.
“Like Lovable is a great example, where, you know, it's like, that's an enterprise customer to from my perspective, that I spend a bunch of time working with”
Hershey says Claude Code has captured a prosumer audience that loves the product.
“there's like a very prosumer-y thing that we've captured with Claude Code.”
Hershey says he has seen Sonnet 4.5 deploy a complex application to AWS autonomously and run a security audit on it.
“I've seen it be able to deploy a complex application to AWS, like fully autonomously, and do like a security audit on it.”
Hershey says legal AI companies he works with employ lawyers on staff to help build and judge their products.
“have this interesting build of companies that have like lawyers on staff to help with product building”