Simon Willison

This talk explores the rapid evolution of AI coding agents, focusing on Anthropic's Claude Code and its advancements like Fable and Claude Tag. The discussion highlights how these tools have shifted from requiring constant oversight to enabling more complex tasks and proactive assistance, fundamentally changing software development workflows. The speakers emphasize the increasing importance of product sense and business acumen for engineers as execution becomes more streamlined.

The AI landscape has accelerated dramatically over the last six months, with numerous significant model releases making it challenging to assess their quality. Traditional benchmarks and leaderboards are losing credibility, prompting a shift towards more practical, self-devised evaluation methods. The speaker uses a unique benchmark involving generating SVGs of pelicans riding bicycles to assess model capabilities, highlighting the rapid progress in model performance and the increasing accessibility of powerful AI on consumer hardware.