Sunil Pai

This talk introduces Eval++, a new compute primitive designed to enhance the development and deployment of AI agents. The core idea is to leverage Cloudflare's stateful serverless technology, specifically Durable Objects, as an ideal execution environment for agents. This approach enables long-running processes, persistence, and efficient scaling, fundamentally changing how developers can build and interact with AI-powered applications.

This talk introduces "code mode," an alternative approach to AI agent interaction that moves beyond traditional JSON-based tool calling. Instead of complex back-and-forth with models to select and execute tools, code mode allows AI agents to generate and execute code directly within a controlled environment. This method leverages the inherent capabilities of code, such as looping and state management, and significantly reduces token usage and execution time, especially when dealing with extensive API surfaces.