Matt Carey

This talk introduces Eval++, a new compute primitive designed to enhance the development and deployment of AI agents. The core idea is to leverage Cloudflare's stateful serverless technology, specifically Durable Objects, as an ideal execution environment for agents. This approach enables long-running processes, persistence, and efficient scaling, fundamentally changing how developers can build and interact with AI-powered applications.

This talk addresses the challenge of providing AI agents with access to a vast number of APIs, a problem termed the Mega Context Problem (MCP). Traditional methods like bundling all tools into an agent's context window lead to an explosion of tokens, rendering them unusable. The speaker proposes that instead of dumping tools into context, agents should be empowered to write code against APIs, leveraging typed SDKs and secure execution environments.