Europe 2026
Scaling GitHub for your Agents — Sam Morrow, GitHub
Overview
This talk discusses the challenges and solutions encountered by GitHub in building and scaling their MCP (Multi-modal Communication Protocol) server for AI agents. The core thesis revolves around managing the complexity of tool integration, optimizing context window usage, and enhancing security in agentic systems. The presentation highlights how GitHub has iterated on its server architecture and features to improve agent performance and user experience.
Who should watch
- AI engineers and developers working with agentic systems.
- Product Managers and builders evaluating agent capabilities and infrastructure.
- Those facing challenges with tool management, context window bloat, and agent security.
- Individuals interested in the practical application and scaling of open-source agent frameworks.
Key takeaways
- Initially, adding more tools to agents led to decreased performance and confusion, a problem identified in research as early as February of the previous year.
- GitHub implemented features like tool sets and dynamic tool selection to manage tool complexity, but users often defaulted to less optimized configurations.
- Significant effort was put into reducing context window usage by focusing tools on general use cases and grouping CRUD operations, achieving substantial token reductions.
- Tool failures were addressed by encoding agent intent into the tool surface and performing multiple API calls server-side to improve robustness and user experience.
- Security is a major concern, with a focus on moving away from plain text access tokens towards more secure methods like OAuth 2.1 with PKCE support.
- The server architecture is stateless, creating a new server instance for each request and adding tools dynamically to handle high volumes of tool calls efficiently.
- GitHub is experimenting with features like MCP apps and an Insiders mode to allow users to test new functionalities, such as human-in-the-loop editing for AI-generated issues.
- The future of agentic systems likely involves automatic server discovery, compositional tool use, and a more seamless user experience where MCP itself becomes less visible.
Notable quotes
*More tools don't make better agents, you know, they get confused and forgetful.*
*It's actually hard to make configuration easy and secure at the same time.*
*The utility of agents is in conflict direct conflict with kind of protecting this stuff.*
Unofficial community note. Prefer the recording for nuance.