Antje Barth

This talk introduces perception agents, a new paradigm in human-agent collaboration that moves beyond text-based interactions. Current agents often require detailed textual prompts and struggle with dynamic visual interfaces or unexpected application behaviors. Perception agents aim to bridge this gap by enabling AI to see, understand, and interact with computer interfaces similarly to humans, using clicks and keystrokes to act upon visual information.

This talk explores building AI agents at cloud scale, emphasizing the reinvention of customer experiences and the development of new AI-powered applications. It highlights the significant integration of agentic capabilities and large language models (LLMs) in reimagining existing services like Alexa, which now operates on over 600 million devices. The presentation introduces a model-driven approach and an open-source Python SDK called Strand Agents, designed to accelerate the development and deployment of production-ready AI agents.