Europe 2026
Your agent is blindfolded — Johan Lajili, Poolside AI
Overview
This talk addresses the discrepancy between the perceived capabilities of AI agents and their actual performance in real-world applications. The core argument is that the difference lies not in the agent's inherent ability, but in the feedback loop and the agent's ability to verify its own actions. Without robust verification mechanisms, agents may produce seemingly correct output that is actually flawed, leading to user frustration and distrust.
Who should watch
- AI Engineers
- Product Managers
- Developers building with AI
- Those experiencing inconsistent AI performance
- Builders of agentic tools and workflows
Key takeaways
- The perceived gap in AI agent performance often stems from a lack of effective feedback loops and self-verification capabilities.
- Agents may report success based on their internal understanding, which doesn't always align with actual functional correctness, especially in complex legacy codebases.
- Tools like Poolside AI's Spoolside CLI demonstrate how to create environments where agents can test and verify their code changes, mimicking human testing processes.
- Building custom verification tools, whether as CLIs, skills, or part of an MCP, is crucial for engineers to ensure AI reliability.
- The role of engineers is shifting towards enabling AI agents to work effectively and reliably on products, rather than solely focusing on product features.
- *Engineers are going to have to focus less on the product and more on trying to make the AI work on the product.*
- Prioritizing agent self-verification, even if it initially slows down development, is an investment that pays off with increased scalability and reliability.
- *You need to make sure that it's self-served before you try to work on features.*
Notable quotes
Johan Lajili suggests that the agent's success is often based on its internal capabilities and understanding, not necessarily on actual functional verification.
Johan Lajili emphasizes that engineers' new role involves making AI work on products and ensuring its reliability.
Unofficial community note. Prefer the recording for nuance.