Productivity
5 sessions
- How METR measures Long Tasks and Experienced Open Source Dev Productivity - Joel Becker, METR
This talk explores the challenges and potential of measuring AI capabilities, particularly focusing on developer productivity and long-term task completion. It questions the extrapolation of current AI progress trends, suggesting that physical and economic constraints, alongside potential technological breakthroughs, could alter the trajectory of AI development. The discussion also delves into the complexities of evaluating AI in real-world scenarios beyond controlled benchmarks, highlighting the gap between AI capabilities and practical application in fields like software engineering and data science.
- Developer Experience in the Age of AI Coding Agents – Max Kanat-Alexander, Capital One
This talk explores how to optimize developer experience in the era of AI coding agents. It argues that investments in foundational aspects of software development, such as standardized environments, robust validation, and clear documentation, will benefit both human developers and AI agents. The core thesis is that practices good for human developers are also good for AI, ensuring long-term value regardless of AI advancements.
- Leadership in AI Assisted Engineering – Justin Reock, DX (acq. Atlassian)
This talk explores the current impact and future potential of AI-assisted engineering, emphasizing that while AI can augment developers, its effective integration requires careful consideration of productivity metrics, organizational culture, and strategic implementation across the software development lifecycle. The core thesis is that AI's true value lies in enhancing, not replacing, engineers, and achieving positive outcomes depends on addressing variability in adoption and impact through education, clear communication, and a focus on psychological safety.
- Keynote: The AI developer experience doesn't have to suck – why and how we built Modal
This talk addresses the challenges in the AI developer experience, arguing that it doesn't have to be cumbersome. The speaker introduces Modal, an infrastructure platform designed to make writing, deploying, and scaling data, AI, and machine learning applications enjoyable again. Modal focuses on high-code use cases, allowing developers to run arbitrary Python code and containers in the cloud, abstracting away complex infrastructure management.
- Unlocking Developer Productivity across CPU and GPU with MAX: Chris Lattner
This talk introduces MAX, an AI framework designed to enhance developer productivity and performance across both CPU and GPU hardware. It addresses the fragmentation and complexity in the current AI development landscape, aiming to provide a unified, high-performance solution that allows developers to own and control their AI models and data. MAX focuses on inference and aims to simplify the deployment of PyTorch models and generative AI applications.