World's Fair 2025
Don’t get one-shotted: Use AI to test, review, merge, and deploy code — Tomas Reimers, Graphite
Overview
The increasing adoption of AI tools in software development, particularly in the inner loop of coding, is creating a bottleneck in the outer loop of review, testing, merging, and deployment. This talk proposes that AI can also be leveraged to streamline and automate these outer loop processes, transforming the entire developer workflow rather than just the IDE.
Who should watch
- AI Engineers
- Product Managers
- Developers facing code review bottlenecks
- Teams looking to increase development velocity
- Builders seeking to integrate AI into their entire development lifecycle
Key takeaways
- AI tools like GitHub Copilot are significantly increasing code volume, making the traditional outer loop of code review, testing, and deployment a critical bottleneck.
- AI-generated code can introduce errors and security vulnerabilities, necessitating robust review processes.
- The future of software development requires an AI-native toolchain, not just AI-assisted IDEs, to handle the increased output.
- AI can automate and streamline manual, time-consuming tasks in the outer loop, allowing developers to focus on core product development.
- AI code review platforms can offer high-signal, low-noise feedback with deep codebase understanding, summarizing, prioritizing, and reviewing changes.
- These AI-powered systems can integrate with CI/CD pipelines to correct errors and failures, reducing review cycles and enforcing quality.
- AI-generated comments in code reviews are being accepted at a higher rate than human comments, indicating their effectiveness.
- Tools like Graphite's Diamond aim to provide a self-driving code review solution that enhances developer productivity and product delivery.
Notable quotes
*The outer loop was rapidly becoming the bottleneck.*
*AI can change your entire developer workflow, not just your IDE.*
*We see comments that our AI bot leaves to be downloaded at less than a 4% rate and to be accepted... at a higher rate than human comments are.*
Unofficial community note. Prefer the recording for nuance.