Code 2025
Leadership in AI Assisted Engineering – Justin Reock, DX (acq. Atlassian)
Overview
This talk explores the current impact and future potential of AI-assisted engineering, emphasizing that while AI can augment developers, its effective integration requires careful consideration of productivity metrics, organizational culture, and strategic implementation across the software development lifecycle. The core thesis is that AI's true value lies in enhancing, not replacing, engineers, and achieving positive outcomes depends on addressing variability in adoption and impact through education, clear communication, and a focus on psychological safety.
Who should watch
- AI Engineers
- Product Managers
- Builders and developers seeking to leverage AI tools
- Leaders aiming to improve developer productivity and experience
- Those struggling with AI adoption or measuring its impact
- Organizations looking to integrate AI across their SDLC
Key takeaways
- The impact of GenAI on productivity is highly variable, with studies showing both increases and decreases, highlighting the need to move beyond simple averages.
- Top-down mandates and a lack of education hinder AI adoption; successful integration requires providing time for learning and experimentation.
- AI's greatest potential lies in augmenting developers and addressing bottlenecks across the entire SDLC, not just in code completion.
- Measuring AI impact requires looking beyond basic utilization metrics to core developer experience indicators like change failure rate and change confidence.
- Psychological safety is a critical factor for high-performing teams, and this principle extends to fostering trust and reducing fear around AI adoption.
- Effective AI integration involves unblocking usage through creative solutions like self-hosted models and partnering with compliance teams early.
- Understanding model parameters like temperature is crucial for controlling the determinism and creativity of AI outputs based on specific use cases.
- Successful AI strategies often involve distributing guides, establishing feedback loops for system prompts, and tying AI skills to employee success.
Notable quotes
*We need to make sure that people understand that this is not a technology that is ready to replace engineers. This is a technology that's really good at augmenting engineers and increasing the throughput of our business.*
*AI is not coming for your job, but somebody really good at AI might take your job.*
*An hour saved on something that isn't the bottleneck is worthless.*
Unofficial community note. Prefer the recording for nuance.