Code 2025
What We Learned Deploying AI within Bloomberg’s Engineering Organization – Lei Zhang, Bloomberg
Overview
This talk discusses Bloomberg's experience integrating AI into its engineering organization, focusing on practical applications and lessons learned. The core thesis is that AI tooling can significantly alter the cost function of software engineering, enabling a re-evaluation of fundamental principles and a shift towards higher-quality software development. The organization aimed to leverage AI to improve developer productivity and system reliability across its vast codebase and numerous functions.
Who should watch
- AI Engineers exploring practical applications of AI in software development.
- Product Managers and builders interested in how AI impacts engineering workflows.
- Teams struggling with code maintenance, migration, and incident response.
- Organizations looking to establish platforms and processes for AI tool adoption.
- Leaders seeking to understand how AI changes engineering trade-offs and decision-making.
Key takeaways
- Bloomberg, with over 9,000 software engineers, explored AI for coding to boost productivity and stability, initially focusing on quick proof-of-concept generation.
- The complexity of large codebases necessitates careful AI application, leading to initiatives like "uplift agents" for automated patching and refactoring, though challenges include verification and increased pull request review times.
- AI-powered "incident response agents" were developed to quickly analyze telemetry, logs, and codebases, offering an unbiased approach to troubleshooting.
- A "golden path" platform was created to standardize AI tool development and deployment, simplifying model selection, tool discovery, and the STLC process while ensuring quality control for production.
- Integrating AI coding into onboarding training proved effective for driving adoption and challenging existing practices, acting as a change agent within the organization.
- Cross-organizational communities and programs like "champ" and "guild" helped bootstrap AI productivity efforts, reduce duplicated work, and foster shared learning.
- Individual contributors showed stronger adoption of AI tools than leadership, highlighting a need for leadership workshops to equip managers with AI-guided software development knowledge.
- The adoption of AI fundamentally changes the cost-benefit analysis of engineering tasks, prompting a return to core principles of high-quality software engineering.
Notable quotes
*The right thing is extremely easy to do and we want to make sure the wrong thing is ridiculous hard to do.*
*The adoption of new things provide opportunity to leverage the strengths you have and also identify the some of the weakness that you may have.*
*With a lot of creativity and innovation in the GI space, it actually changes the cost function of software engineering.*
Unofficial community note. Prefer the recording for nuance.