Finetuning: 500m AI agents in production with 2 engineers — Mustafa Ali & Kyle Corbitt
This talk details how Method scaled its AI agent operations to over 500 million agents with a small engineering team. Initially, they faced challenges with manual data aggregation processes and later with the high costs and limitations of using large language models like GPT-4 for parsing unstructured financial data. The solution involved fine-tuning smaller, more efficient models to meet specific production requirements for accuracy, latency, and cost.
19 min