Lessons from building GenAI based applications — Juan Peredo
This talk shares practical lessons learned from building Generative AI applications over the past year and a half. It emphasizes that while AI can accelerate development, integrating it introduces significant new complexities. Key challenges include model selection, preventing hallucinations, managing infrastructure costs (especially GPUs), ensuring correct outputs, and understanding the operational overhead of agentic systems. The speaker advocates for careful evaluation, externalizing prompts, and robust observability to navigate these complexities effectively.
33 min