The era of unbounded products: Designing for Multimodal IO: Ben Hylak

This talk explores how programmers can leverage Large Language Models (LLMs) to significantly boost their productivity, aiming for a "10x" improvement. The core thesis is that LLMs should be treated not as autonomous reasoning agents, but as powerful translation engines and world simulators. By understanding how to decompose problems into language translation steps and by creatively framing prompts, developers can unlock new levels of efficiency and innovation.

This talk explores the rapidly evolving landscape of AI music generation, demystifying the technology and demonstrating practical applications. It covers various categories of AI music, including voice conversion, text-to-music, and audio-to-music generation, highlighting tools like Suno and Udio. The presentation aims to equip attendees with the knowledge to transform musical ideas into finished songs and discusses the emerging opportunities for artists in this new domain.

This talk focuses on the advantages and practicalities of using open-source models for production AI applications. It highlights how custom-tuned, smaller models can outperform larger, general-purpose proprietary models in terms of speed, cost, and domain-specific accuracy. The presentation also addresses the challenges of deploying open-source models, such as setup complexity and optimization, and introduces Fireworks AI's platform designed to streamline these processes.

This talk details Zapier's approach to building AI-powered products, emphasizing an iterative development process heavily reliant on robust evaluation and observability. The speakers share their journey of integrating AI features, highlighting the challenges and successes encountered when developing and refining tools like the AI Zap Builder and Zapier Copilot. Their strategy involves close collaboration between product and engineering teams, continuous testing, and leveraging platforms like Braintrust to ensure product quality and performance.

This talk explores the concept of personality-driven development in AI agents, where agents are given distinct forms and personalities to enhance user interaction and understanding. The speaker argues that anthropomorphizing AI, while not new, becomes particularly relevant with modern agents, influencing user perception and expectations. This approach aims to simplify complex AI functionalities by mapping them to familiar human roles and traits, thereby improving product development and user experience.