Europe 2026
GPU Cloud Deployment Without Leaving Your IDE — Audry Hsu, RunPod
Overview
This talk introduces RunPod's Flash, a Python SDK designed to streamline the development and deployment of AI models on GPU infrastructure. The core thesis is that developers can significantly reduce iteration time by deploying functions directly to the cloud from their local IDE, eliminating the need for manual commits, Docker builds, and server configuration. This allows for rapid testing and iteration on GPU-accelerated workloads.
Who should watch
- AI Engineers
- ML Engineers
- Developers building and deploying AI applications
- Anyone frustrated with lengthy infrastructure setup and iteration cycles for GPU-based models
- Teams looking to simplify GPU cloud deployment
Key takeaways
- RunPod offers a cloud infrastructure platform focused on making AI workloads scalable and accessible, abstracting away hardware and configuration complexities.
- The Flash Python SDK enables developers to deploy Python functions directly to RunPod's GPU cloud from their local development environment.
- Flash supports hot module reloading, allowing for immediate testing of code changes without manual redeployment steps.
- Developers can specify GPU families, maximum workers, and other configurations directly within the Flash endpoint decorator.
- The SDK facilitates rapid prototyping by allowing quick switching between different models (e.g., Stable Diffusion XL Turbo, DreamShaper) and adjusting inference parameters.
- Flash can be integrated into larger pipelines, orchestrating calls to multiple models and services for complex AI workflows.
- RunPod offers different deployment options including on-demand pods, reserved pods, serverless scaling, and pre-vetted open-source AI repositories on its Hub.
- Serverless deployment on RunPod is priced based on active worker uptime, with recommendations to start with lower worker counts or pods during experimentation.
Notable quotes
*We bring the hardware, we bring the GPUs and the compute. We make it easy for you guys to bring your code, bring your models, and deploy as quickly as possible.*
*Flash is our Python SDK, is that we want to eliminate all of that iteration cycle so that you can deploy your function on a GPU right from your local development environment.*
*Everything around it, your main function, any helper functions that you have, those all run on your local development environment, but if you need GPU compute, that that can run on the cloud.*
Unofficial community note. Prefer the recording for nuance.