Foundry Local: Cutting-Edge AI experiences on device with ONNX Runtime/Olive — Emma Ning, Microsoft
Foundry Local is a Microsoft solution designed to enable developers to build cross-platform AI applications that run directly on user devices. It addresses the need for local AI by providing reasons such as offline access, enhanced privacy and security for sensitive data, cost efficiency for high-volume inference, and real-time latency requirements. The platform leverages ONNX Runtime for accelerated on-device inference across various hardware, integrating with Azure AI Foundry for model management and on-demand downloads.
World's Fair 2025 23 min