Luminal - Search-Based Deep Learning Compilers - Joe Fioti
Luminal is a deep learning library that aims for radical simplification through search-based compilation. Instead of the complex, multi-million line codebases of traditional libraries like PyTorch, Luminal represents models as simple directed acyclic graphs of a minimal set of core operations. This simplified representation allows for a compiler that uses search to discover highly optimized kernels, including complex ones like FlashAttention, which were previously difficult to implement.
World's Fair 2025 25 min