Angelos Perivolaropoulos

This talk provides a hands-on guide to training a transformer-based Large Language Model (LLM) from scratch using PyTorch. It covers the fundamental building blocks of LLMs, including tokenization, model architecture, and the training loop, demonstrating how to implement these components with minimal code. The session emphasizes practical application, enabling participants to train a small model locally or on cloud platforms like Google Colab.