Learn how to fast train your LLMs by maximizing utilization of TPUs. In this talk, we are going to start with training a GPT2 model with JAX from scratch on Colab and Kaggle TPUs for free. To scale it up, we will transition to the latest TPUs and the cutting edge MaxText library to train the state-of-the-art LLMs.