Foundational course

How LLMs Generate Text

This course explains the core mechanics and brief history behind modern LLMs. You'll learn about tokenization, embeddings, attention, sampling, special tokens and prompt templates, to develop an intuitive understanding of LLMs.