What is a large language model (LLM) and how does it work?

An LLM is a neural network trained on vast amounts of text to predict the next token in a sequence. Through this process it develops internal representations of language, facts, and reasoning patterns. At inference time, it generates text autoregressively — one token at a time — based on the context (prompt) provided.