| Output | What it makes | Well-known examples |
|---|---|---|
| Text | Answers, summaries, letters, translations | Chatbots such as ChatGPT, Gemini and Claude |
| Images | Pictures from a written description | Image generators such as DALL-E, Midjourney and Stable Diffusion |
| Audio | Speech in a chosen voice, music | Text-to-speech and voice tools |
| Code | Programs, spreadsheet formulas, bug fixes | Coding assistants such as GitHub Copilot |
How an LLM builds an answer, one token at a time
- Take the text so far Your prompt plus everything written up to now
- Estimate how likely each next token is A token is a word or a piece of a word
- Pick one token
- Add it to the text Then the loop repeats until the answer is complete
Then back to step 1: Take the text so far
| Letter | Word | Meaning |
|---|---|---|
| G | Generative | It produces new text rather than only classifying text |
| P | Pre-trained | It is first trained on a huge general text collection, then adapted |
| T | Transformer | A neural-network design that uses 'attention' to weigh how the words in a passage relate to one another |
| Setting | What it controls | In practice |
|---|---|---|
| Temperature | How much randomness is allowed when the next token is chosen | Lower: more focused, more repeatable wording. Higher: more varied, more surprising wording. It does not change what the model knows. |
| Context window | How much text, counted in tokens, the model can take into account at once: instructions, the conversation, pasted documents and its own reply | Text beyond the limit cannot be considered, so in a very long chat early instructions or details may be lost or need repeating. |
Choosing the temperature
-
Lower temperature
- More focused, more repeatable wording
- Suits: each day's notes as a five-point summary in the same layout
- Does not make answers more true
-
Higher temperature
- More varied, more surprising wording
- Suits: twenty different slogans for a poster
- Does not change what the model knows
An LLM writes by predicting the next token, again and again. Temperature changes how varied the wording is, not how true it is. The context window limits how much text it can consider at once.
Key takeaways: an LLM is pre-trained on huge text collections, then fine-tuned, and writes one token at a time. GPT means Generative Pre-trained Transformer; diffusion models turn noise into images. Higher temperature gives variety, lower gives consistency - never truth. Restate what matters in long chats.