| Output | What it makes | Well-known examples |
|---|---|---|
| Text | Answers, summaries, letters, translations | Chatbots such as ChatGPT, Gemini and Claude |
| Images | Pictures from a written description | Image generators such as DALL-E, Midjourney and Stable Diffusion |
| Audio | Speech in a chosen voice, music | Text-to-speech and voice tools |
| Code | Programs, spreadsheet formulas, bug fixes | Coding assistants such as GitHub Copilot |
How an LLM builds an answer, one token at a time
- Take the text so far Your prompt plus everything written up to now
- Rate every possible next token How likely each word or piece of a word is to come next
- Pick one token Usually a likely one; temperature adds some randomness
- Add it to the text Then the loop repeats until the answer is complete
Then back to step 1: Take the text so far
| Letter | Word | Meaning |
|---|---|---|
| G | Generative | It produces new text rather than only classifying text |
| P | Pre-trained | It is first trained on a huge general text collection, then adapted |
| T | Transformer | A neural-network design that uses 'attention' to weigh how the words in a passage relate to one another |
GPT = Generative Pre-trained Transformer. An LLM writes by predicting the next token, again and again; it predicts likely text, it does not look up verified facts.
How a diffusion model makes a picture
- Start from pure random noise
- Remove a little noise Steered by your text prompt
- Repeat step by step Each step reverses one step of added noise learned in training
- An image appears
| System | Creates new content? | Type |
|---|---|---|
| Email app moving a message to spam | No - it labels an existing email | Predictive |
| Chatbot drafting a leave application | Yes - new text | Generative |
| Phone unlocking when it sees your face | No - it matches a face | Predictive |
| App turning 'a poster for a science fair' into a picture | Yes - new image | Generative |
Key takeaways: generative AI creates new content; predictive AI sorts or scores existing content. An LLM writes by repeatedly predicting the next token after pre-training on huge text collections, then fine-tuning and human feedback. GPT means Generative Pre-trained Transformer. Diffusion models make images by removing noise step by step, guided by the prompt.