AI glossary / How it works
GPT
Generative pre-trained transformer. The type of model behind ChatGPT: it generates text, was trained in advance on lots of writing, and uses the transformer design.
More words in How it works
- Gradient descentThe method a model uses to improve during training: take a small step in whichever direction reduces its errors, and repeat millions of times.
- Ground truthThe known correct answer that an AI's output is checked against.
- HandoffWhen one AI agent passes a task, and everything it knows about it, to another agent better suited to continue.
- InferenceThe moment an AI model is actually used: you ask, it works out an answer. Training is learning, inference is doing.
- Instruction tuningExtra training that teaches a model to follow requests, turning a text predictor into a helpful assistant.