AI glossary / How it works
Model collapse
What can happen when AI is trained on too much AI-made content: quality and variety gradually decline.
Think of it as: A photocopy of a photocopy of a photocopy.
More words in How it works
- Multi-agent systemSeveral AI agents working together, each with its own job, such as one researching, one writing and one checking.
- Neural networkSoftware loosely inspired by the brain: layers of simple connected units that strengthen or weaken their links as they learn.
- OverfittingWhen a model memorises its practice examples so closely that it does badly on anything new.
- ParametersThe millions or billions of internal dials a model adjusts as it learns. More can mean more capable, but not always.
- Post-trainingEverything done to a model after its main training to make it helpful and safe, including instruction tuning and RLHF.