AITipbits

AI glossary / How it works

Gradient descent

How it works

The method a model uses to improve during training: take a small step in whichever direction reduces its errors, and repeat millions of times.

Think of it as: Walking downhill in fog by always stepping where the ground slopes down.

More words in How it works

Browse all 225 wordsTest yourselfGet the weekly email