Standard 5 stops to get here · leads to 1

Stochastic Gradient Descent

A variant of gradient descent that updates parameters using gradients computed on a single random training example at a time (though often used to refer to mini-batch gradient descent).

Your route here

5 stops · basics first
  1. Dataset ✓ understood

    A collection of data examples used for training, validating, or testing machine learning models.

  2. Training ✓ understood

    The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.

  3. Loss Function ✓ understood

    A function that scores how wrong a model's prediction is as a single number, which training then works to make as small as possible.

  4. Gradient Descent ✓ understood

    An optimization method that repeatedly moves a model's parameters a small step in the direction that most reduces the loss.

  5. Optimizer ✓ understood

    The algorithm that turns gradients into weight updates during training, deciding how far and in which direction each parameter moves at every step.

  6. Stochastic Gradient Descent · you are here ✓ understood

Where it sits

Stochastic Gradient Descent

Explore nearby