Quantization
Reducing model precision (FP32 → INT8) to decrease size and increase inference speed with minimal accuracy loss.
Your route here
6 stops · basics first
- Dataset ✓ understood
A collection of data examples used for training, validating, or testing machine learning models.
- Training ✓ understood
The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.
- Inference ✓ understood
Running a trained model on new inputs to get predictions, with its weights frozen: the stage of a model's life that users actually interact with.
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Neural Network ✓ understood
A model built from layers of simple units, each taking a weighted sum of its inputs and applying a nonlinearity; training adjusts the weights so the whole stack maps inputs to useful outputs.
- Parameter ✓ understood
A number inside a model, a weight or a bias, that training adjusts to reduce the loss. Together, a model's parameters are everything it has learned.
- Quantization · you are here ✓ understood