- GPU ✓ understood
Graphics Processing Unit - hardware accelerator with thousands of cores, essential for parallel computation in deep learning.
- Dataset ✓ understood
A collection of data examples used for training, validating, or testing machine learning models.
- Training ✓ understood
The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.
- Distributed Training ✓ understood
Training one model across many GPUs or machines at once, by splitting the data, the model, or both, and keeping every copy in sync.
- Data Parallelism ✓ understood
Replicating the model across devices, each processing different data batches.
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Neural Network ✓ understood
A model built from layers of simple units, each taking a weighted sum of its inputs and applying a nonlinearity; training adjusts the weights so the whole stack maps inputs to useful outputs.
- Layer ✓ understood
A collection of neurons/operations that process data together, neural networks are composed of stacked layers.
- Model Parallelism ✓ understood
Splitting a single model across several devices, by layers or within layers, so that a model too large for one accelerator can still be trained and run.
- Pipeline Parallelism · you are here ✓ understood