- Entropy ✓ understood
A measure of uncertainty or randomness in a random variable from information theory.
- Mutual Information ✓ understood
A measure of dependence between variables, quantifying how much knowing one reduces uncertainty about the other.
- Dataset ✓ understood
A collection of data examples used for training, validating, or testing machine learning models.
- Feature ✓ understood
A single measurable property of an example, such as a house's floor area or how many links an email contains, used as an input to a model.
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Neural Network ✓ understood
A model built from layers of simple units, each taking a weighted sum of its inputs and applying a nonlinearity; training adjusts the weights so the whole stack maps inputs to useful outputs.
- Deep Learning ✓ understood
A subset of machine learning that uses neural networks with multiple layers (deep neural networks) to learn hierarchical representations of data.
- Representation Learning ✓ understood
Letting a model learn its own internal description of the data, such as embeddings or layered visual features, instead of relying on features designed by hand.
- Information Bottleneck · you are here ✓ understood