Support-Vector Networks
Corinna Cortes et al. · Machine Learning
doi:10.1007/BF00994018
In short
The paper introduces the support-vector machine: a classifier that picks the boundary with the widest possible margin between two classes, defined only by the few training points closest to it. Kernels let the same method draw curved boundaries, and a soft margin lets it tolerate noisy, overlapping data.
Why it matters
SVMs were the default strong classifier for a decade and made margins and kernels part of every practitioner’s vocabulary.
Read first
The 4 Field Guide ideas this paper leans on.
Starting from scratch? The full route 7 ideas · basics first
- Machine Learning ✓ understood
Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.
- Supervised Learning · read first ✓ understood
Learning from examples paired with the correct answer, so a model can predict answers for new inputs it hasn't seen.
- Classification · read first ✓ understood
A supervised learning task where the model assigns each input to one of a fixed set of categories, such as spam or not spam.
- Support Vector Machine · read first ✓ understood
A supervised learning algorithm that finds the optimal hyperplane to separate classes with maximum margin.
- Neural Network ✓ understood
A computational model inspired by biological neural networks, consisting of interconnected nodes (neurons) organized in layers that process information through weighted connections.
- Convolution ✓ understood
A mathematical operation that applies filters/kernels to input data to extract features like edges, textures, and patterns.
- Kernel · read first ✓ understood
A small matrix of weights used in convolutional layers to detect specific features or patterns in input data.