Landmark 6 stops to get here · leads to 3

Image Classification

Assigning one label from a fixed set of categories to a whole image, such as "cat" or "defective part"; a core computer vision task.

Your route here

6 stops · basics first
  1. Machine Learning ✓ understood

    Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.

  2. Supervised Learning ✓ understood

    Learning from examples paired with the correct answer, so a model can predict answers for new inputs it hasn't seen.

  3. Classification ✓ understood

    A supervised learning task where the model assigns each input to one of a fixed set of categories, such as spam or not spam.

  4. Neural Network ✓ understood

    A model built from layers of simple units, each taking a weighted sum of its inputs and applying a nonlinearity; training adjusts the weights so the whole stack maps inputs to useful outputs.

  5. Deep Learning ✓ understood

    A subset of machine learning that uses neural networks with multiple layers (deep neural networks) to learn hierarchical representations of data.

  6. Computer Vision ✓ understood

    The field of AI that gets computers to extract meaning from images and video: what is in them, where it is, and how it moves.

  7. Image Classification · you are here ✓ understood

Picture it

  1. 01 Input image A grid of pixel values, e.g. 224×224×3
  2. 02 Feature extractor A CNN or vision transformer
  3. 03 Class scores One logit per category
  4. 04 Softmax Scores become probabilities
  5. 05 One label e.g. "cat" at 0.92
Notice the whole image collapses to a single label: the model never says where the object is, only what the image is.

Image classification is the task of looking at a whole image and assigning it one label from a fixed list: “cat”, “pneumonia”, “defective part”. It is the simplest core task in computer vision, and for about a decade it was the benchmark that drove the field forward.

It is a kind of classification where the input happens to be a grid of pixels. A 224×224 colour image is about 150,000 numbers, and the model has to map all of them to a single category while ignoring lighting, angle, background and the thousand ways a cat can sit.

How a classifier works

Reading the diagram left to right: the image goes into a feature extractor, which turns raw pixels into a compact description of what’s in the picture. For years that meant a convolutional network; increasingly it’s a vision transformer, which cuts the image into patches and treats them like tokens. A final layer produces one score per class, and a softmax turns the scores into probabilities. The top one is the answer.

Everything spatial is thrown away at the end. The classifier says the image contains a cat, not where it is or how many there are. Those questions belong to object detection and semantic segmentation, which usually start from a backbone first trained on classification.

The ImageNet years

The field’s yardstick was the annual challenge built on ImageNet, a dataset introduced in 2009; the challenge version has 1,000 categories and about 1.4 million labelled images. The organizers’ 2014 retrospective records top-5 classification error (the right answer missing from the model’s five guesses) falling from 28.2% in 2010 to 16.4% in 2012, when a deep CNN, AlexNet, won decisively, and to 6.7% by 2014. One trained human annotator, tested on a sample, scored 5.1%. In 2015 ResNet reached 3.57% with networks up to 152 layers deep.

The catch

High benchmark accuracy doesn’t guarantee the model learned what you meant. A classifier can latch onto shortcuts, such as a background or a watermark that happens to co-occur with one class, and fail when that cue changes. It is also forced to pick from its fixed label list, so an image of something unfamiliar still gets a confident-looking answer. In practice most teams don’t train from scratch: they take a network pre-trained on a large dataset and fine-tune it on their own labels, a form of transfer learning that needs far less data than starting over.

Where it sits

Explore nearby

In the research

All papers →

2 papers that build on Image Classification .

Sources

  1. Russakovsky et al., "ImageNet Large Scale Visual Recognition Challenge" . 2014; International Journal of Computer Vision, 2015
  2. He et al., "Deep Residual Learning for Image Recognition" . 2015
  3. Dosovitskiy et al., "An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale" . 2020 (Vision Transformer)