Standard 5 stops to get here

Concept Drift

When the relationship between inputs and the correct output changes over time, so a model's learned mapping goes stale even if the inputs look the same.

Your route here

5 stops · basics first
  1. Machine Learning ✓ understood

    Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.

  2. Supervised Learning ✓ understood

    Learning from examples paired with the correct answer, so a model can predict answers for new inputs it hasn't seen.

  3. Dataset ✓ understood

    A collection of data examples used for training, validating, or testing machine learning models.

  4. Training ✓ understood

    The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.

  5. Inference ✓ understood

    Running a trained model on new inputs to get predictions, with its weights frozen: the stage of a model's life that users actually interact with.

  6. Concept Drift · you are here ✓ understood

Picture it

Data drift

  • The inputs change: P(X) shifts
  • Same input still means the same answer
  • Decision boundary can stay valid

Concept drift

  • The relationship changes: P(y|X) shifts
  • Same input now deserves a different answer
  • The learned boundary itself goes stale
Notice that concept drift can happen even when the inputs look exactly as they did in training, which is why watching inputs alone can miss it.

Concept drift is what happens when the world changes the answer. A fraud model learns what fraud looked like last year; fraudsters adapt, and transactions that used to be safe now signal fraud. The inputs may look much the same, but the correct label for them has moved.

A supervised model learns a mapping from inputs X to outputs y. In probability terms it approximates P(y | X), the chance of each answer given the input. Lu and colleagues’ review breaks drift into sources. When only the input distribution P(X) changes, the decision boundary still holds; this is sometimes called virtual drift, and in production it is usually tracked as data drift. When P(y | X) itself changes, the boundary moves and accuracy falls. That is concept drift in the strict sense. Often both happen at once.

Shapes of drift

The same review describes drift by how it unfolds over time:

  • Sudden: the concept switches abruptly, for example after a policy or product change.
  • Gradual: the new concept increasingly replaces the old one over a period.
  • Incremental: the concept slides steadily from old to new.
  • Recurring: an earlier concept comes back, as with seasonal patterns.

Detecting and handling it

Because inputs can look normal, the most direct signal is the model’s own error rate on fresh labeled data, which often arrives late. Model monitoring therefore combines input statistics with delayed accuracy checks and proxy metrics. The usual responses are retraining on recent data, weighting recent examples more heavily, or online learning that updates the model continuously. The general term for the resulting drop in quality is model drift.

Where it sits

Concept Drift

Leads to

Nothing yet: a destination in its own right.

Explore nearby

Sources

  1. Lu, Liu, Dong, Gu, Gama and Zhang, "Learning under Concept Drift: A Review" . IEEE Transactions on Knowledge and Data Engineering, 2018