Landmark 18 stops to get here · leads to 1

Hallucination

When a language model produces fluent, confident output that is false or unsupported by its sources, such as invented facts, quotes or citations.

Your route here

18 stops · basics first
  1. Natural Language Processing ✓ understood

    The field of AI that lets computers read, interpret, translate and generate human language, from spam filters and search to chatbots.

  2. Token ✓ understood

    The unit of text a language model reads and writes: a word, part of a word, or a character, drawn from the model's fixed vocabulary.

  3. Tokenization ✓ understood

    Splitting text into tokens, usually subword pieces, and mapping each to an integer ID so a language model can process it.

  4. Language Modeling ✓ understood

    Assigning probabilities to sequences of text, in practice by predicting each next token from the ones before it; the objective behind large language models.

  5. Dataset ✓ understood

    A collection of data examples used for training, validating, or testing machine learning models.

  6. Training ✓ understood

    The process of fitting a model to data by repeatedly measuring how wrong its outputs are and adjusting its parameters to reduce that error.

  7. Machine Learning ✓ understood

    Building systems that learn patterns from data instead of following hand-written rules, getting better at a task as they see more examples.

  8. Unsupervised Learning ✓ understood

    Learning from unlabeled data to discover hidden patterns, structures, or relationships without explicit target outputs.

  9. Self-Supervised Learning ✓ understood

    Training on unlabeled data by making the data supply its own answers: hide or alter part of an input and have the model predict or match it.

  10. Pre-training ✓ understood

    Training a model on a large dataset (often self-supervised) before fine-tuning on specific tasks, enabling transfer learning.

  11. Feature ✓ understood

    A single measurable property of an example, such as a house's floor area or how many links an email contains, used as an input to a model.

  12. Neural Network ✓ understood

    A model built from layers of simple units, each taking a weighted sum of its inputs and applying a nonlinearity; training adjusts the weights so the whole stack maps inputs to useful outputs.

  13. Deep Learning ✓ understood

    A subset of machine learning that uses neural networks with multiple layers (deep neural networks) to learn hierarchical representations of data.

  14. Representation Learning ✓ understood

    Letting a model learn its own internal description of the data, such as embeddings or layered visual features, instead of relying on features designed by hand.

  15. Embedding ✓ understood

    A list of numbers (a vector) that represents a word, sentence, image or other item, learned so that similar items end up close together.

  16. Attention Mechanism ✓ understood

    A technique that lets a neural network weigh every part of its input when producing each output, focusing on the parts most relevant at that step.

  17. Transformer ✓ understood

    A neural network architecture, introduced in 2017, built from stacked self-attention and feed-forward layers; the basis of nearly every modern large language model.

  18. Large Language Model ✓ understood

    A neural network, almost always a transformer, trained on vast amounts of text to predict the next token, which lets it write, answer, summarize and follow instructions.

  19. Hallucination · you are here ✓ understood

Picture it

Grounded answer

  • Backed by facts or sources
  • Can be checked
  • Says so when unsure

Hallucination

  • Plausible but false
  • Invented facts or citations
  • Stated just as confidently
Notice that both read equally fluent and confident; only checking against facts or sources tells them apart.

A hallucination is output from a language model that reads as fluent and confident but is false, or isn’t supported by the material the model was given. A model that cites a paper that doesn’t exist, attributes a quote to the wrong person, or adds a detail to a summary that the original never mentioned is hallucinating.

The term predates chatbots. A 2022 survey by Ji and colleagues traces it through machine translation, summarization and dialogue research, where it meant generated text that is nonsensical or unfaithful to the source. It borrows the psychological sense of a perception that feels real with nothing behind it.

Two kinds

The survey sorts hallucinations by their relationship to the source:

  • Intrinsic: the output contradicts the source. A summary says a vaccine was approved in 2021 when the article says 2019.
  • Extrinsic: the output adds something the source can neither confirm nor refute. It might even be true, but nothing in the input supports it.

In open-ended chat there’s often no source document at all, so in everyday use “hallucination” has come to mean any confident factual error.

Why models do it

A language model is trained to produce likely text, not to check facts. Kalai and colleagues argued in 2025 that hallucinations are ordinary statistical errors: if true statements and plausible false ones can’t be told apart from the training data, some mistakes are unavoidable. They add a second cause. Most benchmarks give no credit for “I don’t know,” so a model that guesses scores better than one that admits uncertainty, and training follows the scores. Their paper argues the fix is partly in how evaluations are graded.

That’s why the diagram’s two columns look alike on the surface. Fluency and confidence come from the same machinery whether the content is right or wrong, so tone tells you nothing. What’s missing is calibration: confidence that tracks how often the model is actually right.

What reduces it

  • Grounding answers in supplied text, most often through retrieval-augmented generation, and asking for citations that can be checked.
  • Tools that look facts up or run calculations instead of recalling them.
  • Room to abstain: prompts, training and scoring that reward “I’m not sure.”
  • Verification: tests for code, source checks for claims, a person for anything high-stakes.

None of these brings the rate to zero, so unchecked model output is best treated as a draft.

Where it sits

Hallucination

Leads to

Grounding

Explore nearby

In the research

All papers →

2 papers that build on Hallucination .

Sources

  1. Ji et al., "Survey of Hallucination in Natural Language Generation" . ACM Computing Surveys, 2022; section 2, definitions and the intrinsic/extrinsic categorization
  2. Kalai, Nachum, Vempala and Zhang, "Why Language Models Hallucinate" . 2025