hallucination
Also called: AI hallucination, LLM hallucination, AI confabulation
An AI hallucination is when a large language model produces confident, plausible-sounding text that is factually wrong or fabricated, such as an invented statistic, a fake citation, or false details about a company. It happens because training rewards guessing over admitting uncertainty.
Why models make things up
OpenAI researchers (Kalai et al., 2025) frame hallucinations as ordinary statistical errors, not glitches. Most benchmarks score answers with a binary rule (1 for a correct answer, 0 for a blank or “I don’t know”), and under that math guessing beats abstaining. So models are trained to always answer, even with no grounded fact behind it. Asked for an author’s birthday with “respond only if you know,” the paper’s test model returned three different wrong dates across attempts.
Common triggers: thin or biased training data, questions about long-tail entities the model rarely saw, and prompts demanding specifics it cannot verify (Google Cloud). Hallucinations split roughly into two kinds, output that contradicts the source you handed the model, and output that contradicts real-world fact.
The practical fix is grounding. Retrieval-augmented generation (RAG) ties answers to real documents the system pulls at query time instead of the model’s internal guess. For a business, those retrieved documents are often your own web pages, so what you publish, and how machine-readable it is, shapes whether an assistant repeats your facts correctly or quietly invents them. You cannot patch the model, but you can control what it retrieves.
How it affects your traffic
When someone asks ChatGPT, Gemini, or Google's AI answers about your category, the model can state wrong facts about your pricing or services, or credit a competitor for work you do. You cannot edit the model, but you can change what it retrieves: clear, consistent, well-structured pages give AI systems a grounded source to cite instead of a guess. That is the core of AI SEO work, making your real information the easiest correct answer for an assistant to pull. Left unmanaged, one confident hallucination can push a qualified buyer to the wrong conclusion before they ever reach your site.
Get AI SEO that moves the needle
We turn terms like this into ranked pages and qualified pipeline. Start with a free Initial SEO Strategy.