Why does AI sometimes make up fake facts or sources, and is there a fix?
AI makes up facts—often called 'hallucination'—because it's designed to predict the next plausible word in a sequence, not to retrieve verified truths from a database. It's a storytelling machine, not a librarian. When you ask for a source, the model doesn't search a library; it generates a sequence of words that statistically looks like a real citation, complete with a realistic author name, journal title, and page numbers. A concrete example: if you ask for a study on coffee's effects on productivity, it might invent a paper by 'Dr. Elena Rodriguez from the University of Springfield' that sounds perfect but never existed. The names, dates, and even the journal's formatting will look convincing because the model has learned the pattern of what a citation should look like. There's no quick fix that eliminates this entirely, but you can dramatically reduce it. One powerful approach is grounding the AI in a specific document first—upload a PDF or paste text and ask questions only about that content. This is called retrieval-augmented generation, and it's why tools like NotebookLM can cite exact lines from your sources. Another practical tip: ask the AI to double-check its own work with a follow-up like, 'Can you verify that source exists with a working URL?' It will often backtrack. The core limitation is architectural; these models don't have a 'lie' module or a 'truth' module, just a single prediction engine. For a deeper dive, see our guide on what to do when your prompts produce unreliable output (/blog/chatgpt-prompts-not-working). **Related**: How can I spot AI-generated text in an academic paper? | What is retrieval-augmented generation (RAG) in simple terms?