A while back Claude handed me a block of code built around a library that does not exist. Forty clean, well structured lines, using functions from a package I could not find anywhere online. It never once hinted it was making it up. I lost an hour before I realised the whole thing was fiction. That was not a one off. I have had it give me a SQL job that reported a result while nothing actually ran underneath. I have had it cite sources that were not from where it claimed, or were not real at all. Every single time it sounded certain. That is the dangerous part. It is never unsure. Here is what is going on. When a model does not know something, it does not stop. It fills the gap with the most likely looking answer. A plausible function name. A plausible date. A plausible source. It is built to always produce something, and "something" wins over "I don't know" every time, even when the something is wrong. Here is a live one. I asked for the EU AI Act key dates two ways. Straight from memory it told me the Act was in full force on 1 January 2025, with bans from mid 2024. Confident. Wrong. Then I forced it to work from sources only and search first. It came back with: in force 1 August 2024, bans apply 2 February 2025, GPAI rules 2 August 2025, fully applicable 2 August 2026. Every date now had a link I could open and check. Correct. Same model. Same question. The only difference was whether I let it guess. Here is why I care, and why you should. Everything you send or publish on a model's word carries your name, not the model's. The wrong figure in a report. The fake reference in a proposal. The library that does not exist in code you shipped. Right now people forgive it because "the AI wrote it". In six to twelve months that excuse is gone, the same way "sorry, autocorrect" stopped working. What you send this year is what people remember. So here is how you stop it. 1. Make it search before it answers. Do not ask "what are the EU AI Act dates". Ask "search for the EU AI Act dates and answer only from what you find". No result, no answer.