Managing Hallucinations
In the first pillar we landed on a hard fact: a language model predicts the next word, and it optimizes for plausible, not true. A hallucination is what happens when those two come apart — and it isn't the machine breaking. It's the machine doing exactly what it does, in the same confident voice it uses for everything else. You don't patch that out. You contain it. This pillar is about how.
Read post →