Hallucination

A model stating something fluently and confidently that is not supported by any source — the central risk in putting language models into business processes.

It cannot be eliminated, only constrained

Three controls do the work: restricting answers to retrieved passages, requiring a citation for every claim, and allowing the system to refuse. A model that never says 'not in these documents' is not safe to deploy.

How we measure it

Each release is scored on citation fidelity (does the cited passage actually support the claim) and refusal rate on unanswerable questions, and both numbers go in the release notes.

Related terms

Where this applies

StancorIQ

Need help applying this?

Stancor Technologies engineers answer specification questions directly. Contact us.