AI Radar
Top stories
Importance 2 of 5Covered by 1 source

Audit tests hallucination detectors on small quantized on-device LLMs

Researchers audited four hallucination detectors on small 4-bit models such as Phi-3-mini, Llama-3.2-3B, Qwen2.5-3B and Gemma-2-2B. The study checks whether rankings from large research models hold for models actually shipped on devices.

Why it matters

Teams deploying small on-device models cannot assume detector results from larger models carry over.