Importance 2 of 5Covered by 1 source
Audit tests hallucination detectors on small quantized on-device LLMs
Researchers audited four hallucination detectors on small 4-bit models such as Phi-3-mini, Llama-3.2-3B, Qwen2.5-3B and Gemma-2-2B. The study checks whether rankings from large research models hold for models actually shipped on devices.
Why it matters
Teams deploying small on-device models cannot assume detector results from larger models carry over.