HalluTracer: Pre-Decoding Truthfulness Prediction via Depth-Averaged Probe-Logit
The proposed method HalluTracer, which averages layer-wise probe logits to predict truthfulness before decoding, achieves the highest area under the receiver operating characteristic curve (AUROC) in 23 of 24 model--benchmark pairs among the compared methods.