Arka Pal

Pinocchio: Fast Uncertainty Estimates for Black-Box Language Models

Pinocchio is introduced, an external calibrator that estimates the correctness of responses from black-box API models that needs only a single forward pass to generate an uncertainty estimate and requires no access to the target model's logits, weights, or internal states.