Jul 2026
Conformal Cascade: Distribution-Free Accuracy Guarantees for Multi-Tier LLM Inference
Conformal Cascade (CC), a multi-tier inference framework that uses conformal prediction set size as the deferral rule: accept when the calibrated set collapses to a single answer, defer otherwise, delivers a distribution-free, finite-sample accuracy guarantee.
Yifan Dou, Shikan Lian, Shibo Li
· arXiv.org · 0 citations