API-TAIL: Detecting Model Substitution in LLM APIs through Temperature-Aligned Likelihood Tails
Commercial language model APIs return only text, allowing a provider to cut costs by quietly routing a fraction of user requests to a cheaper substitute model while billing for the advertised one. Detecting such partial substitution is challenging because honest providers also alter the output distribution through undo...