TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference
TELLER is presented, a non-intrusive Trace- and Log-aware LLM inference Root-cause analysis framework that combines numeric candidate localization with a multimodal root-cause model that jointly predicts abnormal steps, localizes suspicious operators, and generates natural-language explanations.