UniExit: A Unified Latency-Aware Early-Exit Runtime for Heterogeneous Edge AI
Edge applications increasingly combine CNN-based perception with edge-deployable Transformer-based language models, but deploying such heterogeneous workloads on resource-constrained devices is challenging because inference latency varies with both input difficulty and runtime hardware state. Early-exit inference reduc...