Latency-Aware Orchestration for Multi-Agent LLM Workflows on Heterogeneous GPUs
A prediction-guided runtime that uses workflow forecasts to construct and optimize a physical execution graph and reduces end-to-end makespan and overall p95 completion latency under burst arrivals by up to 36.8% and 25.8% over state-of-the-art workflow schedulers.