Yu-Jie Huang

SimServing: Native-Execution Simulation for Evolution-Resilient LLM Serving Configuration Tuning

Large Language Model (LLM) services expose a large configuration space that critically affects performance, yet tuning these configurations on hardware (e.g., NVIDIA GPUs) is prohibitively expensive. Simulation offers a scalable alternative, but state-of-the-art simulators suffer from a fundamental software engineering...