Hao-Xuan Yu

KREX: Concurrent Kernel Benchmarking on Shared GPUs via Region-Granular Exclusivity

LLM agents automate GPU kernel optimization by repeatedly composing candidates and measuring their duration on real GPUs. Existing systems preserve measurement fidelity by reserving a GPU for an entire agent session or benchmarking command. However, this results in poor utilization because only a small fraction of comm...