Linh Nguyen

CARB: A Characterization-Guided Framework for CNN Inference Cost Prediction and Deployment Screening

A workload characterization study of 13 419 CNN configurations on two GPU platforms under GPU telemetry reveals that energy, latency, and memory exhibit fundamentally distinct scaling behaviors: energy and latency diverge by 3x under high computational demand, and cross-GPU transferability differs by target.