Benchmark Dataset for Prompt-Shape- and Prefix-Cache-Aware CPU/NPU Routing on Edge SoCs
This dataset supports the experiments reported in “Prompt-Shape- and Prefix-Cache-Aware CPU/NPU Routing for Large Language Model Inference on Edge SoCs.” It contains CPU/NPU latency measurements, benchmark prompts and prompt manifests, prompt-generation scripts, measurement runners, and analysis code for Prompt-Shape-A...