GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference
As demand for LLM inference grows and consumer GPUs grow more capable, edge deployment is becoming increasingly attractive. WebGPU is compelling in this setting because it offers cross-platform portability and browser accessibility. However, these same strengths also make high performance difficult to achieve, as an im...
Rithik Sharma, Reese Levine, Zhe-Yuan Chen et al.
· 0 citations