Tile-based programming models, such as Triton and cuTile, aim to simplify high-performance kernel development, but their practical performance, tuning behavior, and usability remain difficult to compare systematically. We present TileBench, a controlled benchmark for evaluating Triton and cuTile on NVIDIA B200 GPUs und...
Bowen Cui, Zhongchun Zhou, Hao Wu et al.· 0 citations
Elastic Spectral State Space Models is proposed, a train-once, export-many sequence modeling framework that gains elasticity through spectral approximation of the SSM sequence operator that can be truncated to competitive compact models compared with modern Transformer and SSM baselines at similar parameter scales.
Da-Chuan Song, Ju Yin, Ze-Chen Hu et al.· 1 citation
A model-side aggregation interface is introduced that maintains compact Hash-based HyperLogLog sketch states alongside a frozen language model that improves over direct full-context reasoning over chain-of-thought reasoning.
Da-Chuan Song, Ju Yin, Ze-Chen Hu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.