This work introduces KLineage, which learns this missing"when"knowledge from expert kernels: instead of relying on forward rollouts, KLineage walks expert implementations backward through validation-gated simplifications and reverses each accepted step into a reusable optimization skill.
Shuo-Ming Zhang, Qiu-Chun Yu, Rui-Yuan Xu et al.· 0 citations
No single way of parallelizing attention serves large language models well under all loads. Low concurrency favors tensor parallelism, many independent requests favor data-parallel attention, and long prompts favor context parallelism. Reasoning, agentic, and RL-rollout workloads make a fixed choice untenable: a batch...
Chuan Liu, Shuo-Ming Zhang, Zhi-Cheng Li et al.· 0 citations
Large language models now write a growing share of the world's code, increasingly inside agents and serving systems that compile, execute, or dispatch generated code without line-by-line review. This works well for mainstream languages but remains brittle for low-resource programming surfaces such as domain-specific la...
Shuoming Zhang, Ruiyuan Xu, Haofeng Li et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.