Cross-model KV-cache reuse remains a key challenge in modern LLM serving. Coding agents and multi-model systems increasingly route a shared context across models: a user may switch models mid-session, or a cascade may escalate a difficult query. Because KV caches contain model-specific representations, each switch typi...
Sreetama Sarkar, Saptarshi Mitra, Si-Tao Huang et al.· 0 citations
Pragma insertion drives the quality of high-level synthesis (HLS) designs. Choosing the right directives demands expert knowledge and reasoning about loop nesting, data dependences, and memory layout. While existing large language models (LLMs) show promise in code generation, they lack explicit program-structure aware...
Hao-Cheng Xu, Ye Qiao, Phyo Pyae Moe Aung et al.· 0 citations
LowRank-SSM is a hardware-software co-design framework that decomposes the input and output projection weights via post-training truncated SVD and introduces a greedy bandwise rank-allocation algorithm that searches for the per-band rank vector that minimizes weight storage while respecting a user-specified accuracy co...
Hao-Cheng Xu, B. Bhat, Yuseon Chou et al.· 0 citations
Bern2Edge, an end-to-end framework that uses knowledge distillation to convert a pretrained teacher feed-forward network into hardware-efficient representations via Bernstein polynomial activations, is proposed, enabling interpretable inference with explicit input-space constraints.
