Skip to content

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

IronLLM: Forging Compact Edge-Native Language Models for Real-Time Embodied Intelligence

We present IronLLM-0.6B, a 654M-parameter language model designed for efficient on-device inference. IronLLM-0.6B combines a hybrid attention architecture with X-MTP, a lightweight shared-KV multi-token prediction design that eliminates per-depth KV-cache replay and employs a lightweight verification head for rollback-...

Chang-Di Yang, Feng-Quan Jiao, Hao-Chih Lin et al. · 0 citations

OLED-MoE: Accelerating MoE-Based dLLM Inference via Inter-Iteration Locality-Aware Expert Offloading

OLED-MoE is proposed, an expert offloading system that uses confidence-guided inter-iteration prediction to retain high-value experts in GPU memory without introducing extra prefetch traffic and compensates unavoidable cache misses through CPU-GPU cooperative execution.

Jing Xiao, Jia-Yue Wang, Yi-Tao Hu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.