µ VLM: A Vision Language Model for µ NPUs
· 0 citations
· 53 references
Similar papers
Jul 2026
UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models
Extensive experiments demonstrate that the on-device latency-informed design combined with the tailored training strategy establishes a new state-of-the-art for efficient LVLM encoding, significantly outperforming existing encoder-centric baselines while operating on-device at nearly 1.7xthe speed.
Ioannis Maniadis Metaxas, Adrian Bulat, Alberto Baldrati et al.
· arXiv.org · 0 citations
Jul 2026
CoFi-Lite: Pushing the Limits of Ultra-Lightweight Speech Enhancement
Ultra-lightweight models are essential for the deployment of deep learning-based speech enhancement algorithms on edge devices. Although recent approaches have achieved a certain balance between computational complexity and performance, pushing the complexity limits further demands more sophisticated designs. In this letter, we propose CoFi-Lite, a highly efficient model that decouples spectral modeling into coarse- and fine-grained streams. By leveraging two parallel and symmetric encoder-decoder paths, it simultaneously extracts full-band envelopes and low-frequency details for complementary enhancement. In addition, a novel Cross-Path Fusion (CPF) module is introduced to bridge the distinct paths, facilitating efficient feature interaction. Remarkably, CoFi-Lite requires extremely low computational resources, featuring only 12.87 M MACs/s and 83.12 k parameters. Experimental results demonstrate that our proposed model outperforms the ultra-lightweight baseline GTCRN while requiring only 40.26% of its computational complexity. Its scaled-up variant also delivers performance on par with that of the SOTA ultra-lightweight model AdaptCRN alongside a 19.34% reduction in computational cost.
Leyan Yang, Dahan Wang, Xiaobin Rong et al.
· IEEE Signal Processing Lette... · 0 citations
Jul 2026
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model
Mage-VL is presented, an efficient codec-native streaming foundation model for real-time multimodal understanding and interaction and establishes AI4AI data pipelines encompassing prompt-code joint optimization for multimodal captioning and AI-driven performance diagnosis to guide training recipes.
Senqiao Yang, Kaichen Zhang, Zhaoyang Jia et al.
· arXiv.org · 3 citations
Jul 2026
P4Q: Learning to Prompt for Quantization in Low-Bit CLIP
The “Prompt for Quantization” (P4Q) is proposed, by integrating PTQ with Parameter-Efficient Fine-Tuning (PEFT) techniques, and demonstrates that P4Q significantly enhances the performance of low-bit CLIP while reducing deployment costs.
H. Sun, Runqi Wang, Yanjing Li et al.
· ACM Transactions on Multimed... · 0 citations
Jul 2026
Attention-Free and Lightweight Token Reduction for Efficient Vision-Language Models
An attention-free and lightweight token reduction framework as a plug-and-play module for VLMs, which preserves both important and diverse tokens to produce a compact visual representation, and achieves a favorable accuracy-efficiency trade-off.
Xuanyi Hao, Zuoyuan Zhang, Zhibo Wang et al.
· arXiv.org · 0 citations
Preprint
Aug 2026
MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding
This work systematically study MoE designs for vision encoder scaling and finds that fine-grained MoE topologies yield substantial gains over both dense and standard MoE counterparts, and proposes an auxiliary-loss-free balancing variant for better expert utilization, and designs a specialized MoE kernel to mitigate inference latency overhead.
Bonan Zhang, Shiyu Dong, Quan Hung Tran et al.
· 0 citations