Skip to content

Category

computer vision

3,462 papers

#computer vision Preprint Aug 2026

Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Pruning

Middle-layer Attention Prediction (MAP), which uses Question Contrastive Teacher Selection to identify a sample-specific teacher layer by contrasting attention under the original and reference questions, and distills attention from the selected layer into a lightweight predictor that estimates visual token importance f...

Yu-Yao Sun, Tao Deng, Shuang-Hua Li et al. · 0 citations
#computer vision Jun 2026

VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers

This work introduces VTOS (Vision Tools Orchestration Search), a framework for adaptive visual tool orchestration through joint solution-observer search that outperforms static tool pipelines and agentic visual-programming baselines in complex settings such as dense, occluded scenes and out-of-distribution segmentation...

Jin-Chao Ge, Lingqiao Liu, Shu-Wen Zhao et al. · 0 citations
#computer vision May 2026

On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training

A controlled diagnostic framework with two synthetic tasks that disentangle perception from reasoning reveals a consistent perception-reasoning asymmetry: post-training improves reasoning more substantially than perception, though the underlying mechanism differs across training paradigms.

Xueqing Wu, Yu-Chieh Lin, Kai-Wei Chang et al. · 0 citations
#computer vision Preprint Aug 2025

SignBind-LLM: Multi-Stage Modality Fusion for Sign Language Translation

SignBind-LLM, a modular framework that addresses limitations of sign language translation systems through three dedicated expert streams: one for continuous signing, one for fingerspelling, and one for lipreading, confirms that the gains are architectural rather than a consequence of scaling the language model.

Marshall Thomas, Edward Fish, Richard Bowden · 1 citation
#computer vision Preprint Sep 2026

ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding

ShallowStream is a novel framework that leverages the shallow layers of an MLLM to simultaneously perform frame encoding and retrieval index building and achieves performance on par with the strongest existing streaming methods, while reducing per-frame prefill latency and 10-second end-to-end latency by up to 52.1x an...

Jitai Hao, Ke-Shuai Yang, Ding-Kun Yan et al. · 2 citations
#computer vision Preprint Sep 2026

LeakageBench: Document-Level Leakage Risk for Redacting Personally Identifiable Information in Document Images

LeakageBench provides a diagnostic benchmark for high-recall, spatially grounded PII redaction in document images and shows that stronger detection and tool assistance improve localization without making most pages safe for release.

V. Kumar, Santhosh Venkatesh, Ivan P. Yamshchikov · 0 citations
#computer vision Preprint Sep 2026

MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models

This work introduces MemeCULT-1K, a multilingual benchmark of 1,000 South Asian memes in Bengali, English, and Hindi, where each meme is paired with a cultural context note and three human-written explanations, along with a supplementary set of 54 Bengali regional dialect memes.

Tawsif Tashwar Dipto, Mehedi Ahamed, Radib Bin Kabir et al. · 0 citations
#machine learning Preprint May 2026

Half-Truth Audio Detection and Localisation: A Lightweight Cross-Attentive Architecture and a Cross-Corpus Diagnostic Study

CAFNet is presented, a lightweight cross-attentive architecture that fuses MFCC, LFCC, and Chroma-STFT features to jointly classify audio as real, fully fake, or half-truth, and regress the temporal boundaries of the synthesised region, at approximately 14 ms CPU latency.

S. Sutharya, R. Sasi · 0 citations

Conditional Diffusion Posterior Alignment for Sparse-View CT Reconstruction

This work proposes Conditional Diffusion Posterior Alignment (CDPA) to enable scalable 3D sparse-view CT reconstruction to large 3D volumes by combining conditional diffusion with explicit data consistency, and shows that the same principles also strengthen fast denoising U-Nets, yielding near-diffusion quality at a fr...

L. Barba, J. Kirschner, B. B. Haro · 0 citations
#machine learning Preprint Mar 2026

DynaTokens: Controlling Token Dynamics for Continual Video-Language Understanding

DynaTokens, a transformer-based token generator that dynamically produces fine-tuning tokens on demand, enabling task-adaptive prompt updates through shared generation weights is introduced, enabling task-adaptive prompt updates through shared generation weights.

Toàn Nguyên, Yang Liu, C. D. de Melo et al. · 3 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.