Skip to content

Category

computer vision

3,315 papers

#artificial intelligence Preprint Oct 2025

CapGeo-Bench: Decoupling Visual Perception from Reasoning and Evaluating Geometric Understanding

CapGeo-Bench is proposed, a benchmark of 4,641 high-quality figure-caption pairs equipped with a fine-grained keypoint-based evaluation metric that provides high-quality captions consistently and substantially boosts performance of MLLMs, empirically validating the visual perception bottleneck in geometric reasoning.

Yu-Ying Li, Si-Yi Qian, Hao Liang et al. · 5 citations
#artificial intelligence Conference Oct 2025

TOPO-Bench: An Open-Source Topological Mapping Evaluation Framework with Quantifiable Perceptual Aliasing

This work formalizes topological consistency as the fundamental property of topological maps and shows that, under mild assumptions, localization accuracy provides an efficient and interpretable surrogate metric, and introduces the first quantitative measure of dataset ambiguity for fair comparison across environments.

Jia-Ming Wang, Di-Wen Liu, Ji-Zhuo Chen et al. · 1 citation
#artificial intelligence Preprint Aug 2025

Perceptual Reality Transformer: What Must an Illustration Preserve?

Perceptual Reality Transformer is introduced, an evidence-linked workflow and descriptive atlas that retain the source account alongside representations and generated illustrations that retain the source account alongside representations and generated illustrations.

Bai-Han Lin · 0 citations
#artificial intelligence Preprint Open access Sep 2026

JSolver: Joint Spectrum Estimation and Multi-Material Decomposition from Single-Energy CT Projections

Multi-material decomposition (MMD) enables quantitative reconstruction of tissue compositions in the human body, supporting a wide range of clinical applications. However, traditional MMD typically requires spectral CT scanners and pre-measured X-ray energy spectra, significantly limiting clinical applicability. To thi...

Qing Wu, Hongjiang Wei, Jingyi Yu et al. · 0 citations
#artificial intelligence Open access Mar 2025

BGM2Pose: Active 3D Human Pose Estimation With Non-Stationary Sounds

BGM2Pose is proposed, a non-invasive 3D human pose estimation method using pre-selected everyday music as active sensing signals and a Frequency-wise Attention Module that enables the model to focus on subtle acoustic variations attributable to human movement by dynamically computing attention across frequency bands.

Yuto Shibata, Yusuke Oumi, Go Irie et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

EventVL: Understand Event Streams via Multimodal Large Language Model

The event-based Vision-Language Model (VLM) recently has made good progress for practical vision tasks. However, most of these works just utilize CLIP for focusing on traditional perception tasks, which obstruct model understanding explicitly the sufficient semantics and context from event streams. To address the defic...

Pengteng Li, Yunfan Lu, Pinghao Song et al. · 0 citations
#artificial intelligence Preprint Jul 2026

SportD: How do VLMs physically strategize?

SportD opens a new direction for rigorously evaluating physical strategic decision-making in VLMs, showing that careful decomposition of their choices can reveal the mechanisms underlying systematic biases such as risk aversion.

Jasin Cekinmez, Addison J. Wu, Hao-Tian Xia et al. · 0 citations
#artificial intelligence Preprint Dec 2025

Echo-CoPilot: A Multiple-Perspective Agentic Framework for Reliable Echocardiography Interpretation

Echocardiography interpretation requires integrating multi-view temporal evidence with quantitative measurements and guideline-grounded reasoning, yet existing foundation-model pipelines largely solve isolated subtasks and fail when tool outputs are noisy or values fall near clinical cutoffs. We propose Echo-CoPilot, a...

Moein Heidari, Ali Mehrabian, M. A. Roohi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer's Disease Classification from Structural MRI

Deep networks trained on structural MRI for Alzheimer's disease (AD) staging often reach reasonable accuracy while attending to anatomically irrelevant regions, and multimodal models that add clinical tables frequently rely on variables that were used to assign the diagnostic label in the first place. We study both iss...

Paul-Gabriel Nicolae, I. Mocanu · 0 citations
#artificial intelligence Preprint Sep 2026

Don't Send What You Don't Need: Question-Guided Token Pruning as a Privacy Defense for Vision-Language Models

Visual Question Answering (VQA) with Vision-Language Models (VLMs) is increasingly used in privacy-sensitive and bandwidth-constrained settings. Federated Learning (FL), Split Learning (SL), and U-Shaped Split Learning (USL) keep raw data local, but transmitting all visual tokens across a model partition remains costly...

Md. Khalid Syfullah, Alvi Ataur Khalil · 0 citations
#artificial intelligence Preprint Sep 2026

Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration

Multimodal image registration is a key component of many clinical workflows, yet it remains challenging because corresponding anatomical structures often exhibit substantially different image intensities across modalities. In this work, we present a comprehensive benchmark of intra-patient 3D multimodal deformable regi...

Matteo Barbieri, G. La Barbera, J. De la Plata et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.