Skip to content

Category

computer vision

3,022 papers

#artificial intelligence Preprint Sep 2026

Dynamic Manipulation with World-Action Models via Counterfactual Planning

DPP enables real-time dynamic manipulation on a single consumer GPU without additional training on dynamic data and constructs a counterfactual observation that places a predicted target position in a familiar robot context, allowing the model to invoke an existing manipulation skill rather than generate a recovery beh...

Sunwoo Park, Won-Sang Lee, Seonghyun Jin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs

Progress in AI-based retinal image analysis has advanced with foundation models, yet evaluating their reliability remains challenging. Performance reported on a single dataset does not capture how models behave under dataset shift, across clinical definitions, or for different patient subgroups. This limitation is part...

David S. Restrepo, Chen-Wei Wu, L. Nakayama et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models

Grounding is a core capability of spatial vision-language models, yet most existing work focuses only on where a referred object is. Many 3D tasks also require knowing how it is oriented. Although existing 3D VLMs may predict oriented boxes, box pose does not explicitly capture object-centric orientation or symmetry-in...

Tuo Liang, Di-Sheng Liu, Neng-Bo Wang et al. · 0 citations
#artificial intelligence Open access Sep 2026

Query, Align, and Distill: Navigation-Aware Cross-Modal Interaction for Efficient Vision-and-Language Navigation

A high-performing teacher is built that makes navigation evidence selection explicit and compressible, and a compact student is trained by transferring both where to attend and what to do, then further match action distributions during fine-tuning.

Zhihao Chen, Yi-Yuan Ge, Zi-Yang Wang et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

OneSign: Unifying Sign Language Understanding Tasks with One Model

SLU encompasses a diverse set of tasks, including ISLR, CSLR, and SLT. Although these tasks share basic semantic and linguistic foundations, they are typically addressed with task-specific architectures and training pipelines, which hinders knowledge sharing and requires costly pretraining and finetuning for each task....

Shiwei Gan, Yafeng Yin, Xiao Liu et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

SemReward-VL: Semantic Reward-Guided Video-Language Adaptation for Developmental Behavior Assessment

Developmental screening videos show how children perform specific behaviors, but clinical records usually contain outcomes rather than descriptions of what happened. We present SemReward-VL, which learns to describe item-specific behavior from these outcomes. A vision-language model generates a description, and a froze...

De Jiang, Shuo Zhang, Kehong Yuan et al. · 0 citations
#artificial intelligence Preprint Sep 2026

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and broader food computing systems. The existing approaches have progressed along two largely separate axes, vision models that rely on calibrated RGB-depth captures and i...

Aman Kumar, Avinash Anand, Chaitanya Lakhchaura et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

DynamicDx: Evaluating Evidence Acquisition in Video-Based Diagnosis

Diagnosing a patient from video requires more than recognizing the sign: a vision-language model must turn what it sees into hypotheses, questions and tests. DynamicDx evaluates each step in 71 neurological consultations across 11 sign categories, linking authentic patient videos to confirmed diagnoses and fixed charts...

Jiahui Li, Yutong Guo, Nan Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Vision-Language Agents for Active Perception in Optics Laboratories

It is found that, given task-specific natural-language guidance, VLMs can estimate actuator-response relationships, resolve ambiguous observations through intervention, and actively create informative visual feedback when signals are sparse, suggesting that pretrained multimodal models can serve as important decision-m...

Ryan Lopez, Sachin Vaidya, Seouing-Ho Choi et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Multimodal LLMs Outperform Pathology Foundation Models in Cross-Domain Histological Similarity

State-of-the-art pathology foundation models, trained on millions of histology tiles, can fail to preserve tissue similarity when comparisons cross slide or institution boundaries. We show that general-purpose multimodal LLMs, without being trained as pathology foundation models, consistently outperform these specializ...

Yishu Zhang, Yun Li, Daiwei Zhang · 0 citations
#artificial intelligence Preprint Sep 2026

PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery

The proposed PolyTopoBench evaluates both exterior and interior rings, and benchmarks 11 representative methods, including segmentation-based polygonization pipelines, vision foundation model baselines, and specialized vector polygon generators, on two RS-image datasets covering buildings, roads, vegetation, and unvege...

Ze-Ping Liu, Ni Lao, Wei-Wei Sun et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Mind the Spike: Mechanisms and Brittleness of Visual Massive Activations in Large Vision-Language Models

Large vision-language models (LVLMs) inherit massive activations from their text-only bases: spikes where a few fixed hidden channels receive values thousands of times above the typical magnitude. The text spike systematically appears in early layers at a fixed initial position, independently of input content. Visual s...

Jonas Ngnaw\'e, Yann Pequignot, Sabyasachi Sahoo et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.