Skip to content

Category

computer vision

3,080 papers

#computer vision Preprint Sep 2026

MaskVLA: Visual Masking Against Trajectory Overfitting of Vision-Language-Action Model

MaskVLA, a masking-based fine-tuning strategy that randomly masking a small portion of the main camera's visual information leads to the emergence of robust policies, thereby enhancing the model's capability to tackle complex manipulation tasks and improving its generalization performance.

Yuxuan Jiang, Jia-Ying Huang, Ge Wang et al. · 0 citations
#computer vision Preprint Sep 2026

SKstars at SHROOM: Visions Agreement-Guided Ensembling of Zero-Shot and LoRA-Adapted Vision--Language Models

The results show that combining a large zero-shot model with a smaller adapted model provides a practical framework for multilingual and fine-grained hallucination localization, while also highlighting the difficulty of transferring development-set improvements to hidden test data.

Ali Athar, Imran Ahsan, Joon-Yong Jung · 0 citations
#computer vision Preprint Open access Sep 2026

X-GS: An Extensible Framework for Perceiving and Thinking with 3D Gaussian Splatting

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis, subsequently extending into numerous spatial AI applications. However, most existing 3DGS methods operate in isolation, focusing on specific domains. In this paper, we introduce X-GS, an extensible framework that integrates previ...

Yueen Ma, Zenglin Xu, Irwin King · 0 citations
#artificial intelligence Preprint Open access Sep 2026

SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models

Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-language models (VLMs) for multimodal understanding. However, billion-parameter VLMs incur substantial memory and computational costs that hinder deployment in resource-constrained...

Yufei Xue, Yushi Huang, Lunjie Zhu et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in understanding common visual elements, largely due to their large-scale datasets and advanced training strategies. However, their effectiveness in medical applications remains limited due to the inherent discrepancies between data and...

Weiwen Xu, Hou Pong Chan, Long Li et al. · 0 citations
#computer vision Preprint Open access Sep 2026

3D-MoE: Towards Spatial Intelligence with Mixture-of-Experts for 3D Reasoning and Action Generation

Spatial intelligence, encompassing 3D perception and reasoning, is the essential next frontier of AI. Scaling current 3D vision-language models (VLMs) that rely on dense Transformers for spatial tasks incurs prohibitive computational costs. In this paper, we introduce 3D-MoE, a 3D VLM leveraging an efficient mixture-of...

Yueen Ma, Zenglin Xu, Irwin King · 0 citations
#computer vision Preprint Sep 2026

SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models

SLICEChat is introduced, a slide-level MLLM that integrates progressive token pruning within a hybrid Mamba--Transformer slide encoder, which demonstrates accurate and computationally efficient multimodal reasoning over gigapixel WSIs.

Ali Kerem Bozkurt, Baris Cem Bakay, Ibrahim Kulac et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Representation-guided in-context learning for medical image interpretation with multimodal large language models

RG-ICL is introduced, a training-free inference framework that retrieves query-aligned demonstrations using frozen encoders, without task-specific parameter updates, and indicates that for medical image interpretation, curating which reference cases an MLLM sees is a practical alternative to retraining it.

Min-Da Zhao, Fang-Yu Hu, Yan Luo et al. · 0 citations
#computer vision Preprint Open access Sep 2026

Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsing

End-to-end document parsers increasingly offer an optional reasoning mode for complex pages. On a 180-page entropy-stratified discovery sample with one frozen 4B checkpoint, complexity is the wrong decision variable. Reasoning lowers mean quality by 2.21 Overall at 1.54x tokens; a preregistered input-only model cannot...

Xingyu Lin, Dehui Du · 0 citations
#artificial intelligence Preprint Sep 2026

Knowing When to Trust Images: Reliability-Aware Multi-modal Entity Alignment

The visual modality, i.e., images, plays a key role in multi-modal entity alignment (MMEA). Existing approaches often directly fuse the image with other modalities to align different entities. Although simple, such strategies overlook the potential noise in the images and their semantic misalignment with corresponding...

Chen-Xiao Li, Yun-He Feng, Dongfang Liu et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors

Existing 6-DoF grasp detectors typically rank grasp candidates by detector confidence. However, our analysis on GraspNet-1Billion shows that detector confidence is often poorly aligned with grasp quality, leaving successful grasp candidates at low ranks. Motivated by this observation, we study whether learned re-rankin...

Jibao Yuan, Yuhui Zhao, Yinzhen Lv et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification under Foundation-Model Pretraining

Multi-branch architectures and CNN-Transformer fusion are widely believed to improve vehicle re-identification (Re-ID) by combining complementary representations. We revisit this for a DINOv3-pretrained backbone. A single DINOv3-pretrained ConvNeXt with a tuned recipe reaches 88.19 mAP on VeRi-Wild Small and 77.47 on L...

Yu Wang, Hongyu Yang · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.