Skip to content

Category

computer vision

3,080 papers

#artificial intelligence Preprint Sep 2026

WorldAgent: Verification-Guided Agentic Physical World Construction

Constructing complex physical worlds from language requires coordinating extensive 3D environments, detailed structures and objects at different spatial scales, and interacting physical processes under both stated goals and implicit physical constraints. We present WorldAgent, an agentic framework for verification-guid...

Caoliwen Wang, Meng-Di Wang, Yi-Ge Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

PlanGuard: A Guardrail for Multi-Step Plan Safety in Embodied Agents

This work introduces PlanGuard, the first pre-execution detector that evaluates the physical safety of a complete multi-step plan in its current environment, and proposes Strong-Teacher Adaptive Compensation for On-Policy Distillation (STAC-OPD), which provides compact models with adaptive strong-teacher supervision al...

Jun-Chi Chen, Chang-Tao Miao, Yu Xiang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

LocalProp: Neuro-Localized Memory-Efficient Backpropagation

This work proposes LocalProp, a training procedure that locally updates the weights of a model, where the pre-training is based on I-JEPA, and empirically shows that it reaches good performance at a fraction of GPU peak memory.

Diana-Nicoleta Grigore, Iuliana Georgescu, R. Ionescu · 0 citations
#artificial intelligence Preprint Sep 2026

When Helpful Text Hurts: Option-Redirecting Bias in Vision-Language Models

In tri-modal visual question answering (VQA), auxiliary text is commonly used to complement visual and textual inputs, yet its reliability is often uncontrolled. While prior work studies modality conflicts in general, it remains unclear how different types of unreliable auxiliary text affect answer selection under fixe...

Tam Le Thi Thanh, Van Tran Hoang, Hong-Hanh Nguyen-Le et al. · 0 citations
#computer vision Nov 2025

Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward

UniSandbox, a decoupled evaluation framework paired with controlled, synthetic datasets to avoid data leakage and enable detailed analysis, reveals a significant understanding-generation gap, which is mainly reflected in two key dimensions: reasoning generation and knowledge transfer.

Yu-Wei Niu, Weiyang Jin, Jiaqi Liao et al. · 10 citations
#computer vision Preprint Sep 2026

MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos

Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the capture of contextual cues, which are essential for a precise understanding of the content's intent. Although automated detection approaches for the task have advanced si...

Itzel Tlelo-Coyotecatl, Hugo Jair Escalante · 0 citations
#computer vision Preprint Open access Sep 2026

TRACE: Temporal Audit and Condition-aware Evaluation of Streaming Video Understanding

Streaming video understanding requires models to interpret evidence as it arrives, yet current evaluations often report task scores without specifying when evidence becomes valid, how visual history is maintained, or how responses are triggered. As a result, similar scores may correspond to different workloads, failure...

Yibo Ma, Qianqian Zhang, Peng Liu et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Scale-invariant Gaussian derivative residual networks

Generalisation across image scales remains a fundamental challenge for deep networks, which often fail to handle images at scales not seen during training (the out-of-distribution problem). In this paper, we present provably scale-invariant Gaussian derivative residual networks (GaussDerResNets), constructed out of sca...

Andrzej Perzanowski, Tony Lindeberg · 0 citations
#machine learning Preprint Jul 2026

CT-Merging: Consensus Directions and Task-Specific Scaling for LoRA Adapter Merging

LoRA merging methods increasingly operate on the low-rank structure of task updates, yet how the common subspace is estimated and how coefficients are assigned after recomposition are rarely compared directly. We propose CT-Merging, which estimates common directions from averaged task subspace projectors and assigns a...

Keumseo Ryum, Joonhyuk Kang · 0 citations

Pseudo-Invertible Neural Networks

This paper proposes a natural generalization of PInv to the nonlinear regime in general and to neural networks in particular, and introduces Surjective Pseudo-invertible Neural Networks (SPNN), a class of architectures explicitly designed to admit a tractable non-linear PInv.

Yamit Ehrlich, Nimrod Berman, Assaf Shocher · 1 citation

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.