Skip to content

Category

computer vision

3,080 papers

#artificial intelligence Preprint Sep 2026

Astronex-World 1.0: Real-Time Interactive World Model Foundation

Astronex-World 1.0 is presented, an open controllable video world-model foundation that provides a bidirectional model for full-context generation and a causal model with block-causal attention and cross-block KV caching for persistent generation, both built on the Wan2.2-TI2V-5B prior.

Xin Zhou, Cong-Wen Miao · 3 citations · ⚡1
#artificial intelligence Preprint Sep 2026

AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

Findings show that semantic reference-text overlap should not be treated as a proxy for temporal localization, and that AVTrace can identify task-specific weaknesses while providing a testbed for temporal post-training.

Long-Yin Zhang, P. Mahendra, Chengwei Wei et al. · 1 citation
#artificial intelligence Review Sep 2026

PACE: Precise AI Cinematic Expression

PACE (Precise AI Cinematic Expression), a typed representation for the plan: the screenplay evidence, the characters, props and locations it needs, where each subject stands, and what the camera does.

Bing Duan, Qiang Guo, Lin-Pu Li et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

A Multi-Modal Generative Model for Tomato Disease Leaves Understanding

Artificial intelligence for plant disease analysis has advanced from task-specific classifiers to multi-modal models capable of jointly interpreting visual and textual information. However, practical deployment in precision agriculture remains limited because most existing approaches treat disease understanding as isol...

Khang Nguyen Quoc, Minh-Phuoc Tran, Gia-Han Truong et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning

The rapid expansion of multimodal models has surfaced formidable bottlenecks in computation, memory, and deployment, catalyzing the rise of Efficient Multimodal Learning (EML) as a pivotal research frontier. Despite intensive progress, a cohesive understanding of what, how, and where efficiency is manifested across the...

Pan Wang, Siwei Song, Hui Ji et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Riemannian--Lorentz Fusion of Vision Transformers and State-Space Models

Scaling deep learning faces critical bottlenecks: data exhaustion, exponential training costs, and resource concentration. Model merging combines pre-trained checkpoints without gradient descent, offering orders-of-magnitude savings versus retraining. Combining independently trained vision models is difficult when thei...

B. Patro, V. Agneeswaran · 0 citations
#artificial intelligence Preprint Sep 2026

LinePilot Digitizer: Line-Plot Recovery with Manual and Automatic Calibration

LinePilot Digitizer (LinePilot), which combines continuous color-based curve recovery with three calibration modes: LinePilot (standard), LinePilot (enhanced), and LinePilot (OCR) is presented, and DigitizerBench is introduced, the first dedicated benchmark for systematically evaluating digitizer performance.

Feng-Bo Ma, Rayan K. Akhtar, Aakash H. Joshi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment

This work evaluates the capability of open-source Vision-Language Models to perform zero-shot action quality assessment on Olympic diving videos using the AQA-7 benchmark dataset, and suggests that VLMs hold strong potential as assistive tools for explainable and semi-automated sports performance evaluation.

Henry O. Velesaca, David Freire-Obregón, Luigi Miranda et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Perceptual Refinement of an End-to-End Video Streaming Pipeline via Generative AI Layers

Presley is presented, which extends the prior conference work ELVIS by replacing destructive block removal with adaptive in-place degradation under a removability mask, signaling per-block strength in a bit-packed side channel, and restoring via generative backbones conditioned on transmitted visual priors rather than...

Emanuele Artioli, F. Tashtarian, C. Timmerer · 0 citations
#computer vision Preprint Aug 2026

EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision

This work presents EgoPHI, the first method that jointly estimates dense contact maps and 3D force distributions on hand and object meshes from a single monocular RGB image and object geometry, and demonstrates that EgoPHI improves force estimation over existing approaches while generalizing to unseen datasets.

Andela Ilic, Rachel Schuchert, Yi-Jing Jiang et al. · 0 citations
#computer vision Preprint Open access Sep 2026

Seeing Through the MiRAGE: Evaluating Multimodal Retrieval Augmented Generation

We introduce MiRAGE, an evaluation framework for retrieval-augmented generation (RAG) from multimodal sources. As audiovisual media becomes a more prevalent source of information online, RAG systems must integrate such media into generation. Yet, existing evaluation methods for RAG are largely text-centric and do not r...

Alexander Martin, William Walden, Reno Kriz et al. · 0 citations
#computer vision Preprint Open access Sep 2026

PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

Intelligent systems that act in the world require image understanding that is both comprehensive and spatially grounded. Current vision-language models (VLMs) can generate fluent and detailed image captions, but reliably associating them with image pixels remains challenging. Existing methods that combine dense caption...

Sara Pieri, Evangelos Kazakos, Shizhe Chen et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.