Skip to content

Category

computer vision

3,080 papers

#computer vision Preprint Sep 2026

Context-Aware Causal Gaze Forecasting for Human-Vehicle Interaction During In-Cabin Tracking Dropouts

The Causal Context-Gated Forecaster (CCGF), which encodes a 60-frame pre-dropout history of gaze and head pose and combines it with DINOv3 scene features and evaluates two scene conditions: Live, in which the scene representation continues to update during tracker loss, and Frozen, in which the final pre-dropout repres...

Shabnam Shabani, G. Farhani · 0 citations
#computer vision Preprint Sep 2026

When2Talk: When Should a Proactive In-Car Agent Talk?

Investigation of how communication should adapt to event priority and passenger activity highlights event consequence, passenger activity, continuing information value, and confirmation need as key considerations for selective in-cabin communication.

Kaiser Hamid, Peihan Li, Na-De Liang · 0 citations
#computer vision Preprint Dec 2025

MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation

Evaluating state-of-the-art video generators, image generators, and LLM/VLM baselines reveals a sharp gap between visual quality and reasoning correctness: video models perform best on Physical Commonsense, but remain weak on symbolic tasks such as Sudoku, ARC, and Math, and brittle in cross-view embodied navigation.

Ze-Fan Cai, Haoyi Qiu, Tian-Yi Ma et al. · 9 citations · ⚡1
#computer vision Preprint Sep 2026

Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation

We investigate the effect of pretrained T5 model scale and explicit motion features on pose-to-text Indian Sign Language Translation (SLT) for the WSLP 2026 Shared Task. Pose sequences are projected into the embedding space of T5 through a lightweight pose encoder, with the complete model fine-tuned to generate English...

Manav Dhamecha, Praveen Kumar Chandaliya, Pruthwik Mishra · 0 citations
#machine learning Preprint Open access Sep 2026

Anomaly-Preference Image Generation

Synthesizing realistic and diverse anomalous samples from limited data is vital for robust model generalization. However, existing methods struggle to reconcile fidelity and diversity, often hampered by distribution misalignment and overfitting, respectively.To mitigate this, we introduce Anomaly Preference Optimizatio...

Fuyun Wang, Yuanzhi Wang, Xu Guo et al. · 0 citations

AnyView: Synthesizing Any Novel View in Dynamic Scenes

It is found that most baselines drastically degrade in performance, as they require significant overlap between viewpoints, while AnyView maintains the ability to produce realistic, plausible, and spatiotemporally consistent videos when prompted from $\textit{any}$ viewpoint.

Basile Van Hoorick, Dian Chen, Shun Iwase et al. · 12 citations · ⚡1

DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models

Theoretically, the OPD framework is lifted from discrete tokens to continuous-state Markov processes, deriving a closed-form per-step KL objective that unifies both stochastic SDE and deterministic ODE refinement via mean-matching, which provides lower variance and better generality compared to conventional PPO-style p...

Quanhao Li, Jun-Qiu Yu, Kai-Xun Jiang et al. · 34 citations · ⚡10
#machine learning Preprint Sep 2026

PA-CDM: Position-Aware Character Detection Matching for Evaluating Handwritten Mathematical Expression Recognition

Handwritten mathematical expression recognition (HMER) is conventionally scored by exact-match rates and string-similarity metrics that are blind to where an error occurs: two predictions with identical token-error counts receive identical scores whether they misplace a subscript or swap the operands of a fraction. Ren...

Shi-Liang Luo · 0 citations
#machine learning Preprint Sep 2026

ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts

Experiments on seven heterogeneous handwriting benchmarks show that complementary supervision consistently improves training with page transcription alone, while joint multi-source training provides further gains on most datasets, and the proposed sparse expert model further improves the dense baseline on six of the se...

Nam Hoai Dang, H. Nguyen, Quang Huu Hieu et al. · 0 citations
#machine learning Preprint Sep 2026

What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability

STAG is introduced, to the authors' knowledge the first post-hoc framework for token-level spectro-temporal grounding of captions generated by audio-based MLLMs, and provides behavioral support for the faithfulness and selectivity of the explanations.

Lucia Cascone, V. Fraenza, Michele Nappi et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.