Skip to content

Category

computer vision

3,492 papers

DASH: Dual-Branch Score Distillation for Guidance-Calibrated Compact Diffusion Models

DASH is introduced, which supervises the conditional and unconditional branches independently and an anchor term regularises the conditional prediction toward ground-truth noise, and the teacher's final learned per-timestep curriculum transfers into the student as a frozen prior.

A. Shafi, Kazi Saeed Alam, Sk. Imran Hossain et al. · 1 citation

Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light

Focusing on the autonomous driving safety-critical case of pedestrian detection in the dark, it is shown how synthetic low-light samples can be used to better characterize the performance of a state-of-the-art object detection model as a function of the scene illumination.

V. Pais, Malena Mendilaharzu, Daniele Faccio et al. · 0 citations
#machine learning Preprint Apr 2026

SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding

This work proposes a VQA-based fine-tuning strategy that trains models to answer structured questions about visual content rather than relying solely on captions or simple instructions, which encourages deeper visual grounding and reasoning.

Tanzila Rahman, Renjie Liao, Leonid Sigal · 0 citations

NanoVDR: Distilling a 2B Vision-Language Retriever into a 70M Text-Only Encoder for Visual Document Retrieval

NanoVDR exploits query--document asymmetry by decoupling the two encoding paths: a frozen 2B VLM teacher indexes documents offline, while a distilled text-only student as small as 69M parameters encodes queries at inference, and the resulting NanoVDR-S-Multi (DistilBERT, 69M) retains 95.1% of teacher quality.

Zhu Liu, Yao Zhang, Yuntian Xiao · 1 citation

DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation

This work proposes DesignAsCode, a novel framework that reimagines graphic design as a programmatic synthesis task using HTML/CSS, incorporating a Plan-Implement-Reflect pipeline, incorporating a Semantic Planner to construct dynamic, variable-depth element hierarchies and a Visual-Aware Reflection mechanism that optim...

Ziyuan Liu, Shizhao Sun, Danqing Huang et al. · 4 citations
#machine learning Preprint Jan 2026

Diverse via bounded Agreement: Geometric Regularization for Multimodal Fusion

The results suggest that explicitly regulating representation geometry is an effective complement to optimization balancing, and provide evidence that geometry-aware regularization can improve multimodal learning across diverse architectures and domains.

Zixuan Xia, Hao Wang, Peng-Cheng Weng et al. · 1 citation
#machine learning Conference Dec 2024

Classification Drives Geographic Bias in Street Scene Segmentation

This work investigated geo-biases in a Eurocentric driving dataset (Cityscapes) on the fine-grained localization task of instance segmentation and found that instance segmentation models trained on European driving scenes (Eurocentric models) were geo-biased.

Rahul Nair, Gabriel Tseng, Esther Rolf et al. · 0 citations
#artificial intelligence Preprint Aug 2026

ICON decomposition : Auditing deep neural networks with multivariate, variance-based concept-level explanations

CON decomposition is introduced, which quantifies how much of a layer's variance each concept explains given all other concepts and the outcome, and how much none of them explains, yielding layer-comparable, calibrated scores that suppress false positives.

Roshan Prakash, Marco Simnacher, Manuel Pfeuffer et al. · 0 citations

SERUM: State Extraction and Refinement for User Modeling

SERUM is the first system to produce interpretable process models from unstructured egocentric screen video without manual annotation, opening a scalable pathway for user modeling and behavioral understanding in the wild.

Andy J. Phu, Karin de Langis, James C Mooney et al. · 0 citations

OISD: On-Policy Internal Self-Distillation of Language Models

The OISD framework is proposed, which improves reasoning by transferring on-policy predictive signals from the final layer to intermediate representations and employs signed advantage-weighted Jensen--Shannon alignment to distill informative intermediate representations while preserving policy consistency under a unifi...

Xin-Yu Liu, Darryl C. Jacob, Yang Zhou et al. · 0 citations
#artificial intelligence Preprint Mar 2026

Mixture-Greedy for Online Generative Model Selection: Is UCB Necessary in Diversity-Aware Multi-Armed Bandits?

These results suggest that in diversity-aware multi-armed bandits, e.g., for generative model selection, exploration can arise intrinsically from the objective's geometry, particularly for widely used metrics such as FID and Vendi where tight confidence bounds are difficult to construct.

B. Nia, F. Farnia · 2 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.