Skip to content

Category

computer vision

3,462 papers

#machine learning Preprint Sep 2026

TC-Next: Zero-Shot Multimodal Cyclone Forecasting

We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6$-$24$ h leads by leveraging a foundation model's forecast fields of atmospheric kinematic and thermodynamic fields and GridSat infrared satellite imagery. Trained only on GraphCast foreca...

Zhe Wang, Si-Jie Chen, Yi-Ming Luo et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Open-World Semantic Segmentation with Sensitivity Modeling

This work addresses open-world semantic segmentation, the joint task of segmenting known classes while detecting and grouping novel or anomalous content without additional supervision, by extending a dual-decoder baseline with a third, complementary decoder within a unified encoder-decoder design.

Anastasios Romanos Varvarigos, Nikos Giakoumoglou, Tania Stathaki · 0 citations

Bernini: Latent Semantic Planning for Video Diffusion

To better handle multiple visual inputs, Segment-Aware 3D Rotary Positional Embedding (SA-3D RoPE) is introduced, and chain-of-thought reasoning in the planner is incorporated to better transfer understanding into generation.

Chenchen Liu, Junying Chen, Lei Li et al. · 10 citations · ⚡2

Multi-Modal Language Models as Text-to-Image Model Evaluators

MT2IE is presented, an evaluation framework in which a single multimodal large language model (MLLM) acts as an evaluator agent, iteratively generating the evaluation prompts and scoring the resulting images, showing that MT2IE's image-text consistency scores have higher correlation with human judgment than metrics pre...

Jiahui Chen, Candace Ross, Reyhane Askari-Hemmat et al. · 4 citations · ⚡1

TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learning

This work constructs DaTikZ-V4, a dataset more than four times larger and substantially higher in quality than DaTikZ-V3, enriched with LLM-generated figure descriptions, and trains TikZilla, a family of small open-source Qwen models with a two-stage pipeline of SFT followed by reinforcement learning (RL).

C. Greisinger, S. Eger · 5 citations
#artificial intelligence Preprint Sep 2026

RVSD: Retrieval Vision Sparse Decoding for Mitigating Visual Hallucinations in Large Vision-Language Models

RVSD is proposed, a training-free and plug-and-play decoding framework that unifies token sparsification and Semantic-Space Visual Retrieval (SSVR) within a single decoding pass, and asemantics-directed token selection is introduced within RVSD, which selectively sparsifies redundant tokens while preserving critical vi...

Can-Jie Liu, Jia-Wen Kang, Jin-Bo Wen et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Fine-Grained Anomaly Perception in Wild UGC-Enhanced Images: A Comprehensive Dataset and Difference-Fusion Framework

Image enhancement and restoration have become standard back-end operations on short-video and social media platforms to boost UGC visual experience. Yet these processes inevitably introduce visual anomalies--especially in faces, texts, and textures--that directly undermine perceptual fidelity and viewer trust. While ex...

Yan Zhong, Gefei Chen, Qiufang Ma et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Models

VMetaphor-Bench, the first benchmark for evaluating visual metaphor generation in T2I models, is introduced, combining a multiple-choice question (MCQ) based protocol of 9,594 questions across four levels of metaphorical fidelity with a dimension-based scoring protocol along three perceptual dimensions.

Chuer Chen, Zi-Chen Wang, Yi He et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.