Skip to content

Category

computer vision

3,462 papers

TEVI: Text-Conditioned Editing of Visual Representations via Sparse Autoencoders for Improved Vision-Language Alignment

This work proposes TEVI, a framework that uses captions as a signal for what to retain from image embeddings and uses sparse autoencoders to disentangle image embeddings and train a masking module to selectively reconstruct the embedding based on a given caption.

S. Mahajan, Sukrut Rao, Jiahao Xie et al. · 1 citation
#artificial intelligence Open access Mar 2026

LRConv-NeRV: Low-Rank Convolution for Efficient Neural Video Compression

LRConv–NeRV, an efficient NeRV variant that replaces selected dense convolutional layers with structured low-rank separable convolutions, trained end-to-end within the decoder architecture, is proposed, establishing LRConv–NeRV as a potential architectural alternative for efficient neural video decoding under low-preci...

T. Shanableh · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Ex-Omni: Enabling 3D Facial Animation Generation for Omni-modal Large Language Models

Omni-modal large language models (OLLMs) aim to unify multimodal understanding and generation, yet extending them to jointly produce speech and 3D facial animation remains largely underexplored. A key challenge is the mismatch between the discrete semantic reasoning of LLMs and the dense temporal dynamics required for...

Haoyu Zhang, Zhipeng Li, Yiwen Guo et al. · 0 citations
#artificial intelligence Preprint Nov 2025

AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulation

AnyBox is presented, an efficient zero-shot framework that exploits the geometric regularity of boxes to jointly recover pose and dimensions from a single RGB-D observation, and approaches instance-level pipelines that have access to ground-truth CAD models.

Yintao Ma, Sajjad Pakdamansavoji, Charles Eret et al. · 0 citations

Short-Window Sliding Learning for Real-Time Violence Detection via LLM-based Auto-Labeling

A Short-Window Sliding Learning framework for real-time violence detection in CCTV footages that divides videos into 1-2 second clips and applies Large Language Model (LLM)-based auto-caption labeling to construct fine-grained datasets, enabling precise recognition of rapid violent events.

Seoik Jung, Taekyung Song, Yan-Cen Lee et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

Decentralized Vision-Based Autonomous Aerial Wildlife Monitoring

Wildlife field operations demand efficient parallel deployment methods to identify and interact with specific individuals, enabling simultaneous collective behavioral analysis, and health and safety interventions. Previous robotics solutions approach the problem from the herd perspective, or are manually operated and l...

Makram Chahine, William Yang, Alaa Maalouf et al. · 0 citations
#artificial intelligence Review Aug 2025

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications

A taxonomy of reasoning enhancement techniques is proposed, categorized into training-time strategies (e.g., supervised fine-tuning, reinforcement learning) and test-time mechanisms (e.g., prompt engineering, multi-agent systems), and outlining future directions toward building efficient, robust, and sociotechnically r...

Zi-Zhan Ma, Wen-Xuan Wang, Meidan Ding et al. · 16 citations
#artificial intelligence Preprint Jun 2025

ScoreMix: Synthetic Data Generation by Score Composition in Diffusion Models Improves Recognition

This paper proposes ScoreMix, a self-contained synthetic generation method to produce hard synthetic samples for recognition tasks by leveraging the score compositionality of diffusion models, and finds that mixing classes distant in the discriminator's embedding space yields larger gains, compared to selection based o...

Parsa Rahimi, Sébastien Marcel · 0 citations
#artificial intelligence Preprint Aug 2026

Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence

Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, but a spoken answer still leaves the agent visually absent. We introduce \textbf{Ex-Omni-2D}, a framework that answers a multimodal query with coordinated text, personalized speech, and reference-conditioned video. The dialogue m...

Haoyu Zhang, Zhipeng Li, Xiaoying Tang et al. · 0 citations
#artificial intelligence Preprint Mar 2026

A Comparative Study in Surgical AI: Potential and Limitations of Data, Compute, and Scaling

It is demonstrated that even with multi-billion parameter models and extensive training, current Vision Language Models fall short in the seemingly simple task of tool detection in neurosurgery, and experiments suggest that current models could still face significant obstacles in surgical use cases.

K. Skobelev, Eric Fithian, Yegor Baranovski et al. · 0 citations
#artificial intelligence Preprint Sep 2026

One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing

Video editing spans diverse editing paradigms, yet achieving high-quality instruction-guided and subject-guided editing within a single unified framework remains challenging. We introduce EditVid, a training-free framework combining sparse causal memory for local coherence, correspondence-based post-attention token inj...

A. Juvekar, O. Susladkar, K. A. Nguyen et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.