Skip to content

Category

computer vision

3,740 papers

#computer vision Preprint Aug 2026

PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference

PACE (Pixel-Adaptive Condense and Extract), a training-free inference framework that accelerates both the vision encoder and the Large Language Model (LLM) via a unified Condense-and-Extract paradigm, is proposed.

Jun-Jie Liu, Shengyuan Ye, Xu Chen · 0 citations
#computer vision Preprint Jul 2026

Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers

A dual-branch controlled framework is constructed in which both a Vision-based model and an index-based baseline share an identical decoder backbone, training objective, optimizer, and data curriculum, suggesting that transformers are more modality-agnostic than commonly assumed, and that discrete tokenization is not a...

Shuyang Xiang, Hao Guan · 0 citations

Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning

Federated Continual Multimodal Learning (FedCMM), a framework that embeds continual-learning safeguards into the federated optimization loop at three complementary levels, is proposed, confirming that holistic, modality-aware optimization enables robust evolutive adaptation across heterogeneous networked AI deployments...

Jing Liu, Chenxuanyi Zou, Jiayang Ren et al. · 0 citations
#computer vision Jul 2026

Semantic Anchoring for Robotic Action Representations

This work examines whether a robot's action representations preserve the semantic structure captured by pretrained encoders and introduces a plug-and-play method that anchors action representations to a semantic manifold while decomposing representations into a shared semantic channel and a private channel, all discard...

Yuan Xu, Youheng Shi, Chengyang Li et al. · 0 citations
#computer vision Preprint Aug 2026

A Simulator-Grounded Framework For Constructing Verifiable Muscle-Grounded QA From 3D Tongue Meshes (extended version)

A simulator-grounded construction framework, instantiated as 3DTongueQA, that shows geometry-grounded supervision supporting both unified language QA and structured prediction and shows geometry-grounded supervision supporting both unified language QA and structured prediction.

Seungho Eum, Unsang Park · 0 citations
#computer vision Jan 2026

A Multimodal Dataset of Student Oral Presentations with Sensors and Evaluation Data

The SOPHIAS dataset, a 12-hour multimodal dataset containing recordings of 50 oral presentations delivered by 65 undergraduate and master's students at the Universidad Autonoma de Madrid, enables the exploration of relationships between multimodal behavioral and physiological signals and presentation performance, and p...

Álvaro Becerra, Ruth Cobos, Roberto Daza · 4 citations
#computer vision Preprint Aug 2026

SeMoCo: A Semantic-First Motion Codec for Motion Language Modeling

SeMoCo, a semantic-first motion codec, is introduced together with a dual-axis motion generator for language-conditioned motion generation and $\Omega$-MotionVerse, a large-scale, multi-source human-motion dataset unified under the SOMA representation is constructed.

Tianlv Huang, He-Tian Guo, Zi-Yi Cai et al. · 1 citation
#computer vision Jun 2026

MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering

MemoryCard is a video-memory-based augmentation framework that organizes long videos into self-contained Memory Cards, each corresponding to a distinct topic or event, and consistently improves long-video QA performance under comparable visual-token budgets.

Qing Yang, Pengcheng Huang, Xinze Li et al. · 0 citations
#computer vision Sep 2025

The Telephone Game: Evaluating Semantic Drift in Unified Models

Mean Cumulative Drift (MCD), an embedding-based measure of content retention across three representation spaces, and Multi-Generation GenEval (MGG), extending GenEval's object-level compliance scoring across generations are proposed, to quantify drift.

Sabbir Mollah, Rohit Gupta, Sirnam Swetha et al. · 4 citations
#computer vision Preprint Jun 2026

LV-ROVER-MLT: Low-Resource Maltese OCR by Synthetic Fine-Tuning and Multi-Stream Arbitration

Maltese has substantial text corpora and pretrained language models, but paragraph-scale OCR training data remains scarce; NOMOCRAT provides 57 verified annotated pages. LV-ROVER-MLT combines synthetic fine-tuning of Tesseract~5 with five complementary recognition streams and lexicon-gated word-level arbitration adapte...

Adam Darmanin · 1 citation
#computer vision Preprint Aug 2026

Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs

This work studies ViT attention heads and finds they differentiate into object- and background-specialist roles, a pattern most pronounced under full attention, and proposes SHS-Index to quantify this specialization, showing that it distinguishes full-attention from chunk-window ViTs, and finds that it strongly tracks...

Chenyu He, Lei Li, Shi-Cheng Li et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.