It is indicated that current VLMs can identify anomalies within individual frames but struggle to integrate information across frames to reason about temporal consistency, and TimeCatch provides a controlled benchmark for evaluating temporal grounding in vision-language models.
An Implicit Cultural Alignment Reward Model built upon a lightweight 4.2-billion-parameter Multimodal Large Language Model (MLLM) integrated with a Skip-connection Cross-Attention mechanism, enabling late-stage semantic features to directly attend to early-stage visual representations and better preserve culturally sal...
A novel framework for single-shot shape and pose estimation of unknown spacecraft objects using only a single image and reconstructed geometry is proposed, demonstrating strong generalization to unseen spacecraft.
Josiane Uwumukiza, Jocelyn Zhao, Giovanni Lavezzi et al.· 0 citations
The method sets a new state of the art in 4D reconstruction and seamlessly generalizes to in-the-wild videos with large viewpoint changes and dynamic motions, improving both novel-view synthesis and the underlying 3D motion.
Liyuan Zhu, Shengyu Huang, Amrita Mazumdar et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work proposes to decouple the frequencies of memory updates and Memory Caching, and introduces two critical mechanisms: an auxiliary Memory Loss that forces persistent internalization of the scene, and a Memory Caching strategy that regularizes active weights against catastrophic drift.
Baback Elmieh, Lynn Tsai, Zeman Li et al.· arXiv.org· 0 citations
This paper provides a formal definition of Causal WMs (CWMs) grounded in the tasks they are intended to support, connecting existing work in causal representation learning, object-centric learning, causal discovery, structural causal models, and model-based decision-making.
BATON improves task success by 11.6% and cumulative success by 14.9% over the SoTA and improves task success by 11.6% over the RoboMemArena on the long-horizon benchmark RoboMemArena.
This work takes a minimalist approach to designing a competitive generative model that produces high quality samples at fast speed and achieves an FID of 2.56 on ImageNet 256 and simultaneously attains good precision and recall.
These findings show that reliable evaluation of LLM-generated code requires validated ground truth, protected tests, and multiple explicitly interpreted measures, and that CodeAssay provides a reproducible basis for evidence-based model evaluation in AI-augmented software development.
Shahbaz Siddeeq, Muhammad Waseem, Umar Subhan Malhi et al.· 0 citations
This empirical research establishes the essential groundwork for predictably scaling multimodal foundation models by modeling the influence of data composition on compute laws and allocation exponents and derive an efficiency frontier specifying precise configurations of model size, token count, and data mixture.
Haoyuan Wu, Aoqi Wu, Hai Wang et al.· arXiv.org· 1 citation
LookBack, a training-free LVLM response scoring method that augments token likelihood with visual lookback score, a lightweight measure of how strongly each response token refers to image tokens, consistently improves Best-of-$N$ selection over existing baselines with negligible additional overhead.
Beomsik Cho, Jin-Ha Kim, Dongseok Lee et al.· 0 citations
Current structure-based drug design generative models often struggle to faithfully recapitulate genuine ligand-protein binding interactions. Instead, under the coupling of implicit learning architectures and biased training data, they tend to learn spurious statistical correlations. To address this, we propose EIP-Diff...
Huabin Du, Mingyang Wang, M. Luo et al.· Journal of the American Chem...· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.