Contrastive Language-Image Pretraining (CLIP) is a building block of many machine learning applications. Scaling laws have guided resource allocation for large-scale training, yet prior work treats total CLIP model size as a single variable, without exploring how the capacity split between encoders impacts downstream p...
Full-page end-to-end Optical Music Recognition seeks to transcribe entire music pages directly into symbolic notation, avoiding the limitations of traditional pipelines that rely on accurate staff segmentation. Recent Transformer-based architectures have achieved strong performance on typeset scores, relying on large-s...
Adrian Rosello, Antonio Ríos-Vila, David Rizo et al.· 0 citations
Extensive experiments on ScoliSurg demonstrate that ViT$^{3}$Flow achieves the best performance among the compared methods in perceptual image quality, anatomical fidelity, and clinically relevant geometric accuracy, while requiring only a single network evaluation.
Rui Tang, Si-Cheng Yang, Mo-Xin Zhao et al.· 0 citations
Results support NIR video as an independently informative and complementary modality for PSG-defined sleep-stage estimation, and propose ViNUSS (Video-Native Unmediated Sleep Staging), a framework that combines subject-relative micro-motion learning with full-night sleep dynamics modeling.
Kun-Min Jang, You Rim Choi, Hun Heo et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
PARITY (Paired Assessment with Reused Identity), a synthetic, demographically balanced set of identity-controlled neutral/expression portrait pairs with neutral-neutral controls, is introduced, finding a clear split between refusal-first models and speculative models; in the latter, certain expressions disproportionate...
Karan Dua, Amit Agarwal, Hitesh Laxmichand Patel et al.· 0 citations
DLMR is a parameter-efficient mechanism that equips MLLMs with Dual Latent Memories: a visual memory that compresses image evidence and a reasoning memory that tracks intermediate conclusions and constraints with only a small number of additional trainable parameters.
Hao-Xuan Ma, Jin-Fei Qi, Yi-Cheng Xiao et al.· 0 citations
This work studies the problem in web-agent guardrails, where a VLM judges whether on-screen text conflicts with a user instruction, and proposes two training-free interventions that improve grounding without changing verdicts.
Overall, unconditional diffusion captures local gaze kinematics and short-range temporal and directional structure, while long-range properties such as saccade counts and cumulative path geometry remain targets for future conditioned models.
Laxman Basnet, Alexander Szorkovszky, Pedro G. Lind et al.· 0 citations
The proposed situation identification approach enables efficient sensor data management by prioritizing relevant data to the current traffic situation by identifying the current traffic situation using Bird's-Eye-View images.
CrossModalQA is introduced, an open-domain benchmark for evaluating multimodal retrieval and reasoning over heterogeneous corpora and it is revealed that complete cross-modal retrieval contributes more to answer accuracy than generator scaling, while multi-image retrieval and reasoning remain the primary bottlenecks li...
Jia-Cheng Cai, Zi-Jin Hong, Zheng Yuan et al.· 0 citations
Testing off-the-shelf vision-language models shows that general-purpose VLMs can generate human-aligned, goal-directed spatial priorities without gaze-specific training, informing theories of goal-directed attention and offering scalable tools for predicting where people look across tasks.
RevalExo benchmarks unimodal and multimodal locomotion mode recognition across multiple horizons, cross-population generalization from older adults without mobility impairments to clinical cohorts, and vision-guided knowledge transfer to IMU-only models.
Diwas Lamsal, J. Carlon, R. Claeys et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.