Internal visual-text alignment in MLLMs is best read as a geometric diagnostic of the visual stream inside the language model rather than a direct proxy for content-level cross-modal interaction, and is most informative when calibrated by controlled task evidence.
Fine-grained object detectors are commonly evaluated with confusion matrices, which show where the model is confused but not why, nor whether the confusion can be reduced. We argue that confusion can be attributed to distinct, separable sources, each quantitatively measurable, turning a passive measurement into actiona...
The value of reusable coefficient fields for accurate reconstruction beyond the supervised resolution with low incremental arithmetic cost is demonstrated and SCOPE leads the compared methods across six metrics in the main supervised-scale evaluation.
Ze-Kai Shi, Meng Zhang, Hao-Kun Zhang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Experiments show that VG-TIE is competitive with other tabular-to-image methods while providing interpretability on feature importance and ranking similar to intrinsic interpretable methods, and highlights the potential of the proposed image-based transformation to provide an effective framework that expands the use of...
David Chushig-Muzo, L. López-Ramos, Ángeles Rodríguez de Cara et al.· 0 citations
Albireo is presented, a detector-agnostic, codec-free adaptive inference framework that wraps off-the-shelf detectors and decides when detector invocation can be safely skipped based on scene content and per-object temporal state, requiring no detector modification or retraining.
Amir Taherin, José Cano, Bin Ren et al.· 0 citations
Flow-Based Distribution Matching is introduced, a non-adversarial framework that learns this reference-directed geometry through spherical conditional velocity regression that achieves performance nearly on par with DM and remains competitive with existing SSL methods.
Yu-Ling Jiao, Wen-Sen Ma, Hou-Duo Qi et al.· 0 citations
Unified vision-language models (VLMs) that tokenize images through a vector-quantized (VQ) codebook routinely hallucinate objects on grounded yes/no benchmarks, yet existing decoding-time fixes treat this as generic miscalibration without an architectural account. Using activation patching across twenty-five models spa...
Shamanthak Hegde, Xiang-Rui Liu, Maitreya Patel et al.· 0 citations
Onboard vision-language models could enable satellites to answer queries directly, but exhaustive tiled inference over high-resolution imagery is slow and energy-intensive. We identify answer-invariant token redundancy (AITR): image tiles and vision tokens that can be removed without changing the final answer. We prese...
Ishani Janveja, Davis Zhang, Seoyul Oh et al.· 0 citations
Textual descriptions can reduce ambiguity in medical image segmentation by specifying the finding and location to be delineated. Existing text-guided methods mainly improve where image and language features interact but generally retain a single learned update pathway across all image-text pairs. We propose MRSeg, a pa...
Md. Maklachur Rahman, M. H. Al Banna, Saraf Anjum et al.· 0 citations
Encoding input coordinates with sinusoidal functions into multi-layer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of surfaces defined as zero-level sets. However, existing methods often struggle to balance training efficiency, rendering speed, and noise robustness: single-MLP appr...
Vin\'icius da Silva, Isabelle Melo, Matheus Bessa et al.· 0 citations
Benchmarking is an increasingly critical part of research in machine learning and the domains where it is applied, including healthcare. Yet, despite the steady development of new ultrasound foundation models in recent years, the development of well-designed benchmarks to evaluate them has lagged behind. This deficienc...
Ashwath Radhachandran, Adam Tupper, Christian Gagné et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.