Foundation vision-language models (VLMs) exhibit broad intelligence about the world, yet translating this intelligence into robot control remains challenging. We present Show-Harness, an Embodied Harness that enables VLMs to"play"robots through a compact semantic interface linking intent to action. Show-Harness exposes...
Yan-Zhe Chen, Ze-Chen Bai, Zhi-Jun Cao et al.· 23 citations· ⚡2
SemiGroup-JEPA (SG-JEPA), which extends the LeWorldModel framework by supplying the parameter governing the physics to the temporal model via action-conditioning and jointly training an encoder and predictor through an autoregressive latent rollout, is introduced.
The PACE is presented, a framework for retrieval-augmented dialogue serving that formalizes Perceived Time-to-First-Response (PTFR) as a QoE objective and minimizes it under quality/cost constraints and is the first quantification of filler-answer conflict risk in deployed services.
Ling Huang, Yujuan Tan, Wei-Sheng Li et al.· 0 citations
Multimodal large language models (MLLMs) process hundreds or thousands of visual tokens per image, incurring prohibitive inference costs. While existing vision token pruning methods mitigate this overhead, they implicitly assume that a single fixed pruning strategy can be applied uniformly across all inputs. Our analys...
Hai-Jin Liang, P. Zhou, Zheng-Lin Wan et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The lottery ticket hypothesis posits the existence of winning tickets: sparse subnetworks that, when trained in isolation from their original initialization, match the accuracy of the full dense network. The predominant method for discovering such tickets, iterative magnitude pruning, alternates pruning with full retra...
Benedikt Tscheschner, Eduardo Veas, Marc Masana· 0 citations
An automatic framework for continuous SA profiling from super-resolved MR volumes is proposed, extending conventional SA assessment to a continuous profile-based description of trochlear morphology without additional imaging, while remaining conceptually linked to current clinical assessment.
Michael Wehrli, Leo Widmer, Edwin Li et al.· 0 citations
A statistical approach to bias rectification that can be combined in a turn-key fashion with any classical GZSL feature learner as a blackbox, thereby suggesting a wide scope of applicability of this method for a wide variety of GZSL implementations in different domains.
C. Chew, Gim Siang Chia, S. Chanda et al.· 0 citations
This paper proposes Elastoformer: A framework that transforms conventional neural networks into Elastic NN capable of real-time elastic inference, and offers a single, modular solution that dynamically switches between multiple modes of operation at runtime, adapting efficiently to the changing computational budgets of...
Sudaksh Kalra, D. Sapra· IFIP International Informati...· 1 citation
A controlled evaluation of adversarial transferability across 60 detectors spanning six backbones, two pretraining regimes, and five training-data configurations establishes source-model selection as central dimensions of credible transfer-based black-box robustness evaluation.
Rafael M. Mamede, Pedro C. Neto, A. F. Sequeira· 0 citations
This work introduces FlowCPO, an offline forward-KL objective that uses both preferred and dispreferred samples without online rollouts and shows under explicit regularity conditions that the forward-KL objective is bounded by a contrastive flow matching loss, yielding a tractable surrogate on fixed data.
Yan-Sen Han, Shengyi Liao, Peng Sun et al.· 0 citations
Language models can fluently describe how they would behave: whether they would cave to pushback, misuse a tool, or lie under pressure. Is that description actually about the model speaking? We turn self-knowledge into a prediction test. Across nine behavioral evaluations, we measure how a model behaves under different...
This work introduces a novel LBM-based architecture that enforces physical consistency through a pixel reconstruction loss, benefits from the inherent efficiency of LBM low-cost inference, and improves generalization across diverse datasets by incorporating a shading conditioning.
Carme Corbi, David Serrano-Lozano, Javier Vazquez-Corral et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.