This paper proposes conditioned initialization, a principled scheme that initializes attention weights to improve the spectral properties of the attention layer and shows that conditioned initialization can potentially reduce the condition number of the attention Jacobian, leading to more stable optimization.
This paper proposes NeuCME, a novel framework designed to effectively learn and integrate knowledge across tasks with varying modalities, and formulate an evaluation metric to quantify the dynamism of task sequences and then set up a comprehensive benchmark with different degrees of dynamism.
Kai Guo, Chuan-Bin Liu, Peng Hu et al.· 0 citations
This work introduces Selective Posterior Margin Regularization (SPMR), which preserves the Forward objective and converts this disagreement into a graded update on the clean classifier and transfers to estimated transitions, human annotations, architectural changes, and stronger Forward recipes.
Ze-Xing Zhang, Ji-Chao Li, Tian-Yang Lei et al.· 0 citations
Capsule Lens is introduced, a framework that matches the region a concept occupies with a simple, trackable geometric form, a capsule, defined by several interpretable parameters, fitted in closed form to each concept's geometry and validated on held-out samples.
Yi-Ming Tang, Harshvardhan Saini, Samyak Jha et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
Token communications realize the semantic communication principle at the granularity of transformer tokens, providing a promising direction for client--server collaborative inference in resource-constrained edge systems. However, directly transmitting token embeddings presents two practical challenges: substantial comm...
Jiwoong Im, Minwoo Kim, Jaeho Lee et al.· 0 citations
Accurate field plant disease diagnosis requires reliable fusion of uncertain and conflicting perceptual evidence. We present the Hybrid Hierarchical Multi-Agent Framework (H$^{2}$MAF), combining decision-level fusion of EfficientNet-B3 and ConvNeXt-Tiny with semantic arbitration by open-weight multimodal large language...
Ranjan Sapkota, Konstantinos I. Roumeliotis, Pengyao Xie et al.· 0 citations
Visual world-model agents such as DreamerV3 act through a recurrent latent state rather than a single observation, which weakens frame-wise observation attacks and makes their perturbations vary sharply over time under a strict per-frame perturbation constraint. We study white-box, causal, online attacks on such agents...
Jiancheng Wang, Mingli Zhu, Tong Zhang et al.· 0 citations
This paper presents ReLATE, a Reliable Evidence Learning framework with Adaptive Token Evidence Regulation, which realizes reliability-adaptive feature fusion during descriptor construction and achieves the best average corrupted-test performance among the compared methods while maintaining competitive accuracy on clea...
Hao-Chen Jiang, Jialei Pan, Yuzhe Sun et al.· arXiv.org· 0 citations
3D Visual Grounding (3DVG) aims to localize target objects in 3D scenes given natural language descriptions. Existing approaches typically perform reasoning over the entire scene, leading to ambiguous predictions and high computational cost, especially in cluttered environments. We observe that many referential express...
Duc Cao Dinh, Khai Le-Duc, Florent Draye et al.· 0 citations
Arbitrary-Scale Super-Resolution (ASR) reconstructs images at continuous magnification factors. Recent methods accelerate inference by replacing computationally heavy implicit neural decoders with explicit 2D Gaussian Splatting (GS). However, since standard Gaussians are smooth low-pass primitives, modeling edges and f...
Giulio Federico, Giuseppe Amato, Claudio Gennaro et al.· 0 citations
QuADA-GS is proposed, an approach that retains a powerful representational backbone but autonomously predicts where to allocate Gaussians relying strictly on the low-resolution input, providing an improved and competitive trade-off for ASR.
Giulio Federico, Giuseppe Amato, C. Gennaro et al.· 0 citations
HAT-4D is proposed, the first agentic framework designed to reconstruct the 3D geometry, temporal dynamics, and physical interactions of multiple objects from a single video, accompanied by a novel multi-dimensional evaluation protocol focused on physical plausibility and temporal consistency.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.