Cooperative multi-agent tasks often impose constraints on a shared objective or collective safety. A team level violation cost function can measure this constraint outcome, but does not distinguish which agents'actions most strongly influence that violation. We present SafeDiSTL, a constrained multi-agent reinforcement...
Efficient attention mechanisms, such as linear and sliding window attention, aim to reduce the computational complexity of Transformers from quadratic to linear. However, their degraded in-context recall often necessitates interleaving full attention layers, leaving the quadratic bottleneck unresolved in long-context p...
Yuhong Chou, Zehao Liu, Yuqi Pan et al.· 0 citations
Scaling generalist robotic policies is limited by the high cost of collecting embodied interaction data. Large-scale egocentric human videos offer a rich alternative, but they lack robot action labels, and existing action annotation methods are often noisy under real-world visual complexity and diverse manipulation dyn...
Zhi-Yuan Xiang, Pei-Dong Liu, Ming-Yang Li et al.· 0 citations
Counterfactual inference asks how an observed outcome might have differed under different circumstances, such as whether a patient would have recovered had they received a different treatment. Such questions arise whenever decisions depend on the outcomes of alternatives that were not observed. Answering counterfactual...
Hendrik Stumpf, Francesco Quinzan· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This paper shows that standard (post-hoc) calibrators can be trained end-to-end with the backbone via a bilevel Stackelberg formulation, and shows that using the final classification layer itself as the calibrator yields accurate, well-calibrated models with no additional parameters.
Nektarios G. Kalampalikis, Pablo M. Olmos, Isabel Valera· 0 citations
Standard Policy Gradient (PG) algorithms suffer from high estimation variance because they rely on Monte Carlo updates. While off-policy variance reduction mitigates this problem, establishing optimal sample complexity currently requires either restrictive assumptions, such as uniformly bounded importance weights, or i...
Linearizing softmax attention offers a route to efficient Transformer inference, but preserving pretrained attention remains challenging. We identify an important source of approximation error overlooked by standard linearization methods: a small number of outlier dimensions contribute disproportionately to query-key d...
Wei-Qi Sun, Qian-Yue Wu, Wen-Jia Wang et al.· 0 citations
Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene in failed rollouts and determine how to redirect them. To choose where to intervene, we train a 130K-...
Jiwon Jeon, Myungsik Cho, Jeonghye Kim et al.· 0 citations
The Abstraction and Reasoning Corpus (ARC) is increasingly used to evaluate whether neural networks can infer task-specific transformations from few demonstrations. Recent ARC models differ in architecture, but also in broader training and evaluation protocols, including pretraining data, data augmentation, test-time s...
Adrien Deliege, Marc Van Droogenbroeck· 0 citations
Selecting a subset of features (columns) from a tabular dataset is a ubiquitous challenge in real-world applications. Industry experts seek to minimize model training costs, climate scientists require an interpretable subset of factors to understand extreme weather events, and clinicians need to choose among diagnostic...
Bastian Sch\"afer, Dominika Matus, Lennart Purucker et al.· 0 citations
Machine learning models are increasingly used for automated feature extraction from weakly annotated bioimaging data, such as microscopy and cytomorphology images. Due to the sole dependency of automated feature extraction, existing methods yield inconsistent classification performance across weakly annotated datasets....
Jayanie Bogahawatte, Sachith Seneviratne, Simon Maksour et al.· 0 citations
Large Language Models (LLMs) are increasingly used throughout the software development lifecycle. This growing reliance on LLMs raises concerns about their trustworthiness, with deception posing a particularly important risk. Deceptive behavior takes the form of misleading responses or assistance in fabricating, concea...
Xi-Ting Liu, Lin Yang, Yi-Tong Zhang et al.· 0 citations