Reinforcement learning (RL) is now central to training Reasoning Language Models (RLMs), but RLM pipelines are difficult to scale and costly to run because each RL step couples multiple large models, heterogeneous stages, cross-step state, and complex asynchronous dependencies. Existing systems typically optimize only...
Maciej Besta, L. Schmidt, Pierre Pang et al.· 0 citations
Scientific computing is under increasing pressure to adapt to HPC hardware that is shaped by AI workloads. In these modern ecosystems, extracting reasonable performance without investing major engineering effort is a central issue for domain scientists. Correctness constraints and intricate reference implementations re...
Faveo Hörold, Georgiana Mania, P. Adamidis et al.· 0 citations
FitzRoy is presented, the first system that simultaneously achieves state-of-the-art predictive skill and physical realism over the continental United States and establishes a new frontier for high-fidelity precipitation forecasting.
Ozan Sener, A. Avati, David Hafner et al.· 0 citations
This work presents a trace-driven study of network sensitivity for training and inference workloads at scales up to 4,096 GPUs, and combines signature-based trace decomposition with linear programming to make broad network-parameter sweeps feasible.
Tommaso Bonato, A. Rastegari, D. De Sensi et al.· 0 citations
Agentic workflows are increasingly shifting towards long-horizon tasks, such as open-ended scientific work, where models benefit from long context windows. However, at ultra-long context (above 1M tokens), full attention is prohibitively expensive. A promising approach is sparse attention, in which a dedicated indexer...
Aleš Kubíček, Andrea Caciolai, Liang-Zu Peng et al.· 0 citations
The Canonical Parallel Form (CPF), a device-neutral program state from which every ordering constraint the authors' analyses prove unnecessary has been removed, is introduced, a device-neutral program state from which every ordering constraint their analyses prove unnecessary has been removed.
Yakup Budanaz, Pratyai Mazumder, A. Calotoiu et al.· arXiv.org· 1 citation
Coding agents are increasingly used to optimize code, but existing benchmarks fix one accelerator, programming model or harness, so they cannot isolate what each component contributes or show whether added skills and tools repay their cost. We present HPCAgent-Bench with 689 kernels in three tracks: loop-level optimiza...
Yakup Budanaz, Lorenzo Paleari, Marcin Copik et al.· 0 citations
Datacenter congestion control (CC) and load balancing (LB) evolve rapidly as workload demands change, but deployment depends on RDMA hardware and transport interfaces. Emerging programmable RDMA engines tie policy code to vendor APIs. Operators must therefore port each policy for every platform they deploy. We address...
Mikhail Khalilov, Timo Schneider, Tommaso Bonato et al.· 0 citations
While FP64 (binary64) remains the standard representation of real numbers in scientific computing, hardware trends increasingly favor low-precision formats optimized for AI workloads. This shift prioritizes throughput and energy efficiency over full-precision capabilities. We challenge the necessity of high-precision a...
Pratyai Mazumder, A. Calotoiu, Marcin Copik et al.· 0 citations
This work presents Ampel: a system to schedule ML training flows at the network cuts that leverages packet-spraying's ability to spread traffic evenly across all available paths to simplify the view of the topology into one only containing potential bottlenecks, and then bridges this new simplified model with past work...
Valerio Torsiello, Ayush Mishra, Sushovan Das et al.· Conference on Applications,...· 0 citations
Kohn-Sham density functional theory (DFT) remains the workhorse of ab initio materials simulation, yet cubic computational and quadratic memory scaling have confined calculations to a few hundred to thousands of atoms, spanning only nanometers, far below experimentally relevant length scales. We introduce XLSDFT, a lin...
Qi-Men Xu, Yu Zhang, Di-Xing Ni et al.· arXiv.org· 0 citations
Large language models (LLMs) are increasingly used to generate, complete, and transform information in settings where their outputs can shape consequential decisions, raising concerns about their impact on demographic disparities. In this context, causal inference provides a principled basis for assessing fairness, bec...
Patrik Okanovic, T. Hoefler, Drago Plečko· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.