Skip to content

Author

T. Hoefler

We have 19 of 631 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

RPEG: Training Reasoning Language Models Scalably and Cost-Effectively

Reinforcement learning (RL) is now central to training Reasoning Language Models (RLMs), but RLM pipelines are difficult to scale and costly to run because each RL step couples multiple large models, heterogeneous stages, cross-step state, and complex asynchronous dependencies. Existing systems typically optimize only...

Maciej Besta, L. Schmidt, Pierre Pang et al. · 0 citations
Preprint Nov 2026

Performance Portability Explained: Insights from accelerating ICON microphysics

Scientific computing is under increasing pressure to adapt to HPC hardware that is shaped by AI workloads. In these modern ecosystems, extracting reasonable performance without investing major engineering effort is a central issue for domain scientists. Correctness constraints and intricate reference implementations re...

Faveo Hörold, Georgiana Mania, P. Adamidis et al. · 0 citations
Preprint Oct 2026

Skillful and realistic precipitation forecasting with reinforced diffusion

FitzRoy is presented, the first system that simultaneously achieves state-of-the-art predictive skill and physical realism over the continental United States and establishes a new frontier for high-fidelity precipitation forecasting.

Ozan Sener, A. Avati, David Hafner et al. · 0 citations
Preprint Oct 2026

Provisioning Networks for AI Supercomputers: A Trace-Driven Study of Performance Sensitivity at Unprecedented Scale

This work presents a trace-driven study of network sensitivity for training and inference workloads at scales up to 4,096 GPUs, and combines signature-based trace decomposition with linear programming to make broad network-parameter sweeps feasible.

Tommaso Bonato, A. Rastegari, D. De Sensi et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention

Agentic workflows are increasingly shifting towards long-horizon tasks, such as open-ended scientific work, where models benefit from long context windows. However, at ultra-long context (above 1M tokens), full attention is prohibitively expensive. A promising approach is sparse attention, in which a dedicated indexer...

Aleš Kubíček, Andrea Caciolai, Liang-Zu Peng et al. · 0 citations
Sep 2026

The Canonical Parallel Form as a Substrate for Parallelizing Compilers and Agentic Optimizers

The Canonical Parallel Form (CPF), a device-neutral program state from which every ordering constraint the authors' analyses prove unnecessary has been removed, is introduced, a device-neutral program state from which every ordering constraint their analyses prove unnecessary has been removed.

Yakup Budanaz, Pratyai Mazumder, A. Calotoiu et al. · 1 citation
Preprint Oct 2026

HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills

Coding agents are increasingly used to optimize code, but existing benchmarks fix one accelerator, programming model or harness, so they cannot isolate what each component contributes or show whether added skills and tools repay their cost. We present HPCAgent-Bench with 689 kernels in three tracks: loop-level optimiza...

Yakup Budanaz, Lorenzo Paleari, Marcin Copik et al. · 0 citations
Preprint Oct 2026

PCM: Programmable Congestion Management for Terabit RDMA NICs

Datacenter congestion control (CC) and load balancing (LB) evolve rapidly as workload demands change, but deployment depends on RDMA hardware and transport interfaces. Emerging programmable RDMA engines tie policy code to vendor APIs. Operators must therefore port each policy for every platform they deploy. We address...

Mikhail Khalilov, Timo Schneider, Tommaso Bonato et al. · 0 citations
Preprint Oct 2026

What Bloats Your Floats? Right-Sizing Numerical Precision for Scientific Computing

While FP64 (binary64) remains the standard representation of real numbers in scientific computing, hardware trends increasingly favor low-precision formats optimized for AI workloads. This shift prioritizes throughput and energy efficiency over full-precision capabilities. We challenge the necessity of high-precision a...

Pratyai Mazumder, A. Calotoiu, Marcin Copik et al. · 0 citations
Book Open access Aug 2026

Ampel: Scheduling at the Network Cut in ML Training

This work presents Ampel: a system to schedule ML training flows at the network cuts that leverages packet-spraying's ability to spread traffic evenly across all available paths to simplify the view of the topology into one only containing potential bottlenecks, and then bridges this new simplified model with past work...

Valerio Torsiello, Ayush Mishra, Sushovan Das et al. · 0 citations
Sep 2026

Extreme-Scale Linear-Scaling Kohn-Sham DFT at 100 Million Atoms: Bridging Quantum Simulations and Experiments

Kohn-Sham density functional theory (DFT) remains the workhorse of ab initio materials simulation, yet cubic computational and quadratic memory scaling have confined calculations to a few hundred to thousands of atoms, spanning only nanometers, far below experimentally relevant length scales. We introduce XLSDFT, a lin...

Qi-Men Xu, Yu Zhang, Di-Xing Ni et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Causally Fair Generation with Large Language Models

Large language models (LLMs) are increasingly used to generate, complete, and transform information in settings where their outputs can shape consequential decisions, raising concerns about their impact on demographic disparities. In this context, causal inference provides a principled basis for assessing fairness, bec...

Patrik Okanovic, T. Hoefler, Drago Plečko · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.