Skip to content

FromPitch2Board: Benchmarking LLM Agents in Long-Horizon Football Management

Sep 2026 · 0 citations · 42 references
Computer Science

TL;DR

FromPitch2Board, a deterministic football-management benchmark that studies five configurable factors through controlled comparisons on a single simulator, is introduced, showing that responsibility scope and horizon expose behavior changes that a single headline score conceals.

Abstract

Long-horizon agent benchmarks typically report how far an agent progresses, but do not identify whether its performance comes from the foundation model, scaffold, responsibility scope, match-control granularity, or horizon. We introduce FromPitch2Board, a deterministic football-management benchmark that studies five configurable factors through controlled comparisons on a single simulator, using paired seeds and a frozen calibration. We evaluate four foundation models and four agent scaffolds. In the Model Track, Coach points Z-scores span 0.19, while Manager points Z-scores span 0.68, with GPT-5.6 showing a sharp rise in passivity under responsibility expansion. Its responsibility ladder rises from 46.1 to 58.1 points with recruitment, then falls to 46.8 under full management, localizing the regression to the final responsibility boundary. Across that boundary, its skipped-decision rate rises from 1.1% to 57.9%. Within the Flash-Pro pair crossed across every scaffold, scaffold choice changes Manager points Z-scores by up to 0.48 relative to the fixed stateless scaffold. The 3Y cohort shows a directional reversal in mean ranking between years one and three, while a selected Claude Code+Pro configuration peaks in year three and remains below that peak, showing that responsibility scope and horizon expose behavior changes that a single headline score conceals.

View source

Similar papers

#machine learning Preprint Sep 2026

DShuttleNet: A Badminton Doubles Dataset for Evaluating Team Coordination

Most existing sports datasets are individual-centric or ball-centric, focusing on individual player actions while ignoring interactions among teammates. In badminton doubles, tactical success is governed by rapid team formation and coordination, yet standard resources for modeling these player interactions are scarce....

Guan-Yi Jhang, Chien-Cheng Chiang, Wei-Kai Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

JockeyBench: Evaluating LLM Agents on Horse-Racing Decision-Making

Repeated event forecasting requires extracting predictive signals from noisy evidence and evaluating their value across successive decisions. We introduce JockeyBench, a benchmark and evaluation protocol that studies this problem through historical Japanese horse racing. The protocol combines time-gated evidence, price...

Zhong-Wei Xie, Xing-Su Li, Jing Yu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

WhatWorkedBench: Benchmarking Experimental Understanding in AI Agents

WhatWorkedBench links acquisition, inference, program structure, and delivery through a delivered response surface of configuration scores, which evaluates this experimental understanding through a delivered response surface of configuration scores.

Jing-Jie Ning, Xue-Qi Li, Yi-Bo Kong et al. · 1 citation
Preprint Oct 2026

Speedrunning Relational Foundation Model Pretraining

Progress on foundation model pretraining is gated by who can afford a trial, and relational pretraining is no exception. Recipes are developed inside individual labs, reported under private protocols, and do not accumulate. Speedrun leaderboards remove that barrier by decentralizing the search rather than the training...

Gabriel Wedson Mendonça de Souza Veloso, Luan Borges Teodoro Reis Sena, D. Correa et al. · 0 citations
Open access Oct 2026

Decision safety in football passing: A reproducible metric from probabilistic option sets

Football analytics measures what happened on the pitch far more often than whether it was a good choice among the alternatives available. Using StatsBomb 360 freeze-frame data for all 64 matches of the 2022 FIFA World Cup (53,406 passes with a usable freeze frame and a recorded recipient), an XGBoost model trained on...

Lucas Carrasquilla, J. A. Guerrero-Vargas, Pedro Wightman · 0 citations
#artificial intelligence Preprint Oct 2026

SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the Spire

Agentic large language models now tackle complex tasks, yet strategic reasoning over long horizons is under-studied: most agentic benchmarks are short and episodic, and performance on long tasks is hard to dissect into stored knowledge, reasoning and luck. We introduce SpireBench, in which models play the complete comm...

S. Lowe, Sander W. Keemink · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.