QIQCBench is introduced, a benchmark of $49$ expert-authored tasks spanning multiple layers including calibration and control, error correction and compilation, sensing and networking, that reveals wide variation in verified performance across frontier agentic systems.
Abstract
Reliable quantum engineering is essential for turning quantum phenomena into practical technologies. As quantum platforms grow in scale and complexity, their characterization and operation require increasing human effort and coordination. Scientific artificial intelligence agents, which can plan experiments, operate instruments, and analyze observations, offer a promising route towards autonomous quantum engineering. Yet whether current agents can perform reliably in this setting has not been systematically established. To fill this gap, we developed Quantum-Harbor, a virtual laboratory that provides a controlled execution environment for agents to interact with quantum systems. This design enables direct verification of both the actions taken and the conclusions drawn. Building on this framework, we introduce QIQCBench, a benchmark of $49$ expert-authored tasks spanning multiple layers including calibration and control, error correction and compilation, sensing and networking. Across $17$ frontier agentic systems, QIQCBench reveals wide variation in verified performance. These results expose a substantial gap between demonstrating capability and achieving reliable operation, and establish Quantum-Harbor as a foundation for measuring progress towards verified autonomy in quantum engineering.
This work demonstrates direct, cross-platform measurement of quantum computational capability using a new benchmark that quantifies the size of the largest computationally relevant quantum circuits that a machine can execute successfully and the speed at which it can execute them, and project the growth of capability a...
Timothy Proctor, Oliver Hart, Oliver Widzowski Maupin et al.· 1 citation
This work presents a general workflow-oriented framework for QMC and provides evidence that rule-centered architectures are a promising design choice for scalable quantum-system calibration, achieving quantitatively acceptable levels in terms of resource cost, LLM calling times and decision latency.
Zhi-Qiang Fan, Hao-Ran He, Ping Lv et al.· 0 citations
This work considers settings with programmable quantum control in which predictors can be embedded as subroutines within the experiments they analyze, and uses Kleene’s recursion theorem to transform any deterministic bounded-time predictor into a reversible protocol encoding its own specification.
Salman Sajad Wani, Álvaro Perales-Eceiza, Saif Al-Kuwari et al.· Quantum Science and Technolo...· 0 citations
This review examines how error mitigation techniques can be adapted to encoded and logical-qubit settings so that they can operate alongside quantum error correction to suppress residual logical errors and improve the accuracy of computation in the early fault-tolerant regime.
Han-Ze Li, Mengjie Yang, Xian-Quan Yan et al.· 3 citations
It is argued that utility-scale quantum architecture is primarily a cost-performance problem across a coupled quantum-classical system, leading to a blueprint for scalable quantum processing unit (QPU) design, which closely resembles the architecture of high-performance network stacks.
PaQit is introduced, a fidelity-aware qubit packing framework that integrates device-level Rydberg interaction physics with system-level scheduling to jointly optimize energy, runtime, and fidelity in neutral-atom systems.
Known for his clear and elegant writing style, Bertsekas shaped fields from control and optimization to large-scale computation and artificial intelligence.
A secure operating system, a quantum microsystem platform, and a 5G interference-canceling algorithm are named among the year's most significant innovations.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.