Skip to content
Preprint

When Is Inaction a Mistake? Continuation-Aware Auditing of PPO Trading Policies

Sep 2026 · 0 citations · 23 references
Computer Science

TL;DR

A four-stage audit for frozen proximal policy optimization policies without retraining examines deployment occupancy, matches current information, tests isolated deviations under incumbent continuation, and evaluates repeated deployment of observation-based alternatives.

Abstract

An optimal reference may recommend trading when a learned policy chooses inaction, but the recommendation depends on information and future decisions. We introduce a four-stage audit for frozen proximal policy optimization policies without retraining. It examines deployment occupancy, matches current information, tests isolated deviations under incumbent continuation, and evaluates repeated deployment of observation-based alternatives. In controlled linear-Gaussian simulations, information matching explains part of the disagreement, while continuation changes its interpretation. At unit observation noise, incumbent continuation reverses 99.3% of projected-hard missed-advantage mass; repeated projected-rule deployment improves all 50 policies. These comparisons distinguish isolated action changes from policy replacement. Historical Bitcoin/Tether (BTCUSDT) replay applies this deployment perspective to a hand-specified intervention selected using 2024 data and frozen for 2025. Daily net reward improves by 135.03 basis points, with gains in 46 of 50 policies, primarily through lower turnover costs. The audit clarifies what oracle-flagged inaction implies for deployed decision making.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

When Validation Stops Learning: Auditing Update Admission for Continual Embodied Agents

This work argues that update admission must be assessed through both error control and retained learning opportunities at a stated interaction budget, and identifies a concrete failure: a range-based confidence gate cannot certify unchanged old-task behavior within otherwise substantial budgets.

Qin-Zhen Ma, Rui-Hai Wu · 0 citations
Preprint Aug 2026

Revelation Control

Revelation Control is the problem of choosing priced interventions that reveal hidden state only insofar as the revealed distinctions can change a consequential decision, while accounting separately for any useful progress created by the intervention itself. We develop this theory for learning systems, where states equ...

Qin-You Wang · 1 citation
Open access Sep 2026

CFR variant and iterate reporting in small imperfect-information games

Empirical comparisons of counterfactual regret minimization (CFR) variants often mix two distinct choices: the update rule used during training and the iterate reported at evaluation time. This note isolates those choices in an exact small-game setting where exploitability is computed by exact best response, so no me...

Behbod Keshavarzi, H. Navidi · 0 citations
#artificial intelligence Preprint Sep 2026

The Delegation Blind Spot: Auditing Product Decisions from Agent Choices

A decision-specific audit that maps a declared observation channel and product-value contrast to compatible intervals and witness populations to help preserve decision-relevant structured input and diagnosing why a decision is unresolved before collecting more telemetry is presented.

Shivam Gupta · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.