Skip to content

Governance Records as Supervision: Verifier-Selected Self-Training for Structured Workflow Repair

Aug 2026 · 1 citation · 27 references
Computer Science

TL;DR

The results support verifier-selected supervision for bounded, machine-checkable capabilities, not arbitrary planning, enterprise validity, or unrestricted self-improvement.

Abstract

Machine-verifiable workflows produce governance records linking a task contract, model attempt, verifier decision, accepted output, and target origin. We test whether verifier-admitted outputs can supervise a bounded model by consolidating occasional or expensive capability into reliable one-shot execution. On fresh, structure-disjoint PlanBench replanning cases, Qwen3-14B thinking produced 24 plans admitted by independently authored VAL. They trained the same checkpoint for non-thinking execution, without oracle targets or a stronger teacher. VAL acceptance rose from 1/80 to 57/80. A prospective replication held targets, model revision, recipe, and evaluation corpus fixed across eight LoRA seeds and three inference realizations per seed. Every seed produced a clear lift: adapters reached 45/80 to 70/80 against 1/80 for every matched base report; the exact seed-level sign-flip test gave p=0.0078125. Target-selection performance was less stable. An initial matched seed gave 102/160 accepted plans after VAL selection versus 69/160 after blinded model self-selection. Across eight prospective seeds, the contrast was seed-dependent, included one clear reverse seed, and did not replicate (p=0.3672). VAL also had a positive descriptive aggregate over schema-only selection but failed its preregistered seed-level reliability gate (p=0.0703). The verifier remains the admission authority; no reliable downstream capability advantage of semantic selection is established. A complementary Phi arm supports stronger-teacher distillation. Earlier synthetic studies bound teachability, cumulative learning, transfer, and stopping. The evidence supports robust consolidation of one fixed, machine-checkable capability, not arbitrary planning, enterprise validity, or unrestricted self-improvement.

View source

Similar papers

Preprint Aug 2026

Auditable AI-Assisted Research Writing: An Engineering Discipline with Pre-Registered Process Observation

An auditability discipline built at production time is specified: git sealing with an anchor lineage, hash-bound provenance, red-line gates that refuse non-compliant artifacts and log every refusal, cross-model role separation, and programmatic assembly from registered sources.

Yangshuo Zhou, Cheng-Qun Yu · 0 citations
Open access Jul 2026

Automating Multilingual Patent Intelligence Monitoring with a Low-Code Hybrid Workflow: An Engineering Case Study

An engineering case study of a production low-code workflow on the n8n platform that integrates twelve RSS feeds from five patent offices that identifies five design lessons: P1 (Hybrid Intelligence Architecture), P2 (Format Normalization at Boundaries), P3 (Separation of Content and Presentation), P4 (Graceful Degrada...

H. Wang, Hao-Ren Ke · 0 citations
Review Aug 2026

Vibe Coding: Practice, Performance, Productivity, and Risk -A State-of-the-Art Review

This state-of-the-art review assembles that evidence across a cross-disciplinary corpus spanning software engineering, human-computer interaction, labour economics, security research, governance, and education, finding the early benchmarks saturated but task-level capability uneven.

D. Michels, Mutaz Abu Ghazaleh, F. Lazzari et al. · 0 citations
Review Open access 2026

Workflow Signal Protocol: A Measurement Method for Deployment-Time Workflow Observability in Legal AI

The Workflow Signal Protocol (WSP) is introduced, a deployment-layer measurement method for recording workflow observability as a structured workflow-observability record that supports the central claim that deployment-time workflow observability is measurable within the evaluated legal-AI settings.

Liu Ben · 0 citations
Preprint Jul 2026

From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agents

A reusable engineering pattern for turning exploratory prototypes into auditable applications with versioned source, control, and validation artifacts is presented, which reconstructs this pattern into a traceable, auditable LLM-agent architecture.

Joongho Ahn, Moonsoo Kim · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.