Skip to content

Conservative classifiers do consistently well with improving agents: characterizing statistical and online learning

· 0 citations · 52 references

TL;DR

An asymmetric variant of minimally consistent concept classes is introduced and used to provide an exact characterization of proper learning with improvements in the real-izable setting, and positive results for more natural Euclidean ball improvement sets are given.

View source

Similar papers

Jun 2026

Behavior Cloning is Not All You Need: The Optimality of On-Policy Distillation for Noisy Expert Feedback

A noisy expert model is proposed to explain why OPD can outperform SFT when training language models from imperfect teachers, and it is proved that online interaction with the noisy expert via a novel variant of OPD enables polynomial dependence on the horizon in general.

V. Sriraman, Peihan Liu, Daniel Hsu et al. · 0 citations
Book Open access Aug 2026

The Price of Fairness in Active Learning: Fundamental Limits and Optimal Label Acquisition

When a classifier is trained by actively choosing which examples to label, should its labeling budget depend on which notion of fairness it must satisfy? We answer this with the first information-theoretic lower bounds for group-fair active learning, and the answer is a sharp hierarchy across the three standard notions...

Chang Lu, Yizheng Zhao · 0 citations
Jul 2026

Weak-to-Strong Learning in Decision Making

A decision-aware weak-to-strong (W2S) framework that leverages both labeled and unlabeled data to improve contextual stochastic optimization and establishes a non-asymptotic upper bound on the excess decision risk of W2S and a complementary lower bound for a strong-only benchmark.

Jingwei Ji, Renyuan Xu · 0 citations
Review Aug 2026

On the Structural Limits of Machine Learning Decision Systems: An Information-Theoretic, Interaction-Based, and Stochastic-Dynamical Perspective

This work examines intrinsic limits of data-driven decision systems from an information-theoretic and interaction-based perspective and describes decision systems, including LLM-integrated agent architectures, as feedback-driven stochastic processes where state-dependent dynamics may induce emergent macroscopic behavio...

N. R. Barraza, G. Pena · 0 citations
Preprint Jul 2026

Post-Learning Inference for Combinatorial Optimizers with High-Dimensional Sparse Contextual Information via Minimal Directional Perturbation

A novel perturbation test based on a nonsmooth max-difference revenue statistic comparing the best null assortment with the best alternative assortment and asymptotic validity of the proposed p-value under adaptive assortment selection is proposed.

Pengyu Li, Shuting Shen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.