Skip to content
Preprint

Randomization Inference with Concentration Inequalities

Sep 2026 · 0 citations · 73 references
Mathematics

Abstract

Randomization or design-based inference is becoming an increasingly popular tool for analysing data from randomized experiments: It does not require modelling assumptions on the distribution of outcomes or covariates, and hypothesis testing and estimation are respectively valid and unbiased in finite samples. Yet, confidence intervals for the sample average treatment effect (SATE) are still constructed via finite-population central limit theorems and their coverage is only asymptotic. In this work, we explore an alternative approach: We use concentration inequalities to construct confidence intervals for the SATE with non-asymptotic guarantees. We develop this approach for the most common experimental designs (Bernoulli trials and completely randomized experiments) and provide Hoeffding and Bernstein-type confidence intervals. Moreover, we extend these results to matched-pair, cluster and stratified randomized experiments. Our key technical contributions are a novel Bernstein-type concentration inequality for i.i.d. data points as well as a concentration result for Neyman's variance estimator.

View source

Similar papers

Preprint Sep 2026

Quasi-randomization-based inference for multivariate Mann-Whitney effects under random missingness

Marginal Mann-Whitney effects are widely used across various fields of research, and extensions of this estimand have been developed in many directions in statistical methodology. In this paper, we focus on an extensions for repeated measurements and factorial designs subject to randomly missing data. In a previous wor...

Dennis Dobler, Jörg-Tobias Kuhn, L. Amro et al. · 0 citations
Preprint Aug 2026

The Limits of Experimental Design: Covariate Balance Beyond Low Dimension

We study how fast experimental designs can approach the semiparametric efficiency bound in finite samples, as measured by the excess variance of unadjusted treatment effect estimation. We prove an impossibility theorem: under weak conditions, no design can approach the variance bound uniformly over smooth outcome model...

Max Cytrynbaum · 0 citations
Open access Aug 2026

Valid Test for Multi-arm Trials with Generalized Linear Models Under Covariate-adaptive Randomization

A new inference method for conducting multiple-treatment comparisons involving endpoints within the generalized linear model (GLM) framework under covariate-adaptive randomization (CAR) that can effectively control Type I error while potentially improving power.

Guannan Zhai, Fei-Fang Hu · 0 citations
Preprint Sep 2026

Efficient transport and generalization of survival treatment effects

Randomized controlled trials provide internally valid estimates of treatment effects, but their results may not directly apply to broader target populations due to differences in baseline covariate distributions, adherence to treatment or variations in outcome mechanisms. Under standard transport and time-to-event iden...

Axel Martin, Iván Díaz, Michele Santacatterina · 0 citations
Case report Open access Aug 2026

Nonparametric methods for comparing distribution functionals for dependent samples with applications to welfare indices

This paper proposes asymptotically distribution-free inference methods for comparing estimators which admit asymptotically linear Gaussian functional representations across dependent samples. The framework applies to a broad range of welfare indices used in inequality, poverty, and risk analysis. Two distinct situation...

Jean-Marie Dufour, Tianyu He · 0 citations
Preprint Sep 2026

Randomization Inference for Matched Pairs with Binary Outcomes

We give an exact randomization-based confidence set for the average treatment effect (ATE) in matched-pair studies with a binary outcome, requiring neither monotonicity nor any distributional assumption beyond the within-pair coin flip. At its core is an analytic solution to the worst-case allocation of attributable ef...

B. Wilson · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.