Randomization or design-based inference is becoming an increasingly popular tool for analysing data from randomized experiments: It does not require modelling assumptions on the distribution of outcomes or covariates, and hypothesis testing and estimation are respectively valid and unbiased in finite samples. Yet, confidence intervals for the sample average treatment effect (SATE) are still constructed via finite-population central limit theorems and their coverage is only asymptotic. In this work, we explore an alternative approach: We use concentration inequalities to construct confidence intervals for the SATE with non-asymptotic guarantees. We develop this approach for the most common experimental designs (Bernoulli trials and completely randomized experiments) and provide Hoeffding and Bernstein-type confidence intervals. Moreover, we extend these results to matched-pair, cluster and stratified randomized experiments. Our key technical contributions are a novel Bernstein-type concentration inequality for i.i.d. data points as well as a concentration result for Neyman's variance estimator.
Marginal Mann-Whitney effects are widely used across various fields of research, and extensions of this estimand have been developed in many directions in statistical methodology. In this paper, we focus on an extensions for repeated measurements and factorial designs subject to randomly missing data. In a previous wor...
Dennis Dobler, Jörg-Tobias Kuhn, L. Amro et al.· 0 citations
We study how fast experimental designs can approach the semiparametric efficiency bound in finite samples, as measured by the excess variance of unadjusted treatment effect estimation. We prove an impossibility theorem: under weak conditions, no design can approach the variance bound uniformly over smooth outcome model...
A new inference method for conducting multiple-treatment comparisons involving endpoints within the generalized linear model (GLM) framework under covariate-adaptive randomization (CAR) that can effectively control Type I error while potentially improving power.
Randomized controlled trials provide internally valid estimates of treatment effects, but their results may not directly apply to broader target populations due to differences in baseline covariate distributions, adherence to treatment or variations in outcome mechanisms. Under standard transport and time-to-event iden...
Axel Martin, Iván Díaz, Michele Santacatterina· 0 citations
This paper proposes asymptotically distribution-free inference methods for comparing estimators which admit asymptotically linear Gaussian functional representations across dependent samples. The framework applies to a broad range of welfare indices used in inequality, poverty, and risk analysis. Two distinct situation...
We give an exact randomization-based confidence set for the average treatment effect (ATE) in matched-pair studies with a binary outcome, requiring neither monotonicity nor any distributional assumption beyond the within-pair coin flip. At its core is an analytic solution to the worst-case allocation of attributable ef...
B. Wilson· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.