# On mitigating the analytical limitations of finely stratified experiments

@article{Fogarty2017OnMT, title={On mitigating the analytical limitations of finely stratified experiments}, author={Colin B. Fogarty}, journal={Journal of the Royal Statistical Society: Series B (Statistical Methodology)}, year={2017}, volume={80} }

Although attractive from a theoretical perspective, finely stratified experiments such as paired designs suffer from certain analytical limitations that are not present in block‐randomized experiments with multiple treated and control individuals in each block. In short, when using a weighted difference in means to estimate the sample average treatment effect, the traditional variance estimator in a paired experiment is conservative unless the pairwise average treatment effects are constant…

## 28 Citations

### Regression‐assisted inference for the average treatment effect in paired experiments

- Mathematics, EconomicsBiometrika
- 2018

Summary In paired randomized experiments, individuals in a given matched pair may differ on prognostically important covariates despite the best efforts of practitioners. We examine the use of…

### Testing weak nulls in matched observational studies.

- Economics, MathematicsBiometrics
- 2022

We develop sensitivity analyses for the sample average treatment effect in matched observational studies while allowing unit-level treatment effects to vary. The methods may be applied to studies…

### Regression-adjusted average treatment effect estimates in stratified and sequentially randomized experiments

- Mathematics, Economics
- 2019

Stratified and sequentially randomized experiments are widely used in fields such as agriculture, industry, medical science, economics, and finance. Baseline covariates are often collected for each…

### AVERAGE TREATMENT EFFECTS IN THE PRESENCE OF UNKNOWN INTERFERENCE.

- Economics, MathematicsAnnals of statistics
- 2021

The results imply that if one erroneously assumes that units do not interfere in a setting with limited, or even moderate, interference, standard estimators are nevertheless likely to be close to an average treatment effect if the sample is sufficiently large.

### Rerandomization in stratified randomized experiments

- MathematicsJournal of the American Statistical Association
- 2021

Stratification and rerandomization are two well-known methods used in randomized experiments for balancing the baseline covariates. Renowned scholars in experimental design have recommended combining…

### At What Level Should One Cluster Standard Errors in Paired Experiments, and in Stratified Experiments with Small Strata?

- Mathematics, EconomicsSSRN Electronic Journal
- 2020

In paired experiments, the units included in the randomization, e.g. villages, are matched into pairs, and then one unit of each pair is randomly assigned to treatment. We conducted a survey of…

### Berry-Esseen bounds for design-based causal inference with possibly diverging treatment levels and varying group sizes

- Computer Science
- 2022

This work forms a estimator in terms of a linear permutational statistic and uses results based on Stein’s method to derive various Berry–Esseen bounds on the linear and quadratic functions of the estimator to serve as basis for design-based causal inference with possibly diverging treatment levels and diverging dimension of causal effects.

### Model‐assisted analyses of cluster‐randomized experiments

- Economics, Computer ScienceJournal of the Royal Statistical Society: Series B (Statistical Methodology)
- 2021

The asymptotic analysis reveals the efficiency‐robustness trade‐off by comparing the properties of various estimators using data at different levels with and without covariate adjustment and highlights the critical role of covariates in improving estimation efficiency.

### Insights on Variance Estimation for Blocked and Matched Pairs Designs

- Mathematics
- 2017

This article reconciles the literatures by carefully examining the performance of variance estimators under several different frameworks, and uses these insights to derive novel variance estimator for experiments containing blocks of different sizes.

### Covariate-adjusted Fisher randomization tests for the average treatment effect

- MathematicsJournal of Econometrics
- 2021

## References

SHOWING 1-10 OF 60 REFERENCES

### Regression‐assisted inference for the average treatment effect in paired experiments

- Mathematics, EconomicsBiometrika
- 2018

Summary In paired randomized experiments, individuals in a given matched pair may differ on prognostically important covariates despite the best efforts of practitioners. We examine the use of…

### Lasso adjustments of treatment effect estimates in randomized experiments

- Mathematics, EconomicsProceedings of the National Academy of Sciences
- 2016

Simulation and data examples show that Lasso-based adjustment can be advantageous even when the number of covariates is less than theNumber of observations, and a variant using Lasso for selection and ordinary least squares for estimation performs particularly well, and it chooses a smoothing parameter based on combined performance of Lasso and OLS.

### Adjusting treatment effect estimates by post‐stratification in randomized experiments

- Mathematics
- 2013

Summary. Experimenters often use post‐stratification to adjust estimates. Post‐stratification is akin to blocking, except that the number of treated units in each stratum is a random variable…

### Randomization inference for treatment effect variation

- Mathematics
- 2014

A model-free approach to testing for heterogeneity beyond a given model, which can be useful for assessing the sufficiency of a given scientific theory, is proposed and applied to the National Head Start impact study, finding that there is indeed significant unexplained treatment effect variation.

### Covariate balance in simple stratified and clustered comparative studies

- Economics
- 2008

Fisher's randomization inference is applied to the question of balance and suggests the reversal of published conclusions about two studies, one clinical and the other a field experiment in political participation.

### Variance identification and efficiency analysis in randomized experiments under the matched‐pair design

- MathematicsStatistics in medicine
- 2008

This paper extends Neyman's analysis to randomized experiments under the matched-pair design where experimental units are paired based on their pre-treatment characteristics and the randomization of treatment is subsequently conducted within each matched pair.

### Nonparametric Variance Estimation Under Fine Stratification: An Alternative to Collapsed Strata

- Mathematics
- 2016

Abstract Fine stratification is commonly used to control the distribution of a sample from a finite population and to improve the precision of resulting estimators. One-per-stratum designs represent…

### Insights on Variance Estimation for Blocked and Matched Pairs Designs

- Mathematics
- 2017

This article reconciles the literatures by carefully examining the performance of variance estimators under several different frameworks, and uses these insights to derive novel variance estimator for experiments containing blocks of different sizes.

### ADAPTIVE MATCHING IN RANDOMIZED TRIALS AND OBSERVATIONAL STUDIES.

- MathematicsJournal of statistical research
- 2012

Estimation of the average causal effect of a treatment under experimental designs in which treatment allocation potentially depends on the pre-intervention covariates of all units included in the sample is studied.

### Optimal a priori balance in the design of controlled experiments

- Computer Science, Mathematics
- 2013

A unified theory of designs for controlled experiments that balance baseline covariates a priori using the framework of minimax variance and a new method called kernel allocation, which ensures nearly perfect covariate balance without biasing estimates under model misspecification is developed.