On mitigating the analytical limitations of finely stratified experiments

@article{Fogarty2017OnMT,
  title={On mitigating the analytical limitations of finely stratified experiments},
  author={Colin B. Fogarty},
  journal={Journal of the Royal Statistical Society: Series B (Statistical Methodology)},
  year={2017},
  volume={80}
}
  • Colin B. Fogarty
  • Published 20 June 2017
  • Mathematics
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology)
Although attractive from a theoretical perspective, finely stratified experiments such as paired designs suffer from certain analytical limitations that are not present in block‐randomized experiments with multiple treated and control individuals in each block. In short, when using a weighted difference in means to estimate the sample average treatment effect, the traditional variance estimator in a paired experiment is conservative unless the pairwise average treatment effects are constant… 

Regression‐assisted inference for the average treatment effect in paired experiments

Summary In paired randomized experiments, individuals in a given matched pair may differ on prognostically important covariates despite the best efforts of practitioners. We examine the use of

Testing weak nulls in matched observational studies.

We develop sensitivity analyses for the sample average treatment effect in matched observational studies while allowing unit-level treatment effects to vary. The methods may be applied to studies

Regression-adjusted average treatment effect estimates in stratified and sequentially randomized experiments

Stratified and sequentially randomized experiments are widely used in fields such as agriculture, industry, medical science, economics, and finance. Baseline covariates are often collected for each

AVERAGE TREATMENT EFFECTS IN THE PRESENCE OF UNKNOWN INTERFERENCE.

The results imply that if one erroneously assumes that units do not interfere in a setting with limited, or even moderate, interference, standard estimators are nevertheless likely to be close to an average treatment effect if the sample is sufficiently large.

Rerandomization in stratified randomized experiments

Stratification and rerandomization are two well-known methods used in randomized experiments for balancing the baseline covariates. Renowned scholars in experimental design have recommended combining

At What Level Should One Cluster Standard Errors in Paired Experiments, and in Stratified Experiments with Small Strata?

In paired experiments, the units included in the randomization, e.g. villages, are matched into pairs, and then one unit of each pair is randomly assigned to treatment. We conducted a survey of

Berry-Esseen bounds for design-based causal inference with possibly diverging treatment levels and varying group sizes

This work forms a estimator in terms of a linear permutational statistic and uses results based on Stein’s method to derive various Berry–Esseen bounds on the linear and quadratic functions of the estimator to serve as basis for design-based causal inference with possibly diverging treatment levels and diverging dimension of causal effects.

Model‐assisted analyses of cluster‐randomized experiments

  • Fangzhou SuP. Ding
  • Economics, Computer Science
    Journal of the Royal Statistical Society: Series B (Statistical Methodology)
  • 2021
The asymptotic analysis reveals the efficiency‐robustness trade‐off by comparing the properties of various estimators using data at different levels with and without covariate adjustment and highlights the critical role of covariates in improving estimation efficiency.

Insights on Variance Estimation for Blocked and Matched Pairs Designs

This article reconciles the literatures by carefully examining the performance of variance estimators under several different frameworks, and uses these insights to derive novel variance estimator for experiments containing blocks of different sizes.

Covariate-adjusted Fisher randomization tests for the average treatment effect

References

SHOWING 1-10 OF 60 REFERENCES

Regression‐assisted inference for the average treatment effect in paired experiments

Summary In paired randomized experiments, individuals in a given matched pair may differ on prognostically important covariates despite the best efforts of practitioners. We examine the use of

Lasso adjustments of treatment effect estimates in randomized experiments

Simulation and data examples show that Lasso-based adjustment can be advantageous even when the number of covariates is less than theNumber of observations, and a variant using Lasso for selection and ordinary least squares for estimation performs particularly well, and it chooses a smoothing parameter based on combined performance of Lasso and OLS.

Adjusting treatment effect estimates by post‐stratification in randomized experiments

Summary.  Experimenters often use post‐stratification to adjust estimates. Post‐stratification is akin to blocking, except that the number of treated units in each stratum is a random variable

Randomization inference for treatment effect variation

A model-free approach to testing for heterogeneity beyond a given model, which can be useful for assessing the sufficiency of a given scientific theory, is proposed and applied to the National Head Start impact study, finding that there is indeed significant unexplained treatment effect variation.

Covariate balance in simple stratified and clustered comparative studies

Fisher's randomization inference is applied to the question of balance and suggests the reversal of published conclusions about two studies, one clinical and the other a field experiment in political participation.

Variance identification and efficiency analysis in randomized experiments under the matched‐pair design

  • K. Imai
  • Mathematics
    Statistics in medicine
  • 2008
This paper extends Neyman's analysis to randomized experiments under the matched-pair design where experimental units are paired based on their pre-treatment characteristics and the randomization of treatment is subsequently conducted within each matched pair.

Nonparametric Variance Estimation Under Fine Stratification: An Alternative to Collapsed Strata

Abstract Fine stratification is commonly used to control the distribution of a sample from a finite population and to improve the precision of resulting estimators. One-per-stratum designs represent

Insights on Variance Estimation for Blocked and Matched Pairs Designs

This article reconciles the literatures by carefully examining the performance of variance estimators under several different frameworks, and uses these insights to derive novel variance estimator for experiments containing blocks of different sizes.

ADAPTIVE MATCHING IN RANDOMIZED TRIALS AND OBSERVATIONAL STUDIES.

Estimation of the average causal effect of a treatment under experimental designs in which treatment allocation potentially depends on the pre-intervention covariates of all units included in the sample is studied.

Optimal a priori balance in the design of controlled experiments

A unified theory of designs for controlled experiments that balance baseline covariates a priori using the framework of minimax variance and a new method called kernel allocation, which ensures nearly perfect covariate balance without biasing estimates under model misspecification is developed.
...