Beyond Baseline and Follow-Up: The Case for More T in Experiments

@article{McKenzie2011BeyondBA,
  title={Beyond Baseline and Follow-Up: The Case for More T in Experiments},
  author={David J. McKenzie},
  journal={Philosophy \& Methodology of Economics eJournal},
  year={2011}
}
  • David J. McKenzie
  • Published 1 April 2011
  • Economics
  • Philosophy & Methodology of Economics eJournal
Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
TLDR
This paper formalizes this allocation problem and shows that although the optimal share of interviews allocated to the baseline survey is always less than one-half, it is an increasing function of the total number of interviews per cluster, the cluster-level correlation between the baseline measure and the endline outcome, and the intracluster correlation coefficient.
Using Randomized Controlled Trials to Estimate Long-Run Impacts in Development Economics
We assess evidence from randomized controlled trials (RCTs) on long-run economic productivity and living standards in poor countries. We first document that several studies estimate large positive
The Design of Field Experiments With Survey Outcomes: A Framework for Selecting More Efficient, Robust, and Ethical Designs
TLDR
This study estimated a precise zero, suggesting the design can successfully evade demand effects, and details an alternative field experiment design exploiting multiple waves of panel surveys delivered online with multiple measures of outcomes and, if applicable, a placebo control.
Using Rcts to Estimate Long-Run Impacts in Development Economics
We assess evidence from randomized control trials (RCTs) on long-run economic productivity and living standards in poor countries. We first document that several studies estimate large positive
Estimating Treatment Effects with Big Data When Take-up is Low: An Application to Financial Education
Low take-up of interventions is a common problem faced by evaluations of development programs. A leading case is financial education programs, which are increasingly offered by governments,
What do we know about the impact of microfinance? The problems of power and precision
Six randomized control trials were published simultaneously in one issue of the 'American Economic Journal: Applied Economics' in 2015. The studies show no or minimal impact from providing microloans
Balancing Rigor, Replication, and Relevance: A Case for Multiple-Cohort, Longitudinal Experiments
Over the past 15 years, the education research community has advocated for rigorous research designs that support causal inferences, for research that provides more generalizable results across
When Is Parallel Trends Sensitive to Functional Form
This paper assesses when the validity of difference-in-differences and related estimators is dependent on functional form. We provide a novel characterization: the parallel trends assumption holds
...
...

References

SHOWING 1-10 OF 45 REFERENCES
In Pursuit of Balance: Randomization in Practice in Development Field Experiments
Randomized experiments are increasingly used in development economics, with researchers now facing the question of not just whether to randomize, but how to do so. Pure random assignment guarantees
How many repeated measures in repeated measures designs? Statistical issues for comparative trials
  • A. Vickers
  • Psychology, Medicine
    BMC medical research methodology
  • 2003
TLDR
The proposed method offers a rational basis for determining the number of repeat measures in repeat measures designs and is effective in randomized and non-randomized comparative trials.
Being surveyed can change later behavior and related parameter estimates
TLDR
The results suggest that limited attention could play an important but context-dependent role in consumer choice, with the implication that researchers should reconsider whether, how, and how much to survey their subjects.
Microcredit in Theory and Practice: Using Randomized Credit Scoring for Impact Evaluation
TLDR
It is found that microloans increase ability to cope with risk, strengthen community ties, and increase access to informal credit through channels different from those often hypothesized by its proponents.
Repeated measures in clinical trials: analysis using mean summary statistics and its implications for design.
TLDR
The use of simple summary statistics for analysing repeated measurements in randomized clinical trials with two treatments supports the value of the compound symmetry assumption as a realistic simplification in quantitative planning of repeated measures trials.
Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
In this paper we set out some methods that utilize the longitudinal structure of earnings of trainees and a comparison group to estimate the effectiveness of training for the 1976 cohort of CETA
Measuring microenterprise profits: Must we ask how the sausage is made?
A large share of the World's poor is self-employed. Accurate measurement of profits from microenterprises is therefore critical for studying poverty and inequality, measuring the returns to
Expanding Microenterprise Credit Access: Using Randomized Supply Decisions to Estimate the Impacts in Manila
Microcredit seeks to promote business growth and improve well-being by expanding access to credit. We use a field experiment and follow-up survey to measure impacts of a credit expansion for
Returns to Capital in Microenterprises: Evidence from a Field Experiment
Small and informal firms account for a large share of employment in developing countries. The rapid expansion of microfinance services is based on the belief that these firms have productive
...
...