Artificiality: The tension between internal and external validity in economic experiments

@article{Schram2005ArtificialityTT,
  title={Artificiality: The tension between internal and external validity in economic experiments},
  author={Arthur Schram},
  journal={Journal of Economic Methodology},
  year={2005},
  volume={12},
  pages={225 - 237}
}
  • A. Schram
  • Published 1 June 2005
  • Economics
  • Journal of Economic Methodology
The artificiality of a laboratory situation is placed in the context of the tension between external and internal validity. Most economists consider internal validity to be most important. A proper evaluation of the ‘artificiality criticism’ (a lack of external validity) requires distinguishing the various goals experimentalists pursue. External validity is relatively more important for experiments searching for empirical regularities than for theory‐testing experiments. As experimental results… Expand
Conceptual tools for assessing experiments: some well-entrenched confusions regarding the internal/external validity distinction
The notions of internal and external validity of an experiment, coined by Donald T. Campbell in the context of social scientific quasi-experimentation more than 50 years ago, are still central in theExpand
Conceptual tools for assessing experiments: some well-entrenched confusions regarding the internal/external validity distinction
The notions of internal and external validity of an experiment, coined by Donald T. Campbell in the context of social scientific quasi-experimentation more than 50 years ago, are still central in theExpand
Sociality and external validity in experimental economics
It is sometimes argued that experimental economists do not have to worry about external validity so long as the design sticks closely to a theoretical model. This position mistakes the model for theExpand
Why a Trade-Off? The Relationship between the External and Internal Validity of Experiments
Much of the methodological discussion around experiments in economics and other social sciences is framed in terms of the notions of internal and external validity. The standard view is that internalExpand
Experiments in the social sciences: The relationship between external and internal validity
The article identifies a latent debate in the recent literature on the role and worth of experiments in economics and other social sciences concerning the relationship between the external and theExpand
Origin and interpretation of internal and external validity in economics
Validity as a key concern in experimental methodology came to the fore in American post-World War Two psychology. Following the publication of the APA’s Technical Recommendations in 1954, validityExpand
The External Validity of Laboratory Experiments: Qualitative Rather Than Quantitative Effects
Laboratory experiments are used to address a wide variety of questions within economics, including whether behavior is consistent with the predictions and assumptions of theory and how variousExpand
Promises and Perils of Experimentation: The Mutual-Internal-Validity Problem
TLDR
It is highlighted how triangulation can address validity problems by helping experiments and theories make contact with ideas from other disciplines and the real world. Expand
How validity travelled to economic experimenting
Validity was first given a more specifically scientific meaning by psychologists in the early twentieth century in the contexts of psychological tests. Following the classification of differentExpand
Theory, External Validity, and Experimental Inference: Some Conjectures
It is often argued that experiments are strong on causal identification (internal validity) but weak on generalizability (external validity). One widely accepted way to limit threats to externalExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 35 REFERENCES
Experiments in economics: should we trust the dismal scientists in white coats?
Is the rapid growth of experimental research in economics evidence of a new scientific spirit at work or merely fresh evidence of a misplaced desire to ape the methods of natural sciences? It isExpand
Field Experiments in Economics: Some Methodological Caveats
The results of standard lab experiments have long been questioned because of the convenience samples of subjects they typically employ and the abstract nature of the lab settings. These twoExpand
Experimental practices in economics: A challenge for psychologists?
We discuss four key variables of experimental design that tend to be realized quite differently in economics and in areas of psychology relevant to both economists and psychologists, such as judgmentExpand
Experimental Economics: Reply
More than in any particular method of inquiry, I think the hallmark of science is to be found in a constructively skeptical attitude toward knowledge.' The more fundamental are the concepts andExpand
On the scope of experiments in economics: comments on Siakantaris
The problem of 'parallelism' or external validity can in principle be solved; I try to show how by means of two simple examples. I also criticise attempts to dismiss experimental economics thatExpand
Method in Experiment: Rhetoric and Reality
The methodological ideal of experimentalists, E, is easily stated: derive a testable hypothesis, H, from a well-specified theory, T; implement experiments with a design; implicitly in the latter areExpand
Introduction to Experimental Economics
This is the first comprehensive treatment of laboratory experiments designed to evaluate economic propositions under carefully controlled conditions. While it acknowledges that laboratory experimentsExpand
What Constitutes a Field Experiment in Economics ?
Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field contextExpand
Experimental Economics: Hard Science Or Wasteful Tinkering?
I take it that in raising the question "What have we learned from experimental economics" under the broader umbrella of "controversy" the point is not to solicit a catalogue of experimental findings,Expand
Experimental Economics From the Vantage‐point of Behavioural Economics
As a behavioural economist (an economist who brings psychological insights to bear on economic phenomena), preparing a controversy corner piece criticising experimental economics (the use ofExpand
...
1
2
3
4
...