Artificiality: The tension between internal and external validity in economic experiments

@article{Schram2005ArtificialityTT,
  title={Artificiality: The tension between internal and external validity in economic experiments},
  author={Arthur Schram},
  journal={Journal of Economic Methodology},
  year={2005},
  volume={12},
  pages={225 - 237}
}
  • A. Schram
  • Published 1 June 2005
  • Economics
  • Journal of Economic Methodology
The artificiality of a laboratory situation is placed in the context of the tension between external and internal validity. Most economists consider internal validity to be most important. A proper evaluation of the ‘artificiality criticism’ (a lack of external validity) requires distinguishing the various goals experimentalists pursue. External validity is relatively more important for experiments searching for empirical regularities than for theory‐testing experiments. As experimental results… 

Conceptual tools for assessing experiments: some well-entrenched confusions regarding the internal/external validity distinction

The notions of internal and external validity of an experiment, coined by Donald T. Campbell in the context of social scientific quasi-experimentation more than 50 years ago, are still central in the

Conceptual tools for assessing experiments: some well-entrenched confusions regarding the internal/external validity distinction

The notions of internal and external validity of an experiment, coined by Donald T. Campbell in the context of social scientific quasi-experimentation more than 50 years ago, are still central in the

Sociality and external validity in experimental economics

It is sometimes argued that experimental economists do not have to worry about external validity so long as the design sticks closely to a theoretical model. This position mistakes the model for the

Why a Trade-Off? The Relationship between the External and Internal Validity of Experiments

Much of the methodological discussion around experiments in economics and other social sciences is framed in terms of the notions of internal and external validity. The standard view is that internal

Experiments in the social sciences: The relationship between external and internal validity

The article identifies a latent debate in the recent literature on the role and worth of experiments in economics and other social sciences concerning the relationship between the external and the

Origin and interpretation of internal and external validity in economics

Validity as a key concern in experimental methodology came to the fore in American post-World War Two psychology. Following the publication of the APA’s Technical Recommendations in 1954, validity

Promises and Perils of Experimentation: The Mutual-Internal-Validity Problem

It is highlighted how triangulation can address validity problems by helping experiments and theories make contact with ideas from other disciplines and the real world.

How validity travelled to economic experimenting

Validity was first given a more specifically scientific meaning by psychologists in the early twentieth century in the contexts of psychological tests. Following the classification of different

Theory, External Validity, and Experimental Inference: Some Conjectures

It is often argued that experiments are strong on causal identification (internal validity) but weak on generalizability (external validity). One widely accepted way to limit threats to external

Artificiality, Reactivity, and Demand Effects in Experimental Economics

A series of recent debates in experimental economics have associated demand effects with the artificiality of the experimental setting and have linked it to the problem of external validity. In this
...

References

SHOWING 1-10 OF 32 REFERENCES

Experiments in economics: should we trust the dismal scientists in white coats?

Is the rapid growth of experimental research in economics evidence of a new scientific spirit at work or merely fresh evidence of a misplaced desire to ape the methods of natural sciences? It is

Field Experiments in Economics: Some Methodological Caveats

Experimental practices in economics: A challenge for psychologists?

We discuss four key variables of experimental design that tend to be realized quite differently in economics and in areas of psychology relevant to both economists and psychologists, such as judgment

Experimental Economics: Reply

More than in any particular method of inquiry, I think the hallmark of science is to be found in a constructively skeptical attitude toward knowledge.' The more fundamental are the concepts and

On the scope of experiments in economics: comments on Siakantaris

The problem of 'parallelism' or external validity can in principle be solved; I try to show how by means of two simple examples. I also criticise attempts to dismiss experimental economics that

Method in Experiment: Rhetoric and Reality

The methodological ideal of experimentalists, E, is easily stated: derive a testable hypothesis, H, from a well-specified theory, T; implement experiments with a design; implicitly in the latter are

Introduction to Experimental Economics

This is the first comprehensive treatment of laboratory experiments designed to evaluate economic propositions under carefully controlled conditions. While it acknowledges that laboratory experiments

What Constitutes a Field Experiment in Economics ?

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context

Experimental Economics: Hard Science Or Wasteful Tinkering?

I take it that in raising the question "What have we learned from experimental economics" under the broader umbrella of "controversy" the point is not to solicit a catalogue of experimental findings,

Experimental Economics From the Vantage‐point of Behavioural Economics

As a behavioural economist (an economist who brings psychological insights to bear on economic phenomena), preparing a controversy corner piece criticising experimental economics (the use of