Three Options Are Optimal for Multiple‐Choice Items: A Meta‐Analysis of 80 Years of Research

@article{Rodriguez2005ThreeOA,
  title={Three Options Are Optimal for Multiple‐Choice Items: A Meta‐Analysis of 80 Years of Research},
  author={Michael C. Rodriguez},
  journal={Educational Measurement: Issues and Practice},
  year={2005},
  volume={24},
  pages={3-13}
}
Multiple-choice items are a mainstay of achievement testing. The need to adequately cover the content domain to certify achievement proficiency by producing meaningful precise scores requires many high-quality items. More 3-option items can be administered than 4- or 5-option items per testing time while improving content coverage, without detrimental effects on psychometric quality of test scores. Researchers have endorsed 3-option items for over 80 years with empirical evidence—the results of… 
View via Publisher
highpoint.edu
310 Citations
Highly Influential Citations
37
Background Citations
138
Methods Citations
49
Results Citations
16

310 Citations

Are Multiple-choice Items Too Fat?

ABSTRACT The evidence is mounting regarding the guidance to employ more three-option multiple-choice items. From theoretical analyses, empirical results, and practical considerations, such items are…

A, B, or C? A Quasi-experimental Multi-site Study Investigating Three Option Multiple Choice Questions

TLDR
Data analysis revealed that there were no statistically significant differences in the item discrimination, difficulty or mean examination scores when MCQs were administered with three versus four option answer choices.

The Three‐Option Format for Knowledge and Ability Multiple‐Choice Tests: A Case for Why it Should Be More Commonly Used in Personnel Testing

Multiple‐choice (MC) tests are arguably the most widely used testing format in applied settings. In the psychometric and education literatures, research on the optimal number of options for knowledge…

The optimal number of options for multiple-choice questions on high-stakes tests: application of a revised index for detecting nonfunctional distractors

TLDR
The primary purpose of the present study was to evaluate an index of nonfunctional that is sensitive to item difficulty, and results were consistent with previous research indicating that most MCQs had one or two functional distractors.

A comparison of the psychometric properties of three- and four-option multiple-choice questions in nursing assessments.

Empirical Option Weights for Multiple-Choice Items : Interactions with Item Properties and Testing Design

In scoring of a multiple-choice test, the number of correct answers does not use all information available from item responses. Scoring such tests by applying empirically determined weights to the…

The Advantages of Five-Option Multiple-Choice Items in Classroom Tests of Student Mastery

The effectiveness of multiple-choice (MC) items depends on the quality of the response options—particularly how well the incorrect options (“distractors”) attract students who have incomplete…

The Use of Three-Option Multiple Choice Items for Classroom Assessment

Although multiple-choice items (MCIs) are widely used for classroom assessment, designing MCIs with sufficient number of plausible distracters is very challenging for teachers. In this regard,…

A Comparison between Three-and Four-Option Multiple Choice Questions

EFFECTIVENESS OF OPTIONS IN MULTIPLE-CHOICE ITEMS: THE CASE OF “NONE OF THE ABOVE”

The present study examined the effectiveness of ‘none of the above’ (NOTA) as a test alternative in multiplechoice items.It intended to estimate item fit, item difficulty, itemdiscrimination, guess…
...

References

SHOWING 1-10 OF 75 REFERENCES

Estimating the Optimum Number of Options Per Item Using an Incremental Option Paradigm

Previous studies have demonstrated the efficacy of using three-option multiple-choice items. In these studies three- and four-option items were constructed from preexisting item analysis data…

How Many Options is Enough for a Multiple-Choice Test Item?

Textbook writers often recommend four or five options per multiple-choice item, and most, if not all, testing programs in the United States also employ four or five options. Recent reviews of…

Use of an Inclusive Option and the Optimal Number of Options for Multiple-Choice Items

This study examined the validity of two item-writing rules in the design of test items: (a) the desirable number of options for a multiple-choice test item and (b) use of the inclusive none of these…

THREE‐ALTERNATIVE MULTIPLE CHOICE TESTS: AN ATTRACTIVE OPTION

Traditionally, multiple choice tests have included four or five alternatives. Data from public sector employment tests are presented that indicate that tests composed of multiple choice items…

An Empirical Comparison of Three-and Four-Choice Items and Tests: Susceptibility to Testwiseness and Internal Consistency Reliability

Theoretical and test simulation work reveals that under the knowledge-or-randomguessing assumption, three-option item tests are at least as good as four-option item tests in terms of item…

The Optimal Number of Alternatives in Multiple-Choice Achievement Tests: Some Empirical Evidence for a Mathematical Proof

TVERSKY (1964) has presented mathematical proof that given a fixed number of alternatives on a multiple-choice type test, the use of three alternatives at each choice point will maximize the…

A Comparison of Two, Three and Four-Choice Item Tests Given a Fixed Total Number of Choices

While measurement textbooks typically recommend the use of four or five alternatives with multiple-choice test items theoretical work by Tversky (1964) and some empirical studies indicate that…

More Evidence in Favor of Three-Option Multiple-Choice Tests

Students from two consecutive semesters were given multiple-choice tests over five units of an undergraduate course in psychology. During the first semester, students were given five 50-question…

Three-Choice Versus Four-Choice Items: Implications for Reliability and Validity Of Objective Achievement Tests1

IN measuring psychology students’ knowledge of empirical generalizations, Costin (1970) found that mean discrimination indices and estimates of homogeneity mere slightly higher for t.hreechoice items…

Functional Distractors: Implications for Test-Item Writing and Test Design.

The proposition that the optimal number of options in a multiple choice test item is three was examined. The concept of functional distractor, a plausible wrong answer that is negatively…
...