Assessment of Family Doctors in Oman: getting the questions rightPreliminary findings of a performance analysis of multiple choice questions

@inproceedings{Theodorsson2009AssessmentOF,
  title={Assessment of Family Doctors in Oman: getting the questions rightPreliminary findings of a performance analysis of multiple choice questions},
  author={Thord Theodorsson and Kawther El Shafie and Nadia Al Wardy and Anwar Ali Khan and Abdulaziz Al Mahrezi and Mohammed Ali Al Shafaee},
  year={2009}
}
Background Properly constructed multiple-choice questions (MCQs) in high stakes examinations are expected to have high validity and reliability scores. However, several reports show that teacher-generated high stakes examinations do not always achieve the required high level of quality if item constructors are not trained in item writing, or if they are not proficient in the principles of assessment. AimThis evaluation aimed to assess the validity, reliability and quality of a 150 item multiple… 
1 Citations

Tables from this paper

Empirical Analysis of Item Difficulty and Discrimination Indices of Senior School Certificate Multiple Choice Biology Tests
This study empirically analyzed the item difficulty and discrimination indices of senior school certificate examination SSCE multiple choice biology tests used by West African Examinations Council

References

SHOWING 1-10 OF 13 REFERENCES
Quality assurance of item writing: During the introduction of multiple choice questions in medicine for high stakes examinations
TLDR
Five item quality criteria are recommended: adherence to an in-house style, item proportion testing at K2 level, functioning distracter proportion, overall discrimination ratio, frequency of item writing flaws, and (5) IWF frequency.
The Quality of In‐house Medical School Examinations
TLDR
The quality of examination questions can be significantly improved by providing question writers with formal training, as measured by mean quality scores for National Board of Medical Examiners (NBME) who were trained question writers and for question writers without NBME training.
An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis
TLDR
The low frequency of items with three functioning distractors in the four-option items in this study suggests that teachers have difficulty developing plausible distractors for most MCQs.
Multiple choice questions: a literature review on the optimal number of options.
TLDR
It is suggested that MCQs with 3 options should be preferred, because fewer distractors needed to be prepared, took up less space and required less reading time, decreased the time required to develop the items and the time to administer, and more items could be administered in a given time thus increasing the content sampled.
Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37
TLDR
This guide examines the more commonly used methods of standard setting, illustrates the procedure used in each with the help of an example, and discusses the advantages and disadvantages associated with the use of each.
Improving the fairness of multiple-choice questions: a literature review
TLDR
There is a wealth of evidence that extended matching questions are the fairest format but MCQs should always be combined with practical assessments, as written testing emphasizes learning from written sources.
The assessment of clinical skills/competence/performance
  • G. Miller
  • Psychology, Economics
    Academic medicine : journal of the Association of American Medical Colleges
  • 1990
No abstract available.
MRCGP[INT], the Omani Experience
  • RCGP International Newsletter;
  • 2006
DB: Constructing Written Test Questions for the Basic and Clinical Sciences, National Board of Medical Examiners 3rd ed
  • 2002
...
1
2
...