A counterintuitive hypothesis about employment interview validity and some supporting evidence.

@article{Schmidt2004ACH,
  title={A counterintuitive hypothesis about employment interview validity and some supporting evidence.},
  author={Frank L. Schmidt and Ryan D. Zimmerman},
  journal={The Journal of applied psychology},
  year={2004},
  volume={89 3},
  pages={
          553-61
        }
}
This study found mixed support for the hypothesis that the difference in criterion-related validity between unstructured and structured employment interviews is due solely to the greater reliability of structured interviews. Using data from prior meta-analyses, this hypothesis was tested in 4 data sets by using standard psychometric procedures to remove the effects of measurement error in interview scores from correlations with rated job performance and training performance. In the 1st data set… 

Tables from this paper

Employment Interview Reliability: New Meta‐Analytic Estimates by Structure and Format
This study sought to provide an update on evidence regarding the interrater reliability of employment interviews. Using a final dataset of 125 coefficients with a total sample size of 32,428, our
A meta‐analysis of interview length on reliability and validity
First impressions are frequently seen as a biasing factor that may prevent an interviewer from forming a comprehensive assessment of the applicant. However, research has found that people can make
Getting on the same page: The effect of normative feedback interventions on structured interview ratings.
TLDR
Giving normative feedback to interviewers will aid in minimizing interviewer rating differences and enhance the reliability of structured interview ratings, and interviewer feedback might be considered as a potential new component of interview structure.
The effect of the interview structure on the physical attractiveness bias
This study investigated interview structure as a moderator of the relationship between the physical attractiveness of job candidates and two interview outcomes (suitability ratings and hiring
The Structured Employment Interview: Narrative and Quantitative Review of the Research Literature
In the 20 years since frameworks of employment interview structure have been developed, a considerable body of empirical research has accumulated. We summarize and critically examine this literature
A Meta-Analysis of Interviews and Cognitive Ability
The topic of what interviews measure has received a great deal of attention over the years. One line of research has investigated the relationship between interviews and the construct of cognitive
A meta-analysis of the relationship between individual assessments and job performance.
TLDR
Validity was not moderated by the degree of standardization of the assessment content or by use of multiple assessors for each candidate, but higher validities were found when the same assessor was used across all candidates than when different assessors evaluated different candidates.
The validity of ipsative and quasi‐ipsative forced‐choice personality inventories for different occupational groups: A comprehensive meta‐analysis
A comprehensive meta-analysis of two types of forced-choice (FC) personality inventories (ipsative and quasi-ipsative) across nine occupational groups (Clerical, Customer Service, Health Care,
...
...

References

SHOWING 1-10 OF 49 REFERENCES
EXPLORING THE BOUNDARY CONDITIONS FOR INTERVIEW VALIDITY: META‐ANALYTIC VALIDITY FINDINGS FOR A NEW INTERVIEW TYPE
This study uses meta-analysis of an extensive predictive validity data-base to explore the boundary conditions for the validity of. the structured interview as presented by McDaniel, Whetzel,
The validity of employment interviews: A comprehensive review and meta-analysis.
This meta-analytic review presents the findings of a project investigating the validity of the employment interview. Analyses are based on 245 coefficients derived from 86,311 individuals. Results
A meta‐analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview*
A meta-analysis of the employment interview was carried out to investigate the impact of interview format (individual vs. board interviews) and interview structure (unstructured vs. structured) on
Identification and meta-analytic assessment of psychological constructs measured in employment interviews.
TLDR
A comprehensive taxonomy of 7 types of constructs that the interview could assess was developed, suggesting that at least part of the reason why structured interviews tend to have higher validity is because they focus more on constructs that have a stronger relationship with job performance.
Structured Interviewing: Raising the Psychometric Properties of the Employment Interview.
A highly structured employment interviewing technique is proposed, which includes the following steps: (1) develop questions based on a job analysis, (2) ask the same questions of each candidate, (3)
The Validity of the Employment Interview: A Meta‐Analysis
The interview is the most widely used personnel selection method, but has revealed low reliability and validity compared with other selection methods (Mayfield 1964; Ulrich and Trumbo 1965; Schmitt
Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs.
The present investigation provides a reanalysis of the employment interview for entry-level jobs that overcomes several limitations of J. E. Hunter and R. F. Hunter's (1984) article. Using a
A meta-analysis of interrater and internal consistency reliability of selection interviews.
A meta-analysis of 111 interrater reliability coefficients and 49 coefficient alphas from selection interviews was conducted. Moderators of interrater reliability included study design, interviewer
The Effects of Interview Structure on Recruiting Outcomes
Two laboratory experiments explored the effects of interview structure on evaluations and perceptions of the interview and organization. In the first experiment, subjects were presented with
The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.
This article summarizes the practical and theoretical implications of 85 years of research in personnel selection. On the basis of meta-analytic findings, this article presents the validity of 19
...
...