Three Generations of DIF Analyses: Considering Where It Has Been, Where It Is Now, and Where It Is Going

@article{Zumbo2007ThreeGO,
  title={Three Generations of DIF Analyses: Considering Where It Has Been, Where It Is Now, and Where It Is Going},
  author={Bruno D. Zumbo},
  journal={Language Assessment Quarterly},
  year={2007},
  volume={4},
  pages={223 - 233}
}
  • B. Zumbo
  • Published 3 July 2007
  • Education
  • Language Assessment Quarterly
The purpose of this article is to reflect on the state of the theorizing and praxis of DIF in general: where it has been; where it is now; and where I think it is, and should, be going. Along the way the major trends in the differential item functioning (DIF) literature are summarized and integrated providing some organizing principles that allow one to catalog and then contrast the various DIF detection methods and to shine a light on the future of DIF analyses. The three generations of DIF… 
View on Taylor & Francis
faculty.educ.ubc.ca
310 Citations
Highly Influential Citations
32
Background Citations
144
Methods Citations
86
Results Citations
4

310 Citations

A Revisit of Zumbo’s Third Generation DIF: How Are We Doing in Language Testing?
ABSTRACT The purpose of this study is to review the status of differential item functioning (DIF) research in language testing, particularly as it relates to the investigation of sources (or causes)…
Use of multilevel logistic regression to identify the causes of differential item functioning.
TLDR
Multilevel logistic regression is used to identify the item characteristics associated with the presence of DIF and to evaluate alternative explanations of the DIF by comparing the explanatory power or fit of different sequential models.
The Trade-Off between Model Fit, Invariance, and Validity: The Case of PISA Science Assessments
ABSTRACT In large-scale educational assessments, it is generally required that tests are composed of items that function invariantly across the groups to be compared. Despite efforts to ensure…
A Rationale for and Demonstration of the Use of DIF and Mixed Methods
Item bias and Differential Item Functioning (DIF) research has been linked to the history of validity theory since it was first introduced. Forty years of research have provided a great arsenal of…
No negative Flynn effect in France: Why variations of intelligence should not be assessed using tests based on cultural knowledge
Funcionamento Diferencial dos Itens do Teste Não-Verbal de Inteligência SON-R 2½-7[a]
The presence of a considerable amount of items with differential functioning can make a test less valid. Therefore, the existence of Differential Item Functioning (DIF) in the intelligence test SON-R…
A Synthesis of the Peer-Reviewed Differential Bundle Functioning Research
The purpose of this article was to present a synthesis of the peer-reviewed differential bundle functioning (DBF) research that has been conducted to date. A total of 16 studies were synthesized…
UNDERSTANDING DIFFERENTIAL FUNCTIONING BY GENDER IN MATHEMATICS ASSESSMENT
When examinees with the same ?ability? take a test, they should have an equal chance of responding correctly to an item irrespective of group membership. This logic in assessment is known as…
Not all DIF is shaped similarly.
TLDR
An alternative category of differential item functioning (DIF) is presented with a corresponding way of modeling DIF, based on random person and random item effects and explanatory covariates.
A Methodology for Zumbo’s Third Generation DIF Analyses and the Ecology of Item Responding
Methods for detecting differential item functioning (DIF) and item bias are typically used in the process of item analysis when developing new measures; adapting existing measures for different…
...
...

References

SHOWING 1-10 OF 25 REFERENCES
Using Dimensionality-Based DIF Analyses to Identify and Interpret Constructs That Elicit Group Differences
In this paper I describe and illustrate the Roussos-Stout (1996) multidimensionality-based DIF analysis paradigm, with emphasis on its implication for the selection of a matching and studied subtest…
A Multidimensionality-Based DIF Analysis Paradigm
A multidimensionality-based differential item func tioning (DIF) analysis paradigm is presented that unifies the substantive and statistical DIF analysis approaches by linking both to a theoretically…
Characteristics of Mathematics Items Associated With Gender DIF
Most research on differential item functioning (DIF) focuses on methods for detection rather than on understanding why DIF might occur. This study was designed to investigate whether two alternative…
Differential Item Functioning: A Mixture Distribution Conceptualization
Differential item functioning (DIF) may be defined as an item that displays different statistical properties for different groups after matching the groups on an ability measure. For instance, with…
A Didactic Explanation of Item Bias, Item Impact, and Item Validity from a Multidimensional Perspective
Many researchers have suggested that the main cause of item bias is the misspecification of the latent ability space, where items that measure multiple abilities are scored as though they are…
A Method for Studying the Homogeneity of Test Items with Respect to Other Relevant Variables
Drawing on recently developed methodology for structural equation modeling with categorical data, this article proposes a new approach for investigating the behavior of a set of dichotomously scored…
Quantifying Subpopulation Differences for a Lack of Invariance Using Complex Examinee Profiles: An Exploratory Multigroup Approach Using Functional Data Analysis
This article presents a novel exploratory multigroup approach that quantifies relative group differences within an item response theory framework using tools from functional data analysis.…
A Matter of Test Bias in Educational Policy Research: Bringing the Context into Picture by Investigating Sociological/Community Moderated (or Mediated) Test and Item Bias.
The present study introduces and demonstrates a new methodology for item and test bias studies: “moderated differential item functioning (DIF).” This technique expands the DIF methodology to…
3 Validity: Foundational Issues and Statistical Methodology
Instructionally Sensitive Psychometrics: Application of a New IRT‐Based Detection Technique to Mathematics Achievement Test Items
Achievement modeling is carried out in groups of students characterized by heterogeneous instructional background. Extensions of item response theory models incorporate variables reflecting different…
...
...