Unfair Treatment? The Case of Freedle, the SAT, and the Standardization Approach to Differential Item Functioning

@article{Santelices2010UnfairTT,
  title={Unfair Treatment? The Case of Freedle, the SAT, and the Standardization Approach to Differential Item Functioning},
  author={Maria Veronica Santelices and Mark R. Wilson},
  journal={Harvard Educational Review},
  year={2010},
  volume={80},
  pages={106-134}
}
In 2003, the Harvard Educational Review published a controversial article by Roy Freedle that claimed bias against African American students in the SAT college admissions test. Freedle's work stimulated national media attention and faced an onslaught of criticism from experts at the Educational Testing Service (ETS), the agency responsible for the development of the SAT. In this article, Maria Veronica Santelices and Mark Wilson take the debate one step further with new research exploring… 

Figures and Tables from this paper

Misrepresentations in Unfair Treatment by Santelices and Wilson

In his 2003 article in the Harvard Educational Review (HER), Freedle claimed that the SAT was both culturally and statistically biased and proposed a solution to ameliorate this bias. I argued

Unfair Treatment vs. Confirmation Bias? Comments on Santelices and Wilson. Research Report. ETS RR-10-20.

Santelices and Wilson (2010) claimed to have addressed technical criticisms of Freedle (2003) presented in Dorans (2004a) and elsewhere. Santelices and Wilson's abstract claimed that their study

The Revised SAT Score and Its Potential Benefits for the Admission of Minority Students to Higher Education.

This paper investigates the predictive validity of the Revised SAT (R-SAT) score, proposed by Freedle (2003) as an alternative to compensate minority students for the potential harm caused by the

SAT: Does Racial Bias Exist?

SAT is one of the most widely used tests today. But much controversy surrounds it and many times the biases existing in the test have been questioned. The purpose of this paper is to explore whether

Cultural Bias in Testing

The findings and discussions related to cultural bias in testing have in no way been unanimous. However, the considerations of this area of inquiry may possess meaningful implications for educators

Testing at the Tipping Point: HSST as a Governing Education Principle In and Out of the Classroom

At a recent academic conference a senior Canadian scholar who has worked closely with Ontario’s standardized testing body (the Education Quality and Accountability Office, EQAO) argued there were no

Race, Poverty and SAT Scores: Modeling the Influences of Family Income on Black and White High School Students’ SAT Performance

Background Educational policy makers and test critics often assert that standardized test scores are strongly influenced by factors beyond individual differences in academic achievement such as

Segregation and the Underrepresentation of Blacks and Hispanics in Gifted Education: Social Inequality and Deficit Paradigms

This article examines the underrepresentation of African American and Hispanic students in gifted education, proposing that social inequality, deficit thinking, and microaggressions contribute to the

On the Relationship Between Differential Item Functioning and Item Difficulty

The relationship between differential item functioning (DIF) and item difficulty on the SAT is such that more difficult items tended to exhibit DIF in favor of the focal group (usually minority

A Rasch Item Response Modeling Approach to Validation: Evidence Based on Test Content and Internal Structure of the Life Effectiveness Questionnaire

Author(s): Sammet, Kara | Advisor(s): Wilson, Mark R | Abstract: This study applies the Standards for Educational and Psychological Testing to appraise validity evidence for the interpretation of
...

References

SHOWING 1-10 OF 39 REFERENCES

USING SCORE EQUITY ASSESSMENT TO EVALUATE THE EQUATABILITY OF THE HARDEST HALF OF A TEST TO THE TOTAL TEST

In an article published in the spring 2003 issue of Harvard Educational Review, Roy Freedle stated that the SAT® is both culturally and statistically biased. Freedle proposed a solution to this bias,

EXAMINING FREEDLE'S CLAIMS ABOUT BIAS AND HIS PROPOSED SOLUTION: DATED DATA, INAPPROPRIATE MEASUREMENT, AND INCORRECT AND UNFAIR SCORING

In the Spring 2003 issue of Harvard Educational Review, Roy Freedle stated that the SAT® is both culturally and statistically biased, and he proposed a solution to ameliorate this bias. His claims,

Differential Item Functioning for Minority Examinees on the SAT

The standardization approach to assessing differential item functioning (DIF), including standardized distractor analysis, is described. The results of studies conducted on Asian Americans, Hispanics

DIFFERENTIAL ITEM FUNCTIONING FOR MINORITY EXAMINEES ON THE SAT1,2

The standardization approach to assessing differential item functioning (DIF), including standardized distractor analysis, is described. The results of studies conducted on Asian-Americans, Hispanics

ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE OF FEMALE CANDIDATES ON SAT AND TSWE FORMS ADMINISTERED IN DECEMBER 1977: AN APPLICATION OF THE STANDARDIZATION APPROACH1

A new approach to assessing unexpected differential item performance (item bias or item fairness) is developed and applied to the item responses of males and females to SAT/TSWE items administered

Fair Game?: The Use of Standardized Admissions Tests in Higher Education

Despite the onslaught of editorials and articles on the subject of standardized admissions tests, few people outside the rarefied world of psychometrics-the statistical analysis of test scores-know

CHARACTERISTICS ASSOCIATED WITH DIFFERENTIAL ITEM FUNCTIONING ON THE SCHOLASTIC APTITUDE TEST: GENDER AND MAJORITY/MINORITY GROUP COMPARISONS

The purpose of the study was to investigate whether selected test and item characteristics in the SAT are associated with unexpected differential item functioning (DIF) for males and females and for

Further Comment: Freedle's Table 2: Fact or Fiction?

In this section, Neil Dorans, from the Educational Testing Service, responds to Roy O. Freedle's article, "Correcting the SAT's Ethnic and Social-Class Bias: A Method of Reestimating SAT Scores,"

THE INTERNAL CONSTRUCT VALIDITY OF THE SAT1

The primary goal of this research was to obtain a fuller understanding of what is being measured by the SAT. In addition, this project had two secondary goals: (1) the identification of a set of

A COMPARISON OF STRATEGIES USED BY BLACK AND WHITE STUDENTS IN SOLVING SAT VERBAL ANALOGIES USING A THINKING ALOUD METHOD AND A MATCHED PERCENTAGE-CORRECT DESIGN

Two studies are reported which investigate how Black and White examinees differ in their ability to solve analogy items. The first helps to identify three factors which affect differential ethnic