The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures
@article{Lockwood2007TheSO, title={The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures}, author={J. R. Lockwood and Daniel F. McCaffrey and Laura S. Hamilton and Brian M. Stecher and Vi-Nhuan Le and Jos{\'e} Felipe Mart{\'i}nez}, journal={Journal of Educational Measurement}, year={2007}, volume={44}, pages={47-67} }
Using longitudinal data from a cohort of middle school students from a large school district, we estimate separate “value-added” teacher effects for two subscales of a mathematics assessment under a variety of statistical models varying in form and degree of control for student background characteristics. We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification…
Figures from this paper
208 Citations
Sensitivity of Teacher Value-Added Estimates to Student and Peer Control Variables
- Education
- 2015
Abstract Teacher value-added models (VAMs) must isolate teachers’ contributions to student achievement to be valid. Well-known VAMs use different specifications, however, leaving policymakers with…
Exploring Student-Teacher Interactions in Longitudinal Achievement Data
- EducationEducation Finance and Policy
- 2009
This article develops a model for longitudinal student achievement data designed to estimate heterogeneity in teacher effects across students of different achievement levels. The model specifies…
Teacher Value-Added at the High-School Level
- Education
- 2011
This article reports on findings based on analyses of a unique dataset collected by ACT that includes information on student achievement in a variety of subjects at the high-school level. The authors…
Does the Model Matter? Exploring the Relationship Between Different Student Achievement-Based Teacher Assessments
- Education
- 2012
Policymakers have demonstrated an interest in using measures of student achievement to inform high-stakes teacher personnel decisions, but the idea of using student outcomes as a teacher performance…
Value-Added Modeling of Teacher Effectiveness: An Exploration of Stability across Models and Contexts
- Education
- 2010
Recent policy interest in tying student learning to teacher evaluation has led to growing use of value-added methods for assessing student learning gains linked to individual teachers. VAM analyses…
THE INTERTEMPORAL STABILITY OF TEACHER EFFECT ESTIMATES
- Education
- 2008
Recently, a number of school districts have begun using measures of teachers’ contributions to student test scores or teacher “value added” to determine salaries and other monetary rewards. In this…
A Comparison of Student Growth Percentile and Value-Added Models of Teacher Performance
- Education, Economics
- 2014
Evidence suggests that the choice between estimators is most consequential under nonrandom assignment of teachers to students and that value-added measures controlling for teacher fixed effects may be better suited to estimating teacher quality in this case.
The Intertemporal Variability of Teacher Effect Estimates
- EducationEducation Finance and Policy
- 2009
The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher…
Controlling for Student Heterogeneity in Longitudinal Achievement Models
- Education
- 2007
Research and policies concerning primary and secondary school education in the United States are increasingly focused on student achievement test scores, in part because of the rapidly growing…
Estimating Teacher Effects Using Value-Added Models.
- Education
- 2010
Value-added modeling is an alternative approach to test-based accountability systems based on the proportions of students scoring at or above predetermined proficiency levels. Value-added modeling…
References
SHOWING 1-10 OF 47 REFERENCES
Bayesian Methods for Scalable Multivariate Value-Added Assessment
- Education
- 2007
There is increased interest in value-added models relying on longitudinal student-level test score data to isolate teachers’ contributions to student achievement. The complex linkage of students to…
How Large Are Teacher Effects?
- Education
- 2004
It is widely accepted that teachers differ in their effectiveness, yet the empirical evidence regarding teacher effectiveness is weak. The existing evidence is mainly drawn from econometric studies…
Controlling for Student Background in Value-Added Assessment of Teachers
- Education
- 2004
The Tennessee Value-Added Assessment System measures teacher effectiveness on the basis of student gains, implicitly controlling for socioeconomic status and other background factors that influence…
Distorting Value Added: The Use of Longitudinal, Vertically Scaled Student Achievement Data for Growth-Based, Value-Added Accountability
- Education
- 2006
Longitudinal, student performance-based, value-added accountability models have become popular of late and continue to enjoy increasing popularity. Such models require student data to be vertically…
Models for Value-Added Modeling of Teacher Effects
- EducationJournal of educational and behavioral statistics : a quarterly publication sponsored by the American Educational Research Association and the American Statistical Association
- 2004
It is concluded that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations, but student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.
Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System
- Education
- 2003
This article addresses the validity of teacher evaluation measures produced by the Tennessee Value Added Assessment System (TVAAS). The system analyzes student test score data and estimates the…
Evaluating Value-Added Models for Teacher Accountability
- Education
- 2004
Does value-added modeling (VAM) demonstrate the importance of teachers to student outcomes? The authors clarify the primary questions raised by VAM for measuring teacher effects, review the most…
Enhancing the Validity and Usefulness of Large-Scale Educational Assessments: I. NELS:88 Mathematics Achievement
- Education
- 2008
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with…
Gender Differences on High School Science Achievement Tests: Do Format and Content Matter?
- Education
- 1998
Gender differences on the NELS:88 multiple-choice and constructed-response science tests were explored through a combination of statistical analyses and interviews. Performance gaps between males and…
In Dedication: Leigh Burstein
- Education
- 1995
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with…