The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures

  title={The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures},
  author={J. R. Lockwood and Daniel F. McCaffrey and Laura S. Hamilton and Brian M. Stecher and Vi-Nhuan Le and Jos{\'e} Felipe Mart{\'i}nez},
  journal={Journal of Educational Measurement},
Using longitudinal data from a cohort of middle school students from a large school district, we estimate separate “value-added” teacher effects for two subscales of a mathematics assessment under a variety of statistical models varying in form and degree of control for student background characteristics. We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification… 

Figures from this paper

Sensitivity of Teacher Value-Added Estimates to Student and Peer Control Variables
Abstract Teacher value-added models (VAMs) must isolate teachers’ contributions to student achievement to be valid. Well-known VAMs use different specifications, however, leaving policymakers with
Exploring Student-Teacher Interactions in Longitudinal Achievement Data
This article develops a model for longitudinal student achievement data designed to estimate heterogeneity in teacher effects across students of different achievement levels. The model specifies
Teacher Value-Added at the High-School Level
This article reports on findings based on analyses of a unique dataset collected by ACT that includes information on student achievement in a variety of subjects at the high-school level. The authors
Does the Model Matter? Exploring the Relationship Between Different Student Achievement-Based Teacher Assessments
Policymakers have demonstrated an interest in using measures of student achievement to inform high-stakes teacher personnel decisions, but the idea of using student outcomes as a teacher performance
Value-Added Modeling of Teacher Effectiveness: An Exploration of Stability across Models and Contexts
Recent policy interest in tying student learning to teacher evaluation has led to growing use of value-added methods for assessing student learning gains linked to individual teachers. VAM analyses
Recently, a number of school districts have begun using measures of teachers’ contributions to student test scores or teacher “value added” to determine salaries and other monetary rewards. In this
A Comparison of Student Growth Percentile and Value-Added Models of Teacher Performance
Evidence suggests that the choice between estimators is most consequential under nonrandom assignment of teachers to students and that value-added measures controlling for teacher fixed effects may be better suited to estimating teacher quality in this case.
The Intertemporal Variability of Teacher Effect Estimates
The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher
Controlling for Student Heterogeneity in Longitudinal Achievement Models
Research and policies concerning primary and secondary school education in the United States are increasingly focused on student achievement test scores, in part because of the rapidly growing
Estimating Teacher Effects Using Value-Added Models.
Value-added modeling is an alternative approach to test-based accountability systems based on the proportions of students scoring at or above predetermined proficiency levels. Value-added modeling


Bayesian Methods for Scalable Multivariate Value-Added Assessment
There is increased interest in value-added models relying on longitudinal student-level test score data to isolate teachers’ contributions to student achievement. The complex linkage of students to
How Large Are Teacher Effects?
It is widely accepted that teachers differ in their effectiveness, yet the empirical evidence regarding teacher effectiveness is weak. The existing evidence is mainly drawn from econometric studies
Controlling for Student Background in Value-Added Assessment of Teachers
The Tennessee Value-Added Assessment System measures teacher effectiveness on the basis of student gains, implicitly controlling for socioeconomic status and other background factors that influence
Distorting Value Added: The Use of Longitudinal, Vertically Scaled Student Achievement Data for Growth-Based, Value-Added Accountability
Longitudinal, student performance-based, value-added accountability models have become popular of late and continue to enjoy increasing popularity. Such models require student data to be vertically
Models for Value-Added Modeling of Teacher Effects
It is concluded that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations, but student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.
Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System
This article addresses the validity of teacher evaluation measures produced by the Tennessee Value Added Assessment System (TVAAS). The system analyzes student test score data and estimates the
Evaluating Value-Added Models for Teacher Accountability
Does value-added modeling (VAM) demonstrate the importance of teachers to student outcomes? The authors clarify the primary questions raised by VAM for measuring teacher effects, review the most
Enhancing the Validity and Usefulness of Large-Scale Educational Assessments: I. NELS:88 Mathematics Achievement
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with
Gender Differences on High School Science Achievement Tests: Do Format and Content Matter?
Gender differences on the NELS:88 multiple-choice and constructed-response science tests were explored through a combination of statistical analyses and interviews. Performance gaps between males and
In Dedication: Leigh Burstein
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with