The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures

@article{Lockwood2007TheSO,
  title={The Sensitivity of Value‐Added Teacher Effect Estimates to Different Mathematics Achievement Measures},
  author={J. R. Lockwood and Daniel F. McCaffrey and Laura S. Hamilton and Brian M. Stecher and Vi-Nhuan Le and Jos{\'e} Felipe Mart{\'i}nez},
  journal={Journal of Educational Measurement},
  year={2007},
  volume={44},
  pages={47-67}
}
Using longitudinal data from a cohort of middle school students from a large school district, we estimate separate “value-added” teacher effects for two subscales of a mathematics assessment under a variety of statistical models varying in form and degree of control for student background characteristics. We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification… 
View via Publisher
rand.org
208 Citations
Highly Influential Citations
18
Background Citations
85
Methods Citations
23
Results Citations
17

Figures from this paper

208 Citations

Citation Type

Citation Type

Sensitivity of Teacher Value-Added Estimates to Student and Peer Control Variables
Abstract Teacher value-added models (VAMs) must isolate teachers’ contributions to student achievement to be valid. Well-known VAMs use different specifications, however, leaving policymakers with…
Exploring Student-Teacher Interactions in Longitudinal Achievement Data
This article develops a model for longitudinal student achievement data designed to estimate heterogeneity in teacher effects across students of different achievement levels. The model specifies…
Teacher Value-Added at the High-School Level
This article reports on findings based on analyses of a unique dataset collected by ACT that includes information on student achievement in a variety of subjects at the high-school level. The authors…
Does the Model Matter? Exploring the Relationship Between Different Student Achievement-Based Teacher Assessments
Policymakers have demonstrated an interest in using measures of student achievement to inform high-stakes teacher personnel decisions, but the idea of using student outcomes as a teacher performance…
Value-Added Modeling of Teacher Effectiveness: An Exploration of Stability across Models and Contexts
Recent policy interest in tying student learning to teacher evaluation has led to growing use of value-added methods for assessing student learning gains linked to individual teachers. VAM analyses…
THE INTERTEMPORAL STABILITY OF TEACHER EFFECT ESTIMATES
Recently, a number of school districts have begun using measures of teachers’ contributions to student test scores or teacher “value added” to determine salaries and other monetary rewards. In this…
A Comparison of Student Growth Percentile and Value-Added Models of Teacher Performance
TLDR
Evidence suggests that the choice between estimators is most consequential under nonrandom assignment of teachers to students and that value-added measures controlling for teacher fixed effects may be better suited to estimating teacher quality in this case.
The Intertemporal Variability of Teacher Effect Estimates
The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher…
Controlling for Student Heterogeneity in Longitudinal Achievement Models
Research and policies concerning primary and secondary school education in the United States are increasingly focused on student achievement test scores, in part because of the rapidly growing…
Estimating Teacher Effects Using Value-Added Models.
Value-added modeling is an alternative approach to test-based accountability systems based on the proportions of students scoring at or above predetermined proficiency levels. Value-added modeling…
...
...

References

SHOWING 1-10 OF 47 REFERENCES
Bayesian Methods for Scalable Multivariate Value-Added Assessment
There is increased interest in value-added models relying on longitudinal student-level test score data to isolate teachers’ contributions to student achievement. The complex linkage of students to…
How Large Are Teacher Effects?
It is widely accepted that teachers differ in their effectiveness, yet the empirical evidence regarding teacher effectiveness is weak. The existing evidence is mainly drawn from econometric studies…
Controlling for Student Background in Value-Added Assessment of Teachers
The Tennessee Value-Added Assessment System measures teacher effectiveness on the basis of student gains, implicitly controlling for socioeconomic status and other background factors that influence…
Distorting Value Added: The Use of Longitudinal, Vertically Scaled Student Achievement Data for Growth-Based, Value-Added Accountability
Longitudinal, student performance-based, value-added accountability models have become popular of late and continue to enjoy increasing popularity. Such models require student data to be vertically…
Models for Value-Added Modeling of Teacher Effects
TLDR
It is concluded that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations, but student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.
Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System
This article addresses the validity of teacher evaluation measures produced by the Tennessee Value Added Assessment System (TVAAS). The system analyzes student test score data and estimates the…
Evaluating Value-Added Models for Teacher Accountability
Does value-added modeling (VAM) demonstrate the importance of teachers to student outcomes? The authors clarify the primary questions raised by VAM for measuring teacher effects, review the most…
Enhancing the Validity and Usefulness of Large-Scale Educational Assessments: I. NELS:88 Mathematics Achievement
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with…
Gender Differences on High School Science Achievement Tests: Do Format and Content Matter?
Gender differences on the NELS:88 multiple-choice and constructed-response science tests were explored through a combination of statistical analyses and interviews. Performance gaps between males and…
In Dedication: Leigh Burstein
This study demonstrates that the validity and usefulness of mathematics achievement tests can be improved by defining psychologically meaningful subscores that yield differential relations with…
...
...