Value-Added and Other Measures of Teacher Quality (page 2)
School districts, individual schools, and education policies all contribute to student achievement. But it can be argued that the most important contributing factor is the quality of the teacher in the classroom. Evaluating teacher quality is complicated, yet it has become even more important with the testing and assessment focus of No Child Left Behind (NCLB).
Teacher quality traditionally has been measured by considering ‘teacher characteristics,’ for example, the teacher’s academic degrees, personality, and professional development activities. Recently, though, researchers and policy makers have begin to embrace a ‘value-added’ approach to measurement. This set of statistical methods offers a more objective and more precise way to measure the value that teachers, schools, and districts add to students’ educational experiences.
But UW-Madison education professor Douglas Harris* cautions that measuring teacher quality cannot result from choosing between the traditional ‘teacher characteristics’ measure nor a simple value-added measure.
Instead, it’s necessary to use multiple measures, including formative and summative assessments. Evaluating and improving teacher quality requires a comprehensive strategy that few current or proposed policies provide, Harris says. Evidence suggests that teachers should be rewarded not for their graduate degrees, but for a combination of experience, certain types of professional development, teacher value-added and school value-added.
Current proposals shift away from the traditional ‘teacher credentials’ strategy in favor of a value-added accountability strategy. That is warranted, Harris says, but it’s possible to go too far. New policies will fail if they only reinforce the limitations of the status quo, rather than facilitate innovation and success. Harris advocates an evaluation framework he refers to as “policy validity” which involves multiple measures.
Program Evaluation and Accountability
Harris distinguishes between two kinds of value-added measures. Value-added modeling for program evaluation, or VAM-P, identifies the correlations and effects of teacher characteristics, such as their education and professional development. Some of his findings about VAM-P are:
- Most measures of formal teacher education, especially graduate degrees, appear unrelated to teacher value-added.
- There is some evidence that “pedagogical content knowledge” is associated with teacher effectiveness.
- Teacher experience consistently and positively associates with teacher effectiveness, at least for the first several years.
- Teacher test scores are inconsistently associated with teacher value-added.
- Various forms of teacher certification, including National Board certification, are inconsistently associated with teacher value-added.
Value-added modeling for accountability, or VAM-A, identifies the effectiveness of each individual teacher as measured by student achievement on standardized test scores. Harris’s findings regarding the validity of VAM-A:
- Value-added varies considerably across teachers.
- Teacher value-added positively correlates with other measures of teacher effectiveness, especially structured and unstructured principal evaluations.
These first two findings are good news for VAM-A but, as Harris argues, there is also some bad news:
- Teacher value-added scores are imprecise.
- Individual teacher value-added changes considerably over time. This “instability” in the measures is a problem because there is no reason to believe that actual teacher effectiveness varies as much as the measures sometimes indicate.
Overall, Harris concludes that there are clear advantages and disadvantages to using accountability measures versus credentials. Although VAM-P yields fairly precise estimates of the effects of teacher credentials, these effects are small, and they explain little of the total variation value-added. In contrast, the VAM-A measures are imprecise, but they imprecisely measure what is of greatest interest. Also, to the degree that student test scores can and should be used to evaluate teachers, VAM-A is better than the alternatives.
Reprinted with the permission of the University of Wisconsin. © 2007 The Board of Regents of the University of Wisconsin System.
- Coats and Car Seats: A Lethal Combination?
- Kindergarten Sight Words List
- Child Development Theories
- Signs Your Child Might Have Asperger's Syndrome
- 10 Fun Activities for Children with Autism
- Why is Play Important? Social and Emotional Development, Physical Development, Creative Development
- The Homework Debate
- First Grade Sight Words List
- Social Cognitive Theory
- GED Math Practice Test 1