These days teachers find themselves swept up in the cross currents of an education debate about how to evaluate and pay teachers that is more polarizing and ugly by the day. Some days the debate generates much more heat than light, and this topic is greatly in need of illumination. Without at doubt, change is needed. The single salary schedule, which mandates the same salaries for teachers regardless of field, creates shortages of math, science, and special education teachers, and prevents some of the best from entering teaching. It makes sense for “star” teachers to earn more at the same level of experience. Tenure ought not to endlessly protect teachers who end up performing poorly or worse. Yet, that doesn’t mean that every proposed solution is a good idea; and some could turn things from bad to worse. Teachers should take the lead in helping the public understand their jobs and what works. For example, explaining how teaching is not just a matter of each teacher in her own classroom working independently and the many ways in which test scores really don’t capture all that is important about a child’s education.
The most recent example in need of illumination is a proposal released this week by New Jersey’s acting Education Commissioner Christopher Cerf. I find the basic ideas he proposes a pretty good list: more nuanced evaluations of teachers, no moving poorly performing teachers into “less important” teaching positions rather than out of schools altogether, and more clear reliance on supervisor observations and children’s learning to evaluate teachers. Doing this well is not going to be easy, however. Simply calling for teachers to be judged on value-added (VA) evaluations won’t do the job. Broadly speaking, VA calls for using student test scores in deciding how well teachers are doing. This approach has already become policy in some districts and it is beginning to affect which teachers stay, which teachers go, and whether they get a raise. Yet it is highly questionable whether any progress in improving the teacher corps can be made the way that VA is currently done. Too much depends on the children assigned to the teacher and our ability to correctly estimate the teacher’s contribution is far too weak. It matters who else teaches in the same school. First- and second-year teachers are early works in progress and their trajectory matters as much as the level of their performance.
The move to VA teacher evaluation across the country appears to be driven more by political agendas dedicated to blaming teachers and their unions rather than finding effective solutions. I don’t know what else could explain the way VA’s proponents gloss over the fact that as currently implemented it is built on a shaky scientific foundation. However, given this problem it seems likely that public servants like New Jersey’s Commissioner have not been fully informed about the limitations, presenting an opportunity for more illumination to benefit the policy debate.
The VA method calls for estimating through analyses of standardized test scores how much any given teacher helps or hinders the academic progress of students. The Los Angeles Times drew national attention to VA evaluation in a series in which an economist paid by the newspaper rated elementary school teachers according to this method, using a detailed set of data from the Los Angeles Unified School District. Based on this work, the Times then published a 6,000-name list of teachers and their ratings.
Enter the National Education Policy Center (NEPC) at the University of Colorado. Researchers there analyzed the work done at the Times’ behest and found that, while the VA model yielded different outcomes for different teachers, it did not tell them whether those outcomes measured what is important (teacher effectiveness) or something else, such as whether students benefited from other learning resources outside of school. One way to test the validity of the VA model is to investigate whether using it, a student’s future teacher would appear to have an effect on a student’s test performance in the past — something that is impossible in the world most of us inhabit. They found that future teachers did indeed affect the past learning of students, especially in reading, indicating the VA model is faulty. Read the rest of this entry »