Tag Archives: Teacher Evaluation

Ignore the Headlines and Dig into the Results: The Real Impact of Teacher Evaluation Reform

FL StoryThe headline “Florida teacher evaluations: Most everyone good or very good” in last week’s Orlando Sentinel felt like déjà vu. Similar headlines have graced the pages of local newspapers across the country, leading readers to assume that recent reforms of teacher evaluation systems weren’t worth the effort because teachers continue to receive high ratings. But that first impression is incomplete.

My colleague Sara Mead and I grappled with this idea in a recent report. At first blush, it’s true that reformed teacher evaluation systems haven’t substantially changed the distribution of teacher evaluation ratings. And there are logical explanations for those results.

But focusing purely on the final evaluation ratings misses important progress underneath the overall results. For example, my colleague Chad Aldeman highlighted a few specific places where teacher evaluation reforms served broader school improvement efforts. The progress does not stop there. The following studies point to other positive outcomes from teacher evaluation reform:

  • Greater job satisfaction among effective teachers. A new study of Tennessee’s teacher evaluation system released earlier this month found that when teachers receive higher ratings under the state’s reformed teacher evaluation system, the perceptions of their work improve relative to teachers who received lower ratings.
  • Higher turnover of less effective teachers. A 2016 report on the state of the teaching profession in North Carolina found that, for teachers at every experience level, those who left the profession had lower overall evaluation ratings and lower effects on student growth than teachers who stayed. The graph below shows the picture for student growth. The blue line shows the growth scores for teachers who remained as teachers in North Carolina, and the red line shows those who left. We don’t know if this is a story of correlation or causation, but at least North Carolina can now point to data showing that they’re retaining the best teachers.
NC Chart

Click to enlarge

  • Higher turnover of less effective probationary teachers. Similar to the outcomes in North Carolina, a 2014 study of New York City public schools found that teachers who had their probationary periods extended — that is, who were told they weren’t effective enough at that time to earn tenure — voluntarily left their teaching positions at higher rates. Although New York wasn’t actively dismissing low-performers, this notice was enough to “nudge” them to consider other professions.
  • Improvement of overall teacher quality. A study of DC Public Schools’ (DCPS) teacher evaluation system, IMPACT, shows that the evaluation system encouraged the voluntary turnover of low-performing teachers. When the lower performing teachers left the district, leaders in the district filled the open teaching positions with new teachers who were more effective than the ones who left. The result has been a rise in overall teacher quality in DCPS.

These and other teacher evaluation studies are complicated. They are not prone to eye-catching headlines. But nonetheless, teacher evaluation systems may be quietly having an effect on which teachers stay in the profession and, ultimately, whether students are learning.

We Have to Say More About Teacher Evaluation Reforms Than Just “They Didn’t Work”

In a piece for Education Next released last month, I looked at the Obama-era push for better teacher evaluation systems. As states and cities turn the page on that particular set of reforms, I wanted to pause and reflect on what we can learn from the last eight years. In the piece, I nodded toward some of the successes of that effort but spent more time reflecting on what could have gone better. I focused on four major policy mistakes:

  1. A universal approach of trying to get all states and cities to pursue teacher evaluation reform efforts;
  2. A narrow definition that focused too much on the specific elements of evaluation systems without leaving room to accomplish the same goals in different ways;
  3. An emphasis on process over purpose, which paid too much attention to the evaluation systems themselves and not enough on the actual use of those systems;
  4. A collision in timing with the rollout of Common Core that proved politically and logistically challenging.

These failures do not invalidate the entire theory of action that teachers matter and that improving the policies around how school districts hire, evaluate, compensate, and train teachers could lead to better outcomes for students. Encouraging school districts to evaluate teachers and principals at least in part on student growth, and to make consequential decisions based on those determinations, was never going to be an easy shift. It required new policies, new systems, and better tools, not to mention changing a culture that treated teachers as interchangeable widgets. For all these reasons and more, we haven’t seen the widespread changes President Obama or his Secretary of Education, Arne Duncan, might have hoped for when they made teacher evaluation one of their signature policies.

Still, failing to change everything doesn’t mean we’ve learned nothing. There’s a growing body of evidence that evaluation reform can be a viable school improvement strategy for places that want to pursue it. In my piece I cited a randomized controlled trial of the Teacher Incentive Fund (TIF), which provided competitive grants for districts to revamp their evaluation and compensation systems. The study found that TIF led to gains equivalent to 10 percent of a year’s worth of learning in math and 11 percent in reading. There are other positive examples as well. Studies on evaluation reform efforts in Cincinnati, Chicago, Denver, New York City, and Washington, D.C. have found that comprehensive evaluation systems can help identify teachers who need to improve their practice, nudge low-performing teachers out of the profession, and, ultimately, boost student achievement. To be sure, these cities all pursued different sets of reforms, but they had the common thread that they were all trying to identify and act on differences in teacher performance.

In total, these positive examples provide evidence in support of the underlying theory of action on teacher evaluation reforms. Rather than discarding this era and moving on, as states and advocates seem wont to do, we should learn from this massive effort: what worked and what didn’t work and why.

Student Learning Should Matter for Teacher Evaluation Ratings, But It Still Doesn’t

Students are not learning, but teachers are told they’re doing their jobs effectively. This oxymoron is not new in American education, but recent teacher evaluation laws were supposed to demolish it by better aligning teacher evaluation scores and student learning outcomes.

NCTQ Report PicThe problem is: the laws aren’t working as intended. Even with new laws in place, the vast majority of teachers across the country continue to receive a rating equivalent to effective or higher. A new report from the National Council on Teacher Quality (NCTQ) provides a new explanation for the phenomenon.

The report reveals that in almost all states, there are teachers who receive an overall evaluation score of “effective” or “highly effective” despite receiving a low score for leading students to academic achievement. This is possible because these teachers receive high scores on other parts of the evaluation such as principal and peer observations, student and parent surveys, and other district and state measures. As NCTQ’s new report details, the guidance and rules that structure states’ evaluation laws allow teachers who receive uneven scores throughout their evaluation to still be rated as effective practitioners — even when data show their students are not learning.

NCTQ’s report provides a new opportunity to discuss the negative consequences of misalignment between teacher evaluation and student learning outcomes. The following are a few damaging outcomes of such misalignment: Continue reading

What is the Purpose of Teacher Evaluation Today? A Conversation Between Bellwether and The Fordham Institute

BW picTeacher evaluation was one of President Obama’s signature policies, and a controversial element of education reform during his tenure. With the passage of the Every Student Succeeds Act (ESSA), which does not require states and districts to implement performance-based teacher evaluations like No Child Left Behind waivers did, teacher evaluation policy has largely fallen out of the public narrative. But that does not mean states or districts know how they are going to proceed with teacher evaluation policy — in fact, its future remains unclear in this new era of lessened federal oversight.

In December 2016, Bellwether Education Partners and The Thomas B. Fordham Institute independently released two reports centered on teacher evaluation and its consequences. Bellwether’s report summarizes the teacher evaluation policy landscape and points out potential risks for teacher evaluation in the wake of the passage of ESSA. The Fordham Institute’s report studies 25 districts to determine if those districts can terminate veteran teachers once evaluation systems have deemed them ineffective.

fordham picBoth reports offer a glimpse into ongoing challenges and opportunities with teacher evaluation reform, but they have very different analyses. To understand our different approaches and the places where we might overlap on teacher evaluation policy, Bellwether and Fordham hosted an email conversation between the report authors. Below is a transcript of the exchange between Bellwether’s Kaitlin Pennington and Sara Mead and Fordham’s Victoria McDougald and David Griffith.

Fordham’s report emphasized dismissing ineffective veteran teachers and Bellwether’s report highlighted how the field has switched the focus of teacher evaluation to professional development. Are these aims incompatible? Understanding the core purpose of teacher evaluation systems is especially important as states and districts consider making changes in the ESSA era. Each exchange below ends with a question for the other organization’s authors to respond to. The conversation has been lightly edited for clarity.

– – –

Bellwether’s Kaitlin Pennington and Sara Mead: When we wrote our report, we grappled with what policymakers, teachers, and the public see as teacher evaluation’s purpose or “theory of action.” From the onset of reforms, there was inconsistent messaging. Some said teacher evaluation would be used primarily to inform employment decisions. Others said the systems would inform teachers’ professional development. Over time, many said the systems would do both. The inconsistent messaging about the purpose of teacher evaluation enabled opponents to define the systems as primarily punitive measures targeting teachers.

This led advocates to lose hold of the teacher evaluation narrative. Although very few teachers are rated ineffective and – as you write about in your report – even fewer actually lose their jobs because of poor evaluation ratings, many teachers currently view performance-based teacher evaluation systems as mechanisms to harm them.

But focusing narrowly on ineffective teachers may be the wrong emphasis. We believe that teacher evaluation is important because these systems can be used to define common expectations for effective teaching practice, facilitate data-driven conversations about instruction, and reward effective teaching in order to retain the most-skilled teachers. In the past several years, many states have used the systems to do this – in fact the most differentiation of teacher practice is happening at the high end of the spectrum between “effective” and “highly effective” teachers.

So while it is troubling that the systems have not exited poor performing teachers from the profession like many early teacher evaluation advocates hoped they would, the reformed systems have made progress over the binary systems they replaced. Yet the focus on firing teachers continues to dominate the public narrative.

Now because the Every Student Succeeds Act allows for more changes to teacher evaluation, many states are trying to rid their systems from connection to the “firing bad teachers” narrative. They are doing so by making it even harder to objectively determine ineffective teaching (and exit teachers because of it) by reducing or eliminating the main quantitative data point in many teacher evaluation systems – student achievement and growth data.  The loss of this objective data to balance subjective measures like classroom observations and student and parent surveys negatively impacts the reliability of the systems. Moreover it reinforces a troubling age-old message, that great teaching is determined by teacher input and is divorced from student output. This has implications for the future of the teaching profession and the human capital talent interested in joining a profession that is evaluated on these metrics.

When you wrote your report, did you consider teacher evaluation’s theory of action? Do you think performance-based teacher evaluations will survive in the ESSA era if the narrative around them continues to focus on firing ineffective teachers?

Fordham’s Victoria McDougald: While teacher evaluation and dismissal are obviously closely intertwined, our report – Undue Process: Why Bad Teachers in Twenty-Five Diverse Districts Rarely Get Fired – shines light on the latter, equally important yet far less-studied issue. In it, we ask: after nearly a decade of teacher evaluation reform, is it any easier to exit an ineffective veteran teacher from the classroom? Dismissal data are notoriously difficult to come by, but as recently as 2013, just 0.2 percent of tenured teachers in a typical state were dismissed for poor performance.

After combing through collective bargaining agreements, employee handbooks, and state laws, our study yielded bleak findings. Overall, we found that dismissing underperforming teachers remains far too hard (in all twenty-five diverse districts included in our study, significant barriers remain in place to doing so).

Should the conversation around teacher evaluation focus exclusively on firing ineffective teachers? Certainly not. Continue reading

What Hillary Clinton Gets Wrong About Teacher Compensation

Read more live coverage of #EDlection2016 via Bellwether and The 74’s Convention Live Blog.

When it comes to K-12 education policy, Hillary Clinton is campaigning on platitudes, and a favorite topic for the presumptive Democratic presidential nominee is teacher compensation. Clinton has proclaimed on several occasions that teacher pay should be raised. The talking point makes her popular with  teachers unions, but it’s misleading. Across-the-board base salary pay raises for teachers are not financially feasible for most school districts, nor is the idea considered strategic policy.

Low and stagnant teacher pay is alarming, but simply and hastily raising teacher salaries across the board will not solve the problem. Instead, districts should use teacher compensation as a lever to attract, retain, and support a high-performing teaching force, and they need to do this in a financially sustainable way. Base salary increases may be part of the solution, but districts also need to consider other key components of teacher compensation including teacher effectiveness, the speed of salary growth, bonuses and rewards, incentives for hard-to-staff schools and positions, and so on.

The balancing act isn’t easy. The best solution is to use data to make decisions about teacher compensation — a practice most school districts do not employ. As a new Bellwether Education Partners resource called The Learning Landscape explains, the structure of most teacher salary schedules does not align with the evidence of teacher performance. For example, research shows that teachers improve greatly in their first few years of teaching and then their performance levels off, however very few districts use this data to make decisions about teacher compensation to retain top-performing new teachers.

FireShot Capture 161 - Teacher Effecti_ - http___www.thelearninglandscape.org_teacher-effectiveness_

As the above charts shows, while teachers on average rapidly grow in their effectiveness in the first five years of teaching, they do not see substantial pay raises until about one decade into their careers. To retain effective new teachers, a district might consider increasing how quickly those teachers receive large pay raises. A district might not have the funds to use this data-driven compensation strategy if it raised all teachers’ salaries.

This is not to mention other data-driven and research-based teacher compensation strategies such as raising teachers’ compensation as they take on leadership roles within their school communities.

Most districts have a long way before they implement these kinds of strategic compensation designs. The vast majority of school districts implement a compensation structure that treats all teachers the same, regardless of performance, skill, or responsibility. In fact, as The Learning Landscape details, in 2012 only 11 percent of districts used pay incentives to reward teachers for excellent performance.

However, if districts follow Hillary Clinton’s suggestion to raise all teachers’ salaries, data-driven teacher compensation strategies of any kind will not be possible in most places. Perhaps Clinton has something more strategic in mind when she talks about teacher pay, but voters will not know if she continues to speak in generalities when it comes to issues of K-12 education.