Over the Long Term, NAEP Scores Are Way, Way Up

In anticipation of new NAEP scores coming out this week, I thought it would be useful to spend some time reflecting beforehand on what we know on a macro scale. So rather than focus on year-year-changes or commit other sins of misNAEPery, I’m using data from the NAEP Long-Term Trend data series, which goes back to 1971 for reading and 1973 for math. Here are the scale score gains, on a 500-point scale, over the last four decades (* signifies statistically significant):

4th grade math

  • All students: +25*
  • White students: +27*
  • Black students: +36*
  • Hispanic students: +32*

8th grade math

  • All students: +19*
  • White students: +19*
  • Black students: +36*
  • Hispanic students: +32*

12th grade math

  • All students: +2
  • White students: +4*
  • Black students: +18*
  • Hispanic students: +17*

4th grade reading

  • All students: +13*
  • White students: +15*
  • Black students: +36*
  • Hispanic students: +25*

8th grade reading

  • All students: +8*
  • White students: +9*
  • Black students: +24*
  • Hispanic students: +17*

12th grade reading

  • All students: +2
  • White students: +4*
  • Black students: +30*
  • Hispanic students: +21*

There are at least four important things the data are telling us:

1. Although NAEP scores barely budge year-to-year, over the long term, NAEP scores are way, way up. Remember that no matter what happens this week.

2. Math scores are rising faster than reading scores. There’s nothing new to say here, except to note that this is a large-scale reminder that math scores are easier to improve than reading scores.

3. There are clear age trends emerging in the data. Fourth-graders have made greater gains than eighth-graders, and eighth-graders have made larger gains than twelfth-graders. In fact, we see statistically significant gains in both subjects and in all races, except the composite scores in 12th grade.

4. Changing demographics are masking how much NAEP scores have improved. Although all races are rising individually, scores are rising faster for black and Hispanic students than they are for white students or for the overall composite. As I wrote earlier this year, “Because NAEP takes a representative sample, it’s also vulnerable to something called Simpson’s Paradox, a mathematical paradox in which the composition of a group can create a misleading overall trend. As the United States population has become more diverse, a representative sample picks up more and more minority students, who tend to score lower overall than white students. That tends to make our overall scores appear flat, even as all of the groups that make up the overall score improve markedly.” Here are the percentage of NAEP 4th-grade test-takers who were white over the various testing years:

  • 1971: 84
  • 1975: 80
  • 1980: 79
  • 1984: 75
  • 1988: 75
  • 1990: 74
  • 1992: 74
  • 1994: 76
  • 1996: 71
  • 1999: 69
  • 2004: 59
  • 2008: 56
  • 2012: 53

These demographic trends are nearly identical at every age level, and they’re wreaking havoc on our ability to neatly understand our national results. As is clear in the data above, in both math and reading and at every age level tested, all races are improving at least as fast as the nation as a whole. Achievement gaps are closing as black and Hispanic students have made even faster progress.

Similar trends are playing out in other subjects like geography, history, and civics.

I note all this in anticipation that this week’s NAEP results aren’t likely to show much change from the last NAEP results in 2013. Scores may appear “flat,” but we should think of the entire American education system as like a glacier; it may be moving at an almost imperceptibly slow pace, but it is moving.

 

4 thoughts on “Over the Long Term, NAEP Scores Are Way, Way Up

  1. Jon Drescher

    Greatly appreciate this analysis. I think one trend that isn’t listed here, and is important, is the ever widening gap between high poverty and low poverty students at the 12th grade level. This is a disturbing trend. Of course, I don’t know what the 2015 scores will tell us, as yet. Thanks

  2. Leonie Haimson

    So why all the alarmist rhetoric by groups like bellwether that our schools are failing and need radical revamping through privatization, teacher evaluation based on test scores and the common core? Or is this just to satisfy the interests of your clients?

    And surely if the NAEP scores had risen you’d be claiming the success of all these nonsensical policies just the same.

  3. Ken Mortland

    Leonie: Assuming your question is not just rhetorical; here’s a possible response.

    If I want people to pay attention to me, my company, our education reform proposals, and our educational products, I must avoid any suggestion of improvement under the current system. Indeed, it would be better if I could bang the drum of incompetence to drown out any suggestions that the system is improving on its own. My leadership position and the success of my company are at stake.

  4. sandy kress

    Chad – this is a very good and helpful reminder. But there’s a key point you’ve missed. It’s not been a steady climb up. The 90s, for example, were flat. The 2000s were at least generally a superb climb up. And the trajectory from 2009-2013 has returned to being fairly flat.

    I agree with you that change from one round of testing to another might not reveal much, but patterns over decades do. I’ve written a good bit about this and will again after tomorrow’s release. While much of this sort of analysis must necessarily and only involve hypothesis until deeper research is done, it’s important to think out what’s happening in the policy world and the field that might relate to and possibly explain these clear trends in results. with the modesty that it’s only hypothesis, it’s important to try to begin to discuss and understand them.

Comments are closed.