Anne Hyslop
Policy Analyst, Education Policy Program
鈥淎ll you have to do is beat the mean鈥 was the mantra that helped me survive three years of undergraduate pre-med courses. Organic Chemistry, Physics, Botany, and the rest of the lot were horrible, but at least they were graded on a curve. To pass, I didn鈥檛 have to actually pass鈥擨 just had to do better than most of the other miserable students in the lecture hall with me.
All you have to do is beat the mean.
It turns out that school accountability today works in much the same way. February marks two years since states were first awarded waivers from No Child Left Behind (NCLB) and given the green light to experiment with new school accountability approaches. While all schools are still subject to NCLB-like performance targets, the consequences for missing those targets matter much less than before. What really matters under waivers is landing in the bottom 15 percent of schools: the priority and focus schools that must receive state interventions, supports, and resources to improve student outcomes. Clear the 15 percent bar, and schools escape the strictest consequences. In other words, a school鈥檚 absolute level of performance matters less than its performance relative to others鈥攋ust like my Physics grade. I may have gotten only half of the questions right on the midterm, but that was good enough for a 鈥淏.鈥
What really matters under waivers is landing in the bottom 15 percent of schools: the priority and focus schools that must receive state interventions, supports, and resources to improve student outcomes. Clear the 15 percent bar, and schools escape the strictest consequences.
This new 15 percent accountability approach has had far-reaching effects. Using data collected from over 20,000 schools in 16 states during the transition from NCLB to waivers, the latest report from 麻豆果冻传媒, 鈥,鈥 finds that nearly 4,500, or 65 percent, of schools in NCLB improvement were eased from these interventions between the 2011鈥12 and 2012鈥13 school years.聽In these states, two in three so-called 鈥渇ailing鈥 schools were no longer 鈥渇ailing鈥濃攁t least not enough to warrant the priority or focus label. Further, these schools were often in the most serious NCLB improvement phases:
The number of schools identified has also changed significantly in waiver states:
While the 15 percent strategy created a defined number of school improvement slots, states could also measure their performance in new ways, changing how they viewed a school鈥檚 relative success. The effects of these state choices are less dramatic than the switch to relative measures, but they do shape the kinds of schools that fare well in the new system. It鈥檚 like a university adopting a curved grading policy at the same time that professors in the Chemistry department adopt new Organic Chemistry course sequences, syllabi, and assessments. Both decisions affect student performance, but the new institutional grading policy probably matters more.聽States鈥 waiver choices鈥攊ncluding student growth measures and new kinds of student subgroups鈥攃ould influence whether the 鈥渞ight鈥 schools made the 15 percent cut, but more and better data are needed to determine the scope of this influence, why certain schools did, and did not, get identified, and whether this changed a school鈥檚 long-term chances for improvement.
As relative school accountability becomes the norm (pun intended), states shouldn鈥檛 forget about student outcomes and absolute measures of school performance. Grading on a curve may have helped me pass my pre-med classes, but it didn’t mean I knew the material well enough to be a doctor. Then again, I would have also had to eventually pass a medical licensure exam to practice, a criterion-referenced assessment where absolute performance matters. If identification as a priority or focus school is a prerequisite for significant improvement and student success, states should ensure that the schools needing this level of support are included in the category鈥攅ven if it means expanding their capacity or adding safeguards to their accountability systems to ensure certain kinds of schools are always identified.
鈥溾聽concludes with an ambitious federal and state research agenda for waiver implementation, especially as the Department begins to聽聽states鈥 waivers at the end of the 2013鈥14 school year.聽A 15 percent approach to accountability may make school improvement efforts more manageable for state departments of education, but does it lead to better outcomes? To more students鈥攔egardless of race, or income, or zip code鈥攇raduating high school prepared for college and the workforce?
We don鈥檛 have enough data yet to answer these questions, but it鈥檚 time to start asking them.
Click to read the full report.”