The Education Gadfly Weekly

Bad schools rarely die. This was the conclusion of Fordham’s 2010 report Are Bad Schools Immortal?, which discovered that out of two thousand low-performing schools across ten states, only 10 percent actually closed over a five-year period. On reflection, the finding was not too surprising: Shuttering schools nearly always sets off a torrent of political backlash, as authorities in Chicago, Philadelphia, and other urban districts have learned in recent years. And the reasons are understandable: Schools are integral parts of communities. They’re built into families’ routines and expectations, and closing them inevitably causes pain, disruption, and sadness, even when it’s best for students.

However, we also recognize that closing schools is sometimes necessary. In the charter sector, in particular, closure is an essential part of the model: Schools are supposed to perform or lose their contracts. That’s the bargain. And in the district sector, experience has taught us that some schools have been so dysfunctional, for so long, that efforts to “turn them around” are virtually destined to fail.

That doesn’t mean it’s easy to put bad schools out of their misery. Part of the difficulty is political, but it’s also a genuine moral dilemma: Are we sure that kids will be better off after their schools close? What is the quality of the remaining schools in their neighborhoods? Most importantly, do students gain or lose ground academically when their schools close and they are obliged to enroll somewhere else?

We know from personal experience how important, even agonizing, these questions are. In our role as a charter school authorizer in Ohio, we have blinked on a few occasions—choosing to keep marginal schools open because we worried that the children attending them might be even worse off if they had to move elsewhere. Were we right to do so?

To date, policymakers and practitioners have had precious little research to anchor their thinking and inform their decision making. We could only locate three relevant studies, and their conclusions differed on whether closures positively or negatively affected students.

The high stakes associated with school closures, and the paucity of prior research, led us to explore this terrain ourselves. The result is Fordham’s new study School Closures and Student Achievement: An Analysis of Ohio’s Urban Districts and Charter Schools, which brings to bear fresh empirical evidence on this critical issue. As it turns out, our home state of Ohio is fertile ground. Its large urban districts, referred to as the “Big Eight,” have faced sharply declining enrollment due to both shrinking populations and an influx of charter schools. Confronting the loss of more than fifty thousand pupils in just eight years, these districts have been forced to close scores of schools.

During the same period, dozens of charter schools have also closed for a variety of reasons, including financial difficulties and academic underperformance. In fact, Ohio’s automatic closure law, which is based on academic results, required twenty-three charters to close during the period of study.

Our study examined the achievement trends of 22,722 students in grades 3–8 who attended one of the 198 urban schools in Ohio that shut their doors between 2006 and 2012. These closures disproportionately affected low-income, low-achieving, and black students. To our knowledge, this is the first study to investigate separately the academic impact of closing charter schools. The study was conducted by Dr. Stéphane Lavertu of the Ohio State University and Dr. Deven Carlson of the University of Oklahoma, who used state records to examine the impact of closure.

Their most important finding is that school closure has significant positive impacts on the achievement of displaced students. The following figure displays the cumulative learning-gain estimates of displaced students by the third year after their schools closed. Displaced students from district schools that closed in urban areas gained, on average, forty-nine extra days of learning in reading relative to the comparison group; in math, it was thirty-four days. In the charter sector, students displaced from a closed school also made substantial gains in math—forty-six additional days—but did not make statistically significant gains in reading.

Figure 1: Impact of closure on displaced students, measured as cumulative student learning gains by the third year after closure

The analysts then focused on charter and district students who landed in higher-quality schools after closure, and there they found even larger cumulative learning gains. (We defined quality as a school’s contributions to student growth—its “value added,” in education parlance.) District students who landed in higher-quality schools gained an equivalent of sixty-nine extra days of learning in reading and sixty-three extra days of learning in math. When charter students moved to higher-quality schools, they gained an additional fifty-eight days of learning in reading and eighty-eight days of learning in math by the third year after their school closed.

We must register one caveat that tempers the positive findings on closures: When students displaced by closures enter their new schools, it is possible that they negatively impact the learning of students who had previously attended the school. Think of this as a possible “side effect” of the closure “treatment.” The study provides suggestive (but not conclusive) evidence that there might be minor side effects—the value-added scores of schools absorbing displaced students fall slightly. The net effect of closure remains an open empirical question.

These findings have two implications for policymakers. First, they should not shy away from closures as one way to improve urban education; they are a viable alternative to “turnarounds.”  As Andy Smarick and others have argued, fixing a chronically low-performing school is often more wishful thinking than promising strategy. Although successful school turnarounds are not impossible, Smarick is correct when he writes, “Today’s fixation with fix-it efforts is misguided.” This study adds hard evidence that shutting down low-quality schools could better serve students’ interests than endless (and fruitless) efforts to improve them.

Second, policymakers have to grapple with the mechanism of closing schools—whether they ought to shutter schools via top-down decisions or the marketplace. Interestingly, save for Ohio’s automatic closure law that was applied to a handful of charters, state policy did not directly shutter the schools in this study. Rather, population loss and the proliferation of school choice forced districts to close unneeded schools, while most charters closed due to stagnant enrollment, financial difficulties, or a combination of both.

In other words, Ohio’s experience with urban school closures was primarily market-driven. Families voted with their feet, and weaker schools withered and eventually died. And it worked. Most students—though not all—landed in higher-quality schools and made gains after closure. Could Ohio have done even better for its students, had school authorities closed schools more aggressively and strategically? Perhaps.

Though fraught with controversy and political peril, shuttering bad schools might just be a saving grace for students who need the best education they can get.

A vast amount of contemporary education policy attention and education reform energy has been lavished on the task of defining and gauging “college readiness” and then taking steps to align K–12 outcomes more closely with it. The ultimate goal is for many more young people to complete high school having been properly prepared for “college-level” work.

The entire Common Core edifice—and the assessments, cut scores, and accountability arrangements built atop it—presupposes that “college-ready” has the same definition that it has long enjoyed: students prepared to succeed, upon arrival at the ivied gates, in credit-bearing college courses that they go right into without needing first to subject themselves to “remediation” (now sometimes euphemized as “developmental education”).

But this goes way beyond Common Core. Advanced Placement courses also rest on the understanding that an “introductory college-level course” in a given subject has a certain set meaning and fixed standards. The people at ACT, the College Board, and NAGB have sweat bullets developing metrics that gauge what a twelfth grader must know and be able to do in order to be truly college-ready—again, in the sense of having solid prospects of succeeding in credit-bearing college courses in one subject or another.

Lying beneath all this are a thousand sad sagas of students who complete high school near the top of their class, having met all graduation requirements and gotten good grades, only to discover upon arrival in college—even community college—that they are not prepared to succeed. (That’s why so many colleges and universities, particularly the open-admission kind, administer their own placement tests to incoming students. High school success is enough for entry, but it just won’t cut it when it comes to readiness for college-level academics.)

All of which has led to the embarrassment and expense and frustration of widespread on-campus remediation. Matriculating students by the kazillion (it really does reach 75 percent in some colleges) are sent into high-school-level—even middle-school-level—courses that yield them no credit toward a college degree and often lead to discouraged kids dropping out. Such courses also cost plenty, whether that cost is borne by students (with loans!), parents, or taxpayers. When successful, though, they really do qualify students to tackle credit-bearing, college-level courses that can yield a degree of some worth in the real world.

The idea of graduating more “college-ready” kids from high school is intended to lighten the remediation burden, soup up the K–12 curriculum, shift graduation expectations from course completion to standards attainment, make college attendance and completion closer to universal (especially for poor and minority kids), bring overdue alignment to the junction between K–12 and higher education, and ultimately reduce the costly, dysfunctional exasperation of millions of college students taking classes that yield no college credit. Make the K–12 system do it right the first time!

But what if “college-ready” no longer means that you actually have to be prepared to succeed in credit-bearing college courses? Or if “credit-bearing courses” are so diluted that more people appear “prepared” to succeed in them, even though such success means less than it once did?

I’m not imagining this scenario. It’s beginning to play out in the unreal world of American higher education, including perhaps the most surprising place of all: the Commonwealth of Massachusetts, site of the much-lauded “Massachusetts education miracle.” Take, for example, recent actions from the Bay State’s Board of Higher Education. Among its myriad questionable decisions, the state now permits a 2.7 high-school GPA to substitute for passing a college-administered placement test. In practice, this means that high school teachers will set the “college-ready” bar every time they give students a grade of B-minus or better. Worse, a kid with a D in math but good grades in photography, gym, and basket weaving could easily end up with a 2.7 GPA and find himself in a credit-bearing college math course. And we haven’t even mentioned the wide variability in grading standards from classroom to classroom, school to school, district to district, and state to state. So much for Common Core—and every other attempt to forge uniform academic standards.

If you’re not already ill, consider what happened when they did something similar in Florida’s twenty-eight “open-access” institutions of higher education:

Alarmed by the high dropout and failure rates for college students who start out in remedial classes, Florida lawmakers voted last year to make such courses, and even the related placement tests, optional for anyone who…earned a [high school] diploma….The optional-remediation law is forcing professors in college-level composition classes to spend time on basic sentence structure, while mathematics teachers who were ready to plunge into algebra are going over fractions.

Not only is middle school content finding its way into college classrooms, college credit is being awarded for learning it!

Talk about “defining deviancy down”!

Worse, this dumbing down—always with the noblest of intentions, of course—carries the imprimatur of advocacy groups like Complete College America, headed by respected former Indiana Commissioner for Higher Education Stan Jones and generously supported by the likes of Gates, Carnegie, Helmsley, and Lumina. These folks staunchly support the Common Core, too, “college-ready” and all (and some of them support our work at Fordham). Is it possible they don’t see the contradiction between “college-ready” and “corequisite remediation,” one of the five big “game changers” being pushed by Dr. Jones and his team (and being snapped up by at least three states, according to their website)?

Their intentions really are noble. We know that placement exams aren’t perfect, and some kids who could do credit-bearing work are being put into remediation, where they get demoralized. But those are students near the college-ready bar, not functioning at the level of middle school math. And this problem can be tackled by adding relevant information to the college’s course placement decisions, not by substituting meaningless GPAs for on-campus placement.

What, you may reasonably wonder, is “corequisite remediation” besides gobbledygook? Here’s the key sentence: “Make enrollment in college-level courses the default for many more students.”

Which means, of course: Do not send them to remediation, no matter how ill-prepared they may be for college-level work as traditionally defined. Put them in credit-bearing courses anyway.

Yes, some students (and some professors) will rise to that challenge. But what’s the surest way to make this “default” strategy succeed, and thereby prove that it was a great reform? You don’t need a college education to answer that one! Just teach fractions and sentence structure to students in courses that you label “college-level”—even though they’re not. Dumb ‘em down. Cheapen the currency. And again defraud the students (and anyone who might someday contemplate employing them) into believing that they really were prepared for college and are now getting a college education, even though neither of those statements is actually true.

Recent days have brought further evidence that the “everyone should go to college” campaign remains powerful, not just in the United States but in many other parts of the world. And all this insistence comes with practically no attention paid (as editors of The Economist noted the other week) to whether anybody is actually learning anything in college. There’s a strong possibility that that sought-after degree is more “signaling credential” than evidence of a well-stocked brain.

There’s already concern about the integrity and value of the college degree. This isn’t just because there are so many more of them, but also because of mounting evidence that many people earning them still have troubling gaps in their skills and knowledge. More and more employers now seek either postgraduate degrees or entirely different kinds of credentials having more to do with demonstrated competency than with credits earned. Research also shows certain degrees—in specific fields and/or from specific institutions—to be far more valuable than others. The last thing American education needs—and a potentially mortal wound to other reform efforts—is to further cheapen the meaning of “college-educated.” Which cannot be severed entirely from the meaning of “college-ready.”

Aside from generalized fretting over “curricular narrowing,” educators and education policy types have been so consumed in recent years by the crises of the moment—the fracases over Common Core, the new assessments (and their opt-outers), the worrying achievement reports that may follow in the autumn, and how all that does or doesn’t intersect with NCLB reauthorization—that practically nobody has focused on “social studies” courses like history, geography, and civics. (Yes, there have been pot-shots aplenty at the AP framework for U.S. history, but little or no attention to what’s happening in earlier grades.)

Today’s hot-off-the-presses NAEP results should refocus us, at least briefly, because they’re anything but hot. In truth, they’re chilling.

NAEP tested eighth graders in all three subjects last year, and the reports are just out. The bottom line: “In 2014, eighteen percent of eighth graders performed at or above the Proficient level in U.S. history, 27 percent performed at or above the Proficient level in geography, and 23 percent performed at or above the Proficient level in civics.”

Which is to say that three quarters of the kids are less than proficient, a worse showing than in reading and math (both now around 36 percent proficient among eighth graders). And they’re not getting better, even while there’s been modest improvement in both subjects at the center of standards-based reform. And, as always, the news gets more complicated—but not much better—when the student population is disaggregated. Although individual racial subsets do show gains (masked in the overall scores by the phenomenon known as “Simpson’s Paradox”), it remains the stark fact that “proficient” black and Latino youngsters numbered only in the single digits in 2014.

Overall, these data mean that the overwhelming majority of American fourteen-year-olds cannot correctly answer questions like this one:

Which of the following is a belief shared by most people of the United States?

A.    The country should have a single political party.

B.     The country should have an official religion.

C.     The government should be a democracy.

D.    The government should guarantee everybody a job.

Particularly as another election season heats up, it’s not crazy to ask whether we Americans truly know enough to govern ourselves wisely.

If that thought is too cosmic or depressing, you can instead reflect on the challenge awaiting our high schools (and colleges) as these kids walk through their doors. But since nobody is paying any attention to history, geography,y or civics, it’s hard to imagine those institutions successfully rising to that challenge.

Thanks, NAEP, for another freezing shower.

• There are no fearsome beasts or rings of fire, but Marc Tucker’s newest jeremiad for Education Week is an apocalyptic prophecy worthy of a revival tent. Speculating on the origins of our collapsed standards, Tucker settles on four horsemen of academic mediocrity: grade inflation, the eroding prestige of the teaching profession, a standards movement hijacked by the accountability movement, and the consumer transformation of colleges and universities. Taken together, he claims, these factors have produced four decades of educational stagnation and a climate in which colleges teach high school math—and high schools teach grade grubbing. As Fordham’s own Chester Finn reminds us, we’ve been dumbing down our expectations for decades, and the results justify some doom saying.
• Like the rose that grew from concrete, the inimitable Dan Willingham has taken his talents over to the Washington Post’s Answer Sheet blog for a five-part series on reading. His terrific posts, of which three have been published so far, advance arguments from his new book. They will also raise points familiar to fans of Fordham’s own literacy guru, Robert Pondiscio. In the first, Willingham mounts a defense of the Common Core standards as a powerful catalyst for early literacy. By building a strong base of knowledge in subjects like science, social studies, and geography, he writes, the standards prepare young readers for a world of diverse texts. Robert’s been banging that drum so long (often by referring to Willingham’s research) that we only let him talk about baseball now. Editors at major newspapers: Who’s interested in an ongoing column focused on civics education and the National League East?
• In a perfect long read for the weekend, Commonwealth Magazine offers a thorough and bracing take on the New York Mets of state education outcomes, Massachusetts. After enacting landmark reform legislation more than twenty years ago and passing a sorely needed update in 2010 (note to Congress: Renew your education laws), the state famously leapt from middling academic performance to front-runner status. It still oversees pockets of persistently disappointing school failure, however, in economically troubled cities like Lawrence and Springfield. The article provides a great look at the new Republican governor’s efforts to deal with the familiar issues of poverty, high-stakes testing, and turnaround schools.

Ed reform’s low-hanging fruit, opting out, a grim view of American education, and the academic achievement of voucher students.   

Amber's Research Minute

Alyssa Schwenk:          Thank you, thank you Mike, should I call you Key and Peele now?

Mike Petrilli:               I don't even know who that is, I don't know who many people are. When we started this show like ten years ago, I sometimes knew the pop culture references, now it's all over my head. I guess Cecily Strong, she's on Saturday Night Live and she hosted White House Correspondence Dinner.

Alyssa Schwenk:          I'm just, I'm always happy when we don't do a sports reference because anytime I'm co-hosting with you or Robert, I'm like please don't choose a sports reference. You're going to ask me something about an athletic endeavor and I don't know how to do any of those. I kind of know this reference though.

Mike Petrilli:               It's great to have Alyssa back on the show. Alyssa, among other things, helps us raise money.

Alyssa Schwenk:          I do do that.

Mike Petrilli:               Hey we can do it like a public radio show.

Alyssa Schwenk:          Like a telethon?

Mike Petrilli:               Yeah. Hey if you just want to right now just write out a check to the Thomas B. Fordham Institute, send it in.

Alyssa Schwenk:          Send it in, we'll take it.

Mike Petrilli:               They'd be awesome, 1016 16th Street Northwest Washington, D.C. 20036.

Alyssa Schwenk:          C/O: Alyssa Schwenk.

Mike Petrilli:               Yes. Go ahead, 10 bucks, 20 bucks, anything, every little bit helps people. We don't really do a whole lot of that, do we?

Alyssa Schwenk:          We really don't, I mean it works for Big Bird and the folks at PBS maybe that's a strategy that we should do.

Mike Petrilli:               We should have a Gala, that'd be awesome.

Alyssa Schwenk:          That'd be fun, I like fancy clothes.

Mike Petrilli:               We have a lot of fancy people up at Fordham now so maybe we could pull that off.

Alyssa Schwenk:          We do.

Mike Petrilli:               All right hey lots to cover, busy week, let's get started, let's play Pardon the Gadfly, Ellen, let's go.

Ellen:                           The New York Times’ Nicholas Kristof argued in his column last week that pre-k is low hanging fruit compared to K12 ed reform. Do you agree?

Mike Petrilli:               I think he's bananas!

Alyssa Schwenk:          I think that's a pretty good word for it. I'm a former kindergarten teacher and this makes me really scared, please stay out of ECE.

Mike Petrilli:               Stay out of Early Childhood Education. His argument is that politically this should be a lot easier, that education reform has turned into this long, long, bloody war. Whereas early childhood should be relatively easy.

Alyssa Schwenk:          You know it's all just blocks and letters in early childhood.

Mike Petrilli:               See this is where ... I just don't quite understand where he's coming from. Look, I don't doubt that education reform is hard and we probably have done the easy stuff and now it's about the execution and it's about continuing to fight some very difficult political fights. Pre-k is not easy to figure out how to make sure you do high quality pre-k at scale? We don't really know how to do that. It's expensive and you know that means raising new money, that means maybe raising taxes, none of that's easy politically.

Alyssa Schwenk:          No and right now I think the argument is education used to be this thing that everyone could agree on and everyone in theory agrees that if we can get kids earlier, yes that will help close an achievement gap. It's a very values late in proposition, you have people who care a lot about parental freedom and parents making their own choices for kids, like kind of positioning that against the good of society. How early do we start interventions for kids? How far into homes do we go? How much do we tell parents these are good things that you should do? How do we nudge them and maybe right now, yes, it's probably not as polarized as east as education but we get in there and it could very quickly become as bloody as K12 is.

Mike Petrilli:               Yes well said. Okay, topic number two.

Ellen:                           What are parents trying to tell us about opting out of tests and is New York, where in one district 70% have opted out, an anomaly?

Mike Petrilli:               Alyssa this to me is an important question and I don't feel like we have good answers. This is no longer just something that is hypothetical or people are complaining on Twitter about testing. We see tens of thousands, hundreds of thousands of parents saying that they don't want their kids taking a test. This is a big deal now, it's mostly in New York at this point. What's not totally clear is, to me at least, is the message the parents are trying to send versus the advocacy groups.

Alyssa Schwenk:          Right I mean what's the ... Your kid sits out the test, what happens next? I guess that's kind of the mystery to me and I'm not a parent.

Mike Petrilli:               No, no, no, not even that Alyssa, I mean literally what do they ... What are they trying to say, is it that they don't believe in testing and accountability? Is it that they don't like what testing has done to there schools? Is it this concern about ... For example you could say, "Well I don't like the fact that my kid has to take several days out of their school year and sit down and take the test." It's literally the testing.

Alyssa Schwenk:          That's reasonable.

Mike Petrilli:               Right, or is, "Well I fell like my school has gotten rid of art and music and all the other stuff because they're so obsessed with getting better test scores." Is that what's happening because I'm little surprised because most of these parents are in more affluent areas and have those affluent areas really gotten really gotten rid of art and music because of testing?

Alyssa Schwenk:          I kind of want to say no but I'm obviously not in New York so I don't know if that's necessarily the reason. I mean we've seen affluent parents opt out throughout the years, they've sent kids to private schools, they've moved to new suburbs that have new schools that they say are better. We've seen parents make choices for their kids in the past, like over the past several years. My best guess is it's something along those lines, but just why?

Mike Petrilli:               We don't know. Listen, how about this, 2 years from now when we see the Common Core test scores have come out now all over the country. Keep in mind, New York was 2 years ahead of everybody else. Are we going to see this go national, are we going to see this happen everywhere, or is there something unique about New York that is causing this problem?

Alyssa Schwenk:          What's your prediction? We'll come back in 2017.

Mike Petrilli:               I am hopeful that it is going to be limited, at least at this extent, to New York. This really is people are angry at Governor Cuomo, they feel like, teachers particularly feel like he's been stiffing them in the eye. He's got a vendetta against them and so the unions have been actively encouraging parents to opt out. This may be something combined with his unwillingness to compromise on teacher evaluations. You can make the case that in New York there really is a lot of pressure to pay attention to these tests now because of the degree that they're linked to teacher evaluations.

Alyssa Schwenk:          Yeah, it's up to what, 20 ...

Mike Petrilli:               50%, whereas the rest of the country has largely backed off that, at least for a few years. A couple years from now when we get back into the teacher evaluation thing based on test scores, most states have said we're going to reduce the amount driven by test scores. I hope that helps because if this goes national, this whole school reform is in serious trouble.

Alyssa Schwenk:          A whole lot of trouble. Yeah, I hope you're right, I think I agree. I think it's a very pressurized situation and I hope in a couple of years it will have died down and we'll have a new normal.

Mike Petrilli:               Okay. Topic number 3.

Ellen:                           Mark Tucker recently painted an exceedingly grim picture of American education, including a claim that standards have collapsed across the board over the last 40 years. Is the situation really that dire?

Alyssa Schwenk:          Pretty grim article.

Mike Petrilli:               They really, he should have titled it We're Going to Hell in a Hand Basket.

Alyssa Schwenk:          Just buckle up.

Mike Petrilli:               Yes exactly. It's interesting and this guy's a big lefty, right, he's not some right winger complaining about public schools. Here's a guy on the left and he was saying starting way back when by saying that basically now we have high school level course work being done at the college level and people getting credit for it. That at basically every level of our schools were just passing kids along, grade inflation, lower standards. Interestingly one thing he said Alyssa was the accountability movement hijacked the standards movement.

Alyssa Schwenk:          Standards movement, I saw that yeah, I thought that was really interesting way of putting it.

Mike Petrilli:               Do you think that's right?

Alyssa Schwenk:          I think to some degree for sure. We had this kind of accountability movement that started late '90's, early '90's I guess, we needed something to hold people accountable and standards were the easiest thing to kind of link that too.

Mike Petrilli:               What it became was really a focus on equity, the accountability got linked to getting the lowest performing kids up above a fairly low bar. That was what No Child Left Behind was all about and it's made real progress. You look at the lowest performing kids in this country they are reading and doing math 2 to 3 grade levels ahead of their peers from 20 years ago.

Alyssa Schwenk:          Yeah and that's great but it does, he really got out this tension between this equity bar and also this access bar and there's trade offs there.

Mike Petrilli:               Were the excellence, equity and excellence. Here what we're trying to do now with Common Core is say look now we're going to set the standard at the real world standard of what kids need to be ready for college or for career. It's a much, much higher standard and we're hoping that our schools can rise to the challenge and get lots more kids over that higher standard. It raises questions, can we do that without seeing the progress we've made for the lowest performing kids go away and that's the tension. Plenty of people in high poverty schools say, "Oh my god, my kids are so far from those Common Core standards it's just demoralizing to them and to me." I have some sympathy for that point of view but you know somehow going back to just driving the whole system based on low standards doesn't make sense to me either.

Alyssa Schwenk:          Yeah, I think he did a really good job of just highlighting how we got here and why it's so important that we continue to kind of drive up.

Mike Petrilli:               Yup. Okay dokey, that's all the time we've got for Pardon the Gadfly this week. Now it is time for everyone's favorite Amber's Research Minute. Amber welcome back to the show.

Amber:                        Thank you Mike!

Mike Petrilli:               Amber big day here at Fordham, we released a big study on school closures in Ohio.

Alyssa Schwenk:          It's pretty exciting.

Mike Petrilli:               This was an important question, school closures are difficult you know as a charter school authorizer that is hard to look at a school and think about closing it down, you worry about where the kids are going to end up. The good news is that in Ohio, both the charter and the district sector by in large when schools have been closed and quite a few of them closed in the last several years. The kids end up in better schools and they do better as a result.

Amber:                        Great news,

Alyssa Schwenk:          Great news!

Mike Petrilli:               What's most surprising Amber is that they do better almost immediately that you expect because of student mobility that they might ...

Amber:                        It's going to take a while to put together.

Mike Petrilli:               In the first year after the closure they were performing better.

Amber:                        Yeah that's right. I mean it's got to have something to do with the culture too right? I mean just the teachers and the ... I mean who knows, who knows what it is. Whatever it is, it was just phenomenal news I think for all of us who fret, are they going to a better place anyway? Are we doing them more harm than good? Simple question, really neat findings.

Mike Petrilli:               For our podcast listeners, a little inside here, this study, like a lot of the good studies lately, of course it has results based on standard deviations than they turn that into what that means for them. How many extra days of learning the kids are getting after they go to these new schools. We were writing an op-ed for the Wall Street Journal and they sort of got that but they really wanted it in percentiles. Well what they want to say, where do the kids start on average in terms of percentiles and where do they end up? At the last minute we're scrambling, we have our researchers who are fantastic going back and get these numbers. It is so sobering, even with these huge gains where they made something like, I don't know 5, 6 weeks of gains of learning over the course of the year. On average the kids went from the 20th percentile to the 22nd percentile.

Amber:                        Yeah wow.

Mike Petrilli:               Granted these are the lowest performing schools in this day and so of course these kids are very low performing. The point is even when they make big gains their still very low performing compared to everybody else. Somehow Amber I've been trying to figure out how to help our fellow reformers understand that kids can make a lot of progress and still be no where near ...

Amber:                        Proficiency.

Alyssa Schwenk:          The proficiency.

Mike Petrilli:               Because they just start out so far behind.

Amber:                        I don't know what the answer to that is, I mean we still need both right? We still need the high bar but we need to recognize that how far away that they are, like the reality check that you just gave us.

Alyssa Schwenk:          Yeah and how far they can come.

Mike Petrilli:               I want to make all reformers take a math class. I think we should offer a remedial math class, statistics 101.

Amber:                        Add it to Ed Policy 101.

Mike Petrilli:               All right enough about that, what excellent study do you have for us today?

Amber:                        Well, I have a new study out by Friedman and then let's just say that it was challenging in terms of their methodology, but we'll talk about that wanky stuff in a minute. It was called the Achievement Checkup, tracking the post elementary outcomes of Baltimore need based scholarship students. It's looking in at kids in Baltimore who received a scholarship to go to a private school, right.

Mike Petrilli:               Interesting this week in light of the news in Baltimore.

Amber:                        Very tough. They're looking at high school experience, graduation rate and post secondary attendance rates of the students who got these scholarships. They could use it through kindergarten through 8th grade so not in high school. They actually want to see what are the impacts of having this scholarships in the elementary and middle grades. That means up 2 to 9 years, the scholarship range for the sample, about 2,000 dollars a year, so not a ton of money. They surveyed parents of former scholarship recipients 3 to 8 years after those kids had completed the 8th grade. The sample has recipients who had received at least 1 year. Kind of a low bar for inclusion of the sample but the average was 6 years of the scholarship support. They then completed 8th grade between 2004 and 2010. The problem with the methods, basically they weren't able to compare the results to students who had applied for but didn't receive the scholarships since they didn't track those kids, I mean that's kind of what we like to do, right?

Alyssa Schwenk:          Right.

Amber:                        Further the sample is kind of one of convenience because the students, they had about 36 hundred scholarships offered in total. They could track down only 322 of those recipients, of the 322, just 136 responded to the survey.

Mike Petrilli:               You got to assume those kids, those families are different.

Amber:                        Are different. We got all kind of selection, we got all kinds of bias in every which way. The analyst say, to their credit, that this study needs to be thought of more as a qualitative study, right, given the number. With all those caveats in mind their key findings, 84% of those who responded were enrolled in some type of college, pretty high. 5 to 10 years after completing 8th grade, 2% were still in high school, 1% entered the military. 14% did not attend college immediately after graduating, of those who did indicate the type of college. 73% were in 4 year colleges, 27% in 2 years. Then they kind of try to say let's look at some other studies that are similar since we don't have the comparison group. The study most similar to theirs found that 53% were enrolled in 4 year, and 47 in 2 years. A little bit more sobering I think result because 84 was pretty high, right? Then finally college enrollees were more likely than scholarship alumni who did not enroll in college. They did do that comparison of the kids who didn't go but did receive the scholarship.

                                    They basically found that they took a lot of advantage of the college counseling that was available that was at their schools. They were more likely to attend school sponsored college trips, they were more likely to attend a high school that offered admissions test prep and they were more likely to take a test prep class. They were more likely to attend a school that offered college financial planning. All these resources that actually kind of get kids thinking about, you're going to go to college and this is what ...

Mike Petrilli:               …scholarships were not for high schools.

Amber:                        Right.

Mike Petrilli:               Right so it stopped in 8th grade but they landed in maybe better high schools for these kinds of reasons.

Amber:                        That's what they found.

Alyssa Schwenk:          Interesting.

Amber:                        Anyway it's hard to, you know, I mean the study has some method issues but they ended up saying we needed to try ... The scholarship organizations need to partner more thoughtfully with these high schools that offer these types of resources for kids. College planning, college resources, whatever you want to call these things. Which seems sensible no matter what the study had found, right?

Mike Petrilli:               Yes, although as I always have to point out is you know college is. It's a good pathway, it's not the only pathway. Be curious if any of those kids end up going to a career in the Technical Education route as well.

Amber:                        Just 1% in the military, that's pretty low.

Mike Petrilli:               These kids, there must have been an income threshold but if they only got 2,000 bucks they couldn't have been the poorest families right?

Amber:                        Right, I think they actually had to do a match of 500 dollars.

Mike Petrilli:               Okay.

Amber:                        That's some skim in the game.

Mike Petrilli:               Yeah, yeah, makes sense. Well interesting stuff, not quite as amazing a study as our school closures.

Alyssa Schwenk:          Hard to top our study right now.

Mike Petrilli:               Yes, it is a pretty amazing study. All right, well that is all the time we've got for next week, until next.

Alyssa Schwenk:          I'm Alyssa Schwenk.

Mike Petrilli:               I'm Mike Petrilli at the Thomas B. Fordham Institute, signing off. 

In the age of iPads and Fitbits, how should educators harness new technology to improve student learning? In his new book, The Game Believes in You: How Digital Play Can Make Our Kids Smarter, Greg Toppo recounts how innovative educators are changing traditional classroom instruction by incorporating digital play.

Citing cognitive research and visiting schools that have incorporated gaming, Toppo dives into the many questions and concerns of parents, teachers, and policymakers: Does incorporating games improve student achievement? Should students be reading Thoreau’s Walden or does an online game where students follow in Thoreau’s footsteps suffice? How can the use of games complement classroom instruction rather than distract from it? How can we ensure that students have access to these tools regardless of income?  And is all of this truly effective or merely trendy?

Education technology in general—and digital games specifically—can be easily dismissed as yet another Next Big Thing that’s doomed to disappoint. If your standard prescription for schools and teaching is high standards, rigorous instruction, and rich curriculum, you might be tempted to roll your eyes at Greg Toppo’s new book on the potential of digital games to change K–12 education, The Game Believes in You. Toppo is no pie-eyed fanboy nattering on about digital natives, paradigm shifts, innovation, and disruption. The national education reporter for USA Today and a former classroom teacher, Toppo makes a compelling case for games as not merely engaging, (the default setting for mere enthusiasts and marketers) but cognitively demanding. A well-designed game is fun, but it’s rigorous fun.

Toppo makes a convincing case that savvy teachers have always used games to involve kids in learning. He’s at his best describing games like DragonBox, a “lovely, mysterious, and a bit off-center” diversion that seems unusually good at getting pre-schoolers—yes, pre-schoolers—to think algebraically. Likewise, what is a multi-level game if not an adaptive assessment that kids want to participate in? But the most compelling argument running through the book is the infinite malleability of well-designed games. If differentiated instruction is the fool’s gold standard of effective teaching, games hold out the promise of a new and rich seam of the real thing. “A well-designed game sits and waits...and waits,” he writes. “It doesn’t care if that wearisome math problem takes you fifteen seconds or four hours. Do it again. Take all day. The game believes in you.” It also knows students and their abilities better than anyone. The right game, Toppo makes clear, can be something close to a perfect differentiation and assessment engine.

The “well-designed” bit is, of course, the rub—and where the mischief begins. In a chat about the book at Fordham, Toppo quipped, "I really hope that gaming is not the Next Big Thing in education. Because the Next Big Thing in education always sucks. It always fails. I hope it's the Next Small Thing, and it just keeps going under the radar. Keep it away from the real rule-makers." Wise fellow. Many educational fads start out as compelling insights, then collapse beneath the weight of enthusiasts’ cheers and the hucksters’ attempts to cash in. 

I came to The Game Believes in You as a skeptic. I finished it as an agnostic—I’m willing to be convinced that well-designed games have much to teach those Toppo calls “the real rule-makers” about differentiation, assessment, and curriculum—not just student engagement.

SOURCE: Greg Toppo, The Game Believes in You: How Digital Play Can Make Our Kids Smarter (New York: Palgrave Macmillian, 2015).

A February study from the Center for Education Data and Research aims to determine if National Board Certified Teachers (NBCTs) are more effective than their non-certified counterparts. Established in 1987, National Board Certification is a voluntary professional credential designed for experienced teachers in twenty-five content areas. Certification is awarded through a rigorous portfolio assessment process consisting of four components: content knowledge; differentiation in instruction; teaching practice and classroom environment; and effective and reflective practices. These components are analyzed via teacher “artifacts,” including videos of classroom lessons, student work, and reflective essays. Across the country, more than 100,000 teachers, or roughly 3 percent of the teacher workforce, are National Board Certified.

This study examines data out of Washington State, which boasts the fourth-highest number of NBCTs in the country. Washington provides financial incentives for teachers to earn board certification, including bonuses of up to $5,000 for teachers working in high-need schools. The study finds that, compared to average teachers with similar experience, NBCTs produce additional student learning gains on state exams that correspond to about 1–2 additional weeks of middle school reading instruction. In middle school math, the results indicate a whopping five weeks of additional learning compared to non-NBCTs with similar experience. In other words, NBCTs post strong “value-added” results. The researchers also find that teachers with higher scores on the national board assessment program are more effective than those with lower scores: An increase of one standard deviation in teacher assessment scores corresponds to 3–5 weeks of student learning gains (though this varies across certification areas).

An interesting component of national board certification is the option for teachers to “bank” their scores—if a teacher fails to earn NBCT certification on their first attempt, they are permitted to keep their scores in areas where they did well and resubmit their work in areas where they performed poorly. When researchers took a closer look at teachers who don’t achieve certification after their first attempt, they found no evidence that initially unsuccessful NBCTs are more effective than non-NBCTs—except in the case of middle school math, where initially unsuccessful NBCTs are still more effective than those who never earn certification. Even more fascinating: Initially unsuccessful NBCTs are less effective than NBCTs who successfully earn certification on their first attempt. This leads the researchers to conclude that, although variations exist depending on the type of national board certification, a teacher’s first attempt at national board certification “contains more useful information about teacher effectiveness than subsequent attempts.” Nevertheless, the big takeaway here is that NBCTs are more effective overall than non-NBCTs. Whether the student achievement gains are worth the program’s significant cost is a question for another day.

SOURCE: James Cowan and Dan Goldhaber, “National Board Certification and Teacher Effectiveness: Evidence from Washington.” Center for Education Data & Research (February 2015).