Category Archives: Media

Class Grades

Since I am quick to criticize the media for its role in the failures of the current education reform movement—such as PBS, The Charleston Post and Courier, and Education Week—I must also recognize when a media outlet provides much needed insight into education policy that has clearly run off the tracks, such as the so-called Florida miracle and the enduring practice of assigning letter grades to schools.

In “Low-income schools struggle under state’s grading system” (Miami Herald, August 10, 2013), Michael Vasquez and David Smiley offer a clear but disturbing picture of accountability in Florida:

With dozens of changes in just the past three years, the formula behind Florida’s A-to-F school grading system has been criticized as a confusing mess. But there’s been at least one constant in Miami-Dade and Broward results: The wealthiest schools never get Fs, and schools with high populations of poor students face an uphill battle to even get a C.

The trend is visible through a decade-plus of school grade results, dating back to the first grades issued in 1999.

Vasquez and Smiley, along with the Miami Herald, represent a needed aspect of journalism addressing education reform: Recognizing large and compelling patterns, and thus the consequences of education policy.

The analysis of assigning letter grades to schools in Florida exposes some important conclusions:

•  Although high poverty rates don’t necessarily doom a school to a subpar grade, D and F schools are overwhelmingly serving students from poor neighborhoods, and the few schools that do overcome poverty to achieve an A are outliers. (There were nine such schools this year, all in Miami-Dade).

•  Of the 209 schools in Miami-Dade and Broward with at least 90 percent of students receiving free or reduced lunch, 78 percent received a grade of C or worse. Roughly 39 percent of these high-poverty schools received a D or F.

•  Of the 43 local schools with much lower poverty rates (30 percent or fewer students receiving free or reduced lunch), 86 percent received an A, and none received a D or F.

Despite efforts to identify educational quality among schools by focusing on growth models, data used in accountability policies remain primarily a reflection of out-of-school factors. Further, the schools that sit outside the typical patterns are rightfully identified by Vasquez and Smiley as “outliers.”

This analytical report on letter grades for schools in Florida is a strong example of quality journalism that seeks out and presents complex and detailed evidence, placing that data in the broader context of the many factors that impact not only the evidence we gather on our schools but also what conclusions we draw as well as how we draw those conclusions.

In the article, Miami-Dade Superintendent Alberto Carvalho explains, “‘Just as much as poverty can’t be an excuse, the exclusion of poverty as a factor is immoral.'”

Rare is the news article that allows a perspective this complex.

No Child Left Behind (NCLB) ushered in several grand promises in 2001, such as closing the achievement gap, but one of the central requirements of the legislation—the use of scientifically based research—is now poised to dismantle the entire accountability movement, including policies such as labeling schools with letter grades based primarily on test scores.

The evidence is clear that thirty years of accountability built on standards and high-stakes testing has failed. The next step is composing and sharing a unified message of that fact, while also building a coalition to reset the reform agenda so that we address poverty, equity, and opportunity in the lives of children and their families as well as in the schools those children attend.

Charter Schools: A Primer

Stakeholders in education include virtually everyone in a democracy—students, parents, teachers, politicians, business leaders, the media, and more.

Historically, public education in the U.S. has experienced two continual popular narratives: (1) public schools are failing, and (2) [insert reform here] is needed to overhaul schools for (a) international competitiveness and (b) a stronger workforce.

Recently, charter schools have seen a significant rise in advocacy and implementation as a complex mechanism for reform. Along with that rise has come a new wave of research on the effectiveness of those charter schools, particularly as they compare with traditional public schools (TPS).

Most stakeholders in education receive their information about charter schools from the media; thus, when the media covers the charter school debate and research, the influence of those media accounts can be disproportional to the quality.

For example, The Post and Courier (Charleston, SC) has taken a strong position for charter schools in SC: “But there is one area where the state has taken bold steps to improve education: charter schools.” However, an analysis of charter schools in SC that compares state report card data between those charter schools and  TPS using the state metric of “Schools with Students Like Ours” revealed in 2012:

Charter schools in SC have produced outcomes below and occasionally typical of outcomes of public schools; thus, claims of exceptional outcomes for charter schools in SC are unsupported by the data (3/53 ABOVE Typical, 17/53 Typical, and 33/53 BELOW Typical).

Since the pattern of advocacy and implementation of charter schools includes a significant amount of support from political leaders, business leaders, the media, and advocates (such as charter-based organizations and think tanks), most stakeholders need a clear and accurate primer addressing what we currently know about charter school effectiveness, and that must be guided by this caution from Matthew Di Carlo:

There’s a constant barrage of data, reports and papers flying around, and sifting through it with a quality filter, as well as synthesizing large bodies of usually mixed evidence into policy conclusions, are massive challenges. Moreover, we all bring our pre-existing beliefs, as well as other differences, to the table. There are no easy solutions here.

But, one useful first step, at least in education, would be to stop pointing fingers and acknowledge two things. First, neither ‘side’ has anything resembling a monopoly on the misuse of evidence. And, second, such misuse has zero power if enough people can identify it as such.

One overarching point needs to be made about the charter school debate first. Charter advocacy and criticism both too often fail in their use of data, as Di Carlo warns, but both also make another mistake, ignoring the evidence base entirely.

What, then, is the current state of evidence on charter school effectiveness? [1] And, how do charter schools address, or not, clearly identified problems and goals of TPS—including what questions and concerns remain in the context of what the evidence suggests about charter school effectiveness?

• Research has repeatedly shown that measurable outcomes (test scores, graduation rates, college admissions rates, etc.) from charter schools produce about the same range of quality as TPS (and private schools) and that the type of school structure (charter v. TPS) appears not to be a determining factor in the outcomes with the demographics of the students and the community remaining powerful correlations with those outcomes.

• Claims of “miracle” schools fail to stand up under close scrutiny, but even if outliers exist in charter schools, outliers exist in TPS and private schools as well, and thus, outliers may prove to be ineffective models for scaling any success.

• Charter schools do not appear to address and often seem to mirror or increase key problems with TPS: (a) teacher assignment (high-needs students assigned to inexperienced and un-/under-certified teachers), (b) class and racial segregation, (c) selectivity and attrition of students, (d) teacher turnover and retention [“churn”], (e) concerns about excluding the most difficult sub-categories of high-needs students [English language learners, special needs students, highest-poverty students, students from home that cannot or will not pursue choices].

• Charter school student outcomes are often complicated by issues of selectivity, attrition, and scalability.

• Some charter school ideologies—notably “no excuses” policies—trigger concerns about classism and racism that are rarely weighed against data.

• Charter schools (along with school choice and home schooling) introduce problems concerning athletic participation as well as a wide range of extracurricular participation in TPS.

• Charter schools also complicate already stressed and controversial TPS funding policies and agendas.

The charter school debate seems to warrant a similar caution that many other reforms now deserve, including VAM-style teacher evaluation. As Di Carlo explains:

As discussed in a previous post, there is a fairly well-developed body of evidence showing that charter and regular public schools vary widely in their impacts on achievement growth. This research finds that, on the whole, there is usually not much of a difference between them, and when there are differences, they tend to be very modest. In other words, there is nothing about “charterness” that leads to strong results.

With commitments to charter schools, many policy makers are moving too quickly and failing to examine the evidence so far along with weighing that evidence against clearly defined problems with TPS and specifically identified goals for the reforms.

—–

[1] A number of studies inform the list above. Readers are invited to examine a wide array of research and reports listed below, but also urged to search for new evidence:

Charter Schools Not the Answer, Especially if We Fail to Identify the Question, P. L. Thomas

Comparing Teacher Turnover In Charter And Regular Public Schools, Matthew Di Carlo

Charter Schools posts at The Shanker Blog

Search “charter schools” at NEPC

Charter Schools posts at School Finance 101 (Bruce Baker)

Charter Schools research at NCSPE

Search “charter schools” at EPAA

Between Educational Research and the Public, a Cloud of Misinformation

Walt Gardner, blogging at Education Week, has posted “Esoteric Formulas and Educational Research,” concluding (with a focus on the complex formulas used in pursuit of value added methods of evaluating teachers):

The point is that we are too accepting of research that relies heavily on esoteric formulas. I want evidence to support conclusions about educational issues. But the evidence has to be understandable. Just as legal contracts now are increasingly written with consumers in mind, I hope that educational studies will do the same in the future. Taxpayers are entitled to know if students are being well taught, but they can’t make that judgment when they are given incomprehensible data.

I would suggest that the greatest problem related to educational research is that a cloud of misinformation exists between good educational research/data and the public; and that this cloud is created by political leaders, think tank advocacy groups, and the media [1] who all either do not understand stats or purposefully misuse stats. I also believe some see the world only through a technocratic lens (such as the pursuit of VAM)—also a huge failure of applying appropriate paradigms in different contexts. Larry Ferlazzo has recently cited Nate Silver, who recognizes VAM as misguided: “There are certainly cases where applying objective measures badly is worse than not applying them at all, and education may well be one of those.”

Democracy and the market both work best for the public good when the public and consumers are informed. Political leaders, think tanks, and the media do no one any good by continually being inept themselves (and dishonest) in the use and misuse of research to drive political agendas or advance their own brand.

Some excellent resources to confront how badly educational research is portrayed for the public see the following:

Bracey, G. W. (2006). Reading educational research: How to avoid getting statistically snookered. Portsmouth, NH: Heinemann.

Molnar, A. (2001, April 11). The media and educational research: What we know vs. what the public hears. Milwaukee, WI: Center for Education Research, Analysis, and Innovation. Retrieved from http://epsl.asu.edu/epru/documents/cerai-01-14.htm

Yettick, H. (2009). The research that reaches the public: Who produces the educational research mentioned in the news media? Boulder, CO and Tempe, AZ: Education and the Public Interest Center & Education Policy Research Unit. Retrieved from http://epicpolicy.org/publication/research-that-reaches

[1] See chapters on the media in two of my most recent books: Parental Choice? and Ignoring Poverty in the U.S.