Tag Archives: Daniel Willingham

Education, Educational Research, reading

Beware the Technocrats: More on the Reading Wars

1 Comment

Since it is Academy Awards season, let me start with film as context.

Whiplash has received a great deal of Oscars buzz with five significant nominations. But that film praise is interesting to frame against a review that considers how the film’s topic, jazz, is portrayed:

The mediocre jazz in Damien Chazelle’s new film, “Whiplash,” the story (set in the present day) of a young drummer (Miles Teller) under the brutal tutelage of a conservatory professor (J. K. Simmons), isn’t itself a problem. The problem is with the underlying idea. The movie’s very idea of jazz is a grotesque and ludicrous caricature.

“Mediocre,” “grotesque,” and “ludicrous caricature” are certainly not the stuff of Oscars, one would think, but this contrast of responses to the film represents well my problem with the Mt. Rushmore of technocrats who are cited with missionary zeal whenever you spend much time in the reading wars (see the comments here): Daniel Willingham, John Hattie, E.D. Hirsch, and Grant Wiggins.

With some qualifications for Wiggins (who taught high school and coached for 14 years, but has focused primarily on assessment since then), these often cited men are primarily quantitative researchers who are not within the field of literacy (Hirsch’s background is literature, not literacy) and have created cottage industries out of their names/work: Willingham as a psychologist, Hattie as a researcher/consultant, Hirsch as a core knowledge advocate, and Wiggins as proponent of understanding by design and consultant.

As I have noted before, most of my concern here is how certain advocates for phonics and direct instruction in literacy use the Mt. Rushmore of technocrats to close the door on the reading wars—not with any of these men or their work specifically (except Hattie [1]).

Therefore, I must offer, Beware the technocrats, because of the following:

  • Beware the seductive allure of statistics, numbers, and “scientific” research. As I have detailed more often than I would have liked, a perfect example of this concern is the prevalence of the Hart and Risley research on the “word gap,” which persists despite many concerns being raised about not only the research itself, but also the deficit ideology that drives the conclusions. Of course, high-quality experimental and quasi-experimental research matters, but many aspects of teaching and learning require and lend themselves to other research paradigms—notably qualitative action research conducted by classroom teachers with the real populations they teach.
  • Beware the momentum of cottage industry gurus. Hattie, Hirsch, and Wiggins have created entire careers for themselves—books, workshops, consultations. I remain deeply skeptical of such ventures (see also Nancie Atwell and a whole host of gurus on the “softer” side of research and within literacy as well). Even the best people with the best intentions can find themselves victims of “‘filthy lucre,'” but just as the higher the quality of scientific research, the more likely it means less to real-world teaching, the urge to reduce an evidence base or best practice to a program means that evidence and practice are mostly ruined.

In the reading wars, then, I witness time and again that the advocates for intensive phonics, phonics programs, and direct instruction grounded in prescribed content are either not within the field of literacy [2] or themselves invested in programs that benefit from those positions (the Common Core debate represents the same issue since most advocates stand to benefit from Common Core being implemented, some politically and some financially).

Which brings me back to Whiplash. If you know little or nothing about jazz, the film likely appears more wonderful than if you do.

I have a thirty-plus year career in literacy, including teaching literacy (mostly writing) and scholarship addressing literacy. That context for me renders the Mt. Rushmore of technocrats not insignificant, but certainly less credible than a century of research and practice by literacy practitioners and researchers that informs my practice.

There is a tyranny to certainty among those who wield the work of Willingham, Hattie, Hirsch, and Wiggins in ways that end the conversation, that shut the door on a broader basis of evidence to inform, not mandate, practice. There is a greater tyranny of commerce lurking here also, using “scientific” as a mask for commercialization.

Both serve to further de-professionalize teachers, and both often result in classroom practices that may raise test scores but create nonreaders.

And thus, when Hattie is cited (yet again) during the reading wars, for example:

I posted a question in Pamela and Alison’s article last week, but didn’t get a response from anyone. My question is: if the “effect size” of synthetic phonics (according to Hattie’s research) is 0.54, and that of whole language learning is 0.06, does that mean:

  1. That whole language actually does have an effect; and
  2. Should we therefore use the two approaches in the ratio of 1:9 (i.e. the difference in their effect sizes)? (scroll to the comment from John Perry, who, I must add, is being reasonable here)

I share the exasperation Richard Brody expresses at the end of his review of a jazz film that uses Buddy Rich as the icon for the film’s protagonist: John Hattie. John Visible Learning Hattie.

In terms of evidence, that has the opposite effect intended.

—

See Also

Education ‘experts’ may lack expertise, study finds

Taming the Wild West of Educational Research, Simon P. Walker

[1] Those who rush to use Hattie are proof of solid research fail to note that his work has been challenged for quality, even within the quantitative paradigm; see:

[2] Since many people continue to refer to the National Reading Panel report, please examine Joanne Yatvin’s minority view, starting about page 444, including:

In the end, the work of the NRP is not of poor quality; it is just unbalanced and, to some extent, irrelevant. But because of these deficiencies, bad things will happen. Summaries of, and sound bites about, the Panel’s findings will be used to make policy decisions at the national, state, and local levels. Topics that were never investigated will be misconstrued as failed practices. Unanswered questions will be assumed to have been answered negatively. Unfortunately, most policymakers and ordinary citizens will not read the full reviews. They will not see the Panel’s explanations about why so few topics were investigated or its judgments that the results of research on some of the topics are inconclusive. They will not hear the Panel’s calls for more and more fine-tuned research. Ironically, the report that Congress intended to be a boon to the teaching of reading will turn out to be a further detriment.

As an educator with more than 40 years of experience and as the only member of the NRP who has lived a career in elementary schools [emphasis added], I call upon Congress to recognize that the Panel’s majority report does not respond to its charge nor meet the needs of America’s schools.

Education, education reform, Educational Research, reading, Standards, Statistics, Teaching, Testing

More on Evidence-Based Practice: The Tyranny of Technocrats

2 Comments

Depending on your historical and literary preferences, spend a bit of time with Franz Kafka or Dilbert and you should understand the great failure of the standards movement in both how we teach and how we certify teachers—bureaucracy.

Bureaucracy tends to be inadequate because bureaucrats themselves are often lacking professional or disciplinary credibility or experience, depending, however, on the status of their authority to impose mandates. For education, Arne Duncan serves well as the face of the bureaucrat, an appointee who has only the bully pulpit of his appointment to hold forth on policy.

However, as corrosive to education—and ultimately to evidence-based practice—is the technocrat.

Technocrats, unlike bureaucrats, are themselves credible, although narrowly so. For technocrats, “evidence” is only that which can be measured, and data serve to draw generalizations from randomized samples.

In short, technocrats have no interest in the real world, but in the powerful narcotic of the bell-shaped curve.

As a result, a technocrat’s view often fails human decency (think Charles Murray and Richard Herrnstein) and certainly erases the very human reality of individual outliers.

The face of the technocrat—in fact, the technocrat’s technocrat—is Daniel Willingham, whose work is often invoked as if handed down by the hand on God, chiseled on tablets. [1] [Note: If you sense snark here, I am not suggesting Willingham’s work is flawed or unimportant (I would say important but narrow), but am being snarky about how others wield the technocratic hammer in his name.]

And it is here I want to return to a few points I have made recently:

  • Even the gold standard of experimental research fails the teacher in her day-to-day work because her classroom is not a random sampling of students, because her work is mostly with outliers.
  • And in the teaching moment, what counts as evidence becomes that teacher’s experience couched in that teacher’s content and teaching knowledge as all of that happens against the on-going evidence of the act of teaching.

Stewart Riddle, offering yet another effort in the reading war, is essentially speaking for evidence-based practice while raising a red flag against the tyranny of the technocrat, embodied by the systematic phonics crowd (those who wave the Willingham flag, for example).

On Twitter, in response to my piece on evidence-based policy and practice, Nick Kilstein raised a great point:

My ultimate response (prompting this blog):

My thoughts here, building on the bullet points above, are that having our practice informed by a wide range of evidence (including important evidence from technocrats, but also from other types of evidence, especially qualitative research [2] that can account for outliers, nuance, and the unexpected) is much different than having our practice mandated by evidence (think intensive, systematic phonics for all children regardless of needs or fluency because that is the program the school has adopted).

For day-to-day teaching, the tensions of the disciplines remain important: what we can measure against what measuring cannot address.

When Willingham proclaims that a certain type of research does not support the existence of learning styles, for example, teachers should use that to be very skeptical of the huge amount of oversimplified and misguided “teacher guides” and programs that espouse learning styles templates, practices, and models. [3]

But day-to-day teaching certainly reveals that each of our students is different, demanding from us some recognition of those differences in both what and how we teach them.

It is in the face of a single child that technocrats fail us—as Simon P. Walker notes:

Some educational researchers retreat to empiricist methods. Quantitative studies are commissioned on huge sample sizes. Claims are made, but how valid are those claims to the real-life of the classroom? For example, what if one study examines 5,000 students to see if they turn right rather than left after being shown more red left signs. Yes, we now with confidence know students turn left when shown red signs. But so what?  What can we extrapolate from that?  How much weight can that finding bear when predicting human behaviour in complex real world situations where students make hundreds of decisions to turn left and right moment by moment? The finding is valid but is it useful?

If that child needs direct phonics or grammar instruction, then I must offer them. If that child is beyond direct phonics and grammar instruction or if that direct instruction inhibits her/his learning to read and write, then I must know other strategies (again, this is essentially what whole language supports).

The tyranny of the bureaucrats is easy to refute, but the tyranny of the technocrat is much more complicated since that evidence is important, it does matter—but again, evidence of all sorts must inform the daily work of teaching, not mandate it.

Professional and scholarly teachers are obligated to resist the mandates by being fully informed; neither compliance nor ignorance serves us well as a profession.

—

[1] For more on worshipping technocrats, explore this, notably the cult of John Hattie and that those who cite his work never acknowledge the serious concerns raised about that work (see the bottom of the post).

[2] Full disclosure, I wrote a biography for my EdD dissertation (published here), and also have written a critical consideration of quantitative data.

[3] See, for example, how evidence (Hart and Risley) functions to limit and distort practice in the context of the “word gap.” The incessant drumbeat of the “Hart and Risley” refrain is the poster child of the tyranny of technocrats.