Category Archives: Testing

Much Ado about Politics (Not Reading)

As new legislation was being debated in South Carolina, what was destined to become Read to Succeed, I was in contact with some strong advocates for public education who were seeking ways to shape effective reading policy in the state.

My input was focused on acknowledging the research base that refuted the popular political agendas mostly mimicking Florida reading policies driven by standardized high-stakes testing and grade retention for third graders.

First, decades of research reveal that despite popular support for grade retention (and bending to public antagonism for social promotion) grade retention is overwhelmingly harmful to students, especially our most vulnerable students (students living in poverty, black and brown students, English language learners).

Second, the Florida model has enough data and research to conclude that test-based third-grade retention produces some short-term bumps in test scores (what I would call false positives since this may be simply that students are taking the test again, and likely is not indication of reading growth) but those mirage-gains disappear over time (see Jasper’s doctoral dissertation on the data).

None the less, I was soon informed that there would be bi-partisan support for a new reading policy (Read to Succeed), even though it was flawed, because there would be an influx of more funding for reading.

Fast forward to now, the fall of 2018, when the first students are being impacted by this legislation—documented well by Paul Bowers at The Post and Courier (Charleston, SC):

South Carolina schools held back about 354 students in third grade for the 2018-19 school year under a new law designed to retain students with reading deficiencies.

That figure represents about one-half of 1 percent of the third-graders who took the state SC READY reading subtest in the spring — and only about 8.5 percent of the students who earned the lowest possible grade, “Not Met 1.”

While many will read this as either failure or success in terms improving reading and literacy in the state, the real lessons here are about politics, and the essential failure of bureaucratic measures for educational purposes.

Let me unpack some of how the consequences of Read to Succeed for 300-plus students is much ado about politics (not reading):

  • Is SC 47th in reading proficiency in the U.S. as Bowers reports? This may seem obvious, or at least non-partisan data, but educational rankings are inherently flawed, thoroughly debunked by Gerald Bracey. SC is doomed to low rankings in reading if those rankings remain anchored to high-stakes standardized tests (which reflect socio-economic status of any child’s home and community than educational attainment) and if SC political leadership refuses to address the state being also mired in the bottom quartile of high-poverty states. To claim SC ranks at the bottom of reading proficiency is a distraction from the root cause of those scores—inequity and poverty.
  • Is retaining 300+ students too many or too few? Bowers coverage seems to imply that Read to Succeed has fallen well short of having an effective impact while, as I was referenced in the article, I remain adamant that 345 students retained are 345 too many. Here is why. This legislation has created a bureaucratic mandate for a great deal of time and tax-payer money to be spent on more bureaucracy than valid reading instruction or reading opportunities for students. More high-stakes testing (which distorts what counts as reading), greater stigmas and misguided demands on vulnerable populations of students, more data collecting and analysis (without regard for the quality of that data), more prescriptions and mandates for teachers that result in less effective reading instruction—this in a nutshell is why Read to Succeed is a waste of time and money as well as a fraud in terms of addressing or improving reading in the state.
  • What really is going on—the politics that trumps reading? Read to Succeed has been exposed as legislation more dedicated to political viability (the public loves grade retention, and remains naive about high-stakes testing) than funding and supporting public education or teacher professionalism and autonomy. Read to Succeed is a political mirage, generating political capital at the expense of student achievement (see also Florida).
  • What are the negative lessons so far of Read to Succeed? (1) Stop mimicking the politics-of-the-day from other states, (2) reject education policy grounded in high-stakes testing and punishment (grade retention), (3) resists political agendas and embrace research and educational expertise , and (4) stop isolating political attention on schools as if they are not subsets of and influenced by larger and more powerful social realities such as poverty and inequity.
  • What should SC be committed to instead? Most importantly, political leadership and the public in the state must admit that social policy is the first line of educational policy; SC needs to address historical pockets of poverty in the state often linked to racism and generational inequity. This big picture failure of political leadership, however, does not mean there is nothing we can do in our schools concerning reading. Schools also must be reformed to end the inequities they often reflect and perpetuate—tracking, teacher assignments, school funding, experimentation (schools choice and charter schools, for example) that refuses to address directly public school reform. Finally, reading instruction can and should be reformed to include the following: much lower student/teacher ratios to facilitate effective instruction; guaranteeing student access to books and reading in their homes, communities, and schools; creating and supporting teacher professionalism and autonomy in terms of strong foundations in high-quality reading instruction not driven by raising test scores; patience for student growth in reading that rejects the flawed (and false) crisis response to third-grade literacy; and a robust campaign to inform better the public and parents about effective reading instruction, healthy student growth in reading, and how educational outcomes are more often than not a reflection of society and community affluence, not school or teacher quality.

Read to Succeed is yet another story about political motivation coupled with the good intentions of those charged with implementing truly flawed policy (see No Child Left Behind and the current Every Student Succeeds Act).

Good intentions are never enough, and good intentions can never overcome political negligence.

Since we remain enamored by ranking, let’s confront a very ugly fact: SC ranks first (or at least at the top) in political negligence, and Read to Succeed is just one more lesson in that embarrassing reality, one that has bitter consequences for the most vulnerable children in the state.

Negotiating Meaning from Text: “readers are welcome to it if they wish”

[Header Photo by Shelley Pauls on Unsplash]

Yesterday, I finished Jeff VandeMeer’s The Southern Reach Trilogy. As full disclosure, I should add “finally” since I plowed through with glee Annihilation, warmed to Authority after adjusting to the different style/genre and main character, but sputtered through Acceptance out of a sort of self-imposed commitment to finish the trilogy.

On balance, I can fairly say I may have almost no idea what the hell happened in these novels, and I certainly have only some faint urges about what the trilogy means—especially in the sorts of ways we assign meaning in formal scholling such as English courses.

Now only a few years away from 60, having taught for over 30 years, I am afforded something almost no students are allowed: I read entirely by choice, and thus, I can quit any book at any time with no consequences (except my own shame at having not read a book).

I still on occasion highlight and annotate the books I read. But no tests, no papers (except I do often blog about the books I read).

Traditionally, fictional texts and poetry have been reduced in formal schooling—in English courses—to mere vehicles for “guess what the text means,” or more pointedly “guess what the teacher claims the text means.”

Text meaning in English courses, then, is located often in the authority of the teacher, not in the text itself or the student.

As a high school English teacher, I was always careful to avoid propagandizing students toward “the” singular authoritarian meaning of a text, but I also felt compelled to make students fully aware of the traditional expectations (New Criticism, Advanced Placement testing, etc.) of couching all claims of meaning in the text itself.

Students still often balked at how one meaning held credibility and others did not.

One approach to this challenge I used was to ask students to read William Carlos Williams’s “The Red Wheelbarrow,” and then to visualize a wheelbarrow. I went around the room and had the students identify the position of the wheelbarrow in their visualization.

Decoding ‘The Red Wheelbarrow’–The impact of a 16-word poem

I also shared that I always thought of wheelbarrows leaned against a tree because I was chastised growing up about not leaving wheelbarrows so that rain water could accumulate and rust out the tub.

From here, we discussed that the poem gives some details—”red,” “glazed with rain/water”—but nothing about its physical position. Meaning, then, could work from those text details, but students’ visualization of the wheelbarrow was a personal response, not an element for claims of academic meaning.

Here, I also stressed that students should not think the distinction between meaning and personal response meant that their responses did not matter, or mattered less. However, in formal situations such as testing or assigned critical analysis, most assessments would draw an evaluative judgment, honoring text-based meaning over personal response.

Yet, I remain deeply concerned about how formal schooling, especially narrow versions of literary analysis essays and high-stakes testing, erodes and even poisons students’ joy in reading text by continuing to couch text meaning in the authority of the teacher, which is often a proxy for the authority of the critic (and not the author, or the students as readers).

Authors, I often warned my students, did not write their fiction and poetry so teachers could assign them and then have students analyze the text for literary techniques and the ultimate meaning or theme. Many celebrated authors loathed English courses, and equally loathe the literary analysis game.

Author Sara Holbrook, for example, recently confessed I can’t answer these Texas standardized test questions about my own poems:

These test questions were just made up, and tragically, incomprehensibly, kids’ futures and the evaluations of their teachers will be based on their ability to guess the so-called correct answer to made up questions….

Texas, please know, this was not the author’s purpose in writing this poem.

This tyranny of testing supplants not only the authority of students as readers, but also the authority of the writer who constructed the text!

And Hannah Furness reports:

Ian McEwan, the award-winning author, has admitted feeling “a little dubious” about people being compelled to study his books, after helping his son with an essay about his own novel and receiving a C.

McEwan explained:

“Compelled to read his dad’s book – imagine. Poor guy,” McEwan added.

“I confess I did give him a tutorial and told him what he should consider. I didn’t read his essay but it turned out his teacher disagreed fundamentally with what he said.

“I think he ended up with a C+.”

Meaning couched in the authority of the teacher trumps, again, students constructing meaning and the author as an agent of intent.

And finally, consider Margaret Atwood discussing her recently reimagined The Handmaid’s Tale as a serial TV drama:

When I first began “The Handmaid’s Tale” it was called “Offred,” the name of its central character. This name is composed of a man’s first name, “Fred,” and a prefix denoting “belonging to,” so it is like “de” in French or “von” in German, or like the suffix “son” in English last names like Williamson. Within this name is concealed another possibility: “offered,” denoting a religious offering or a victim offered for sacrifice.

Why do we never learn the real name of the central character, I have often been asked. Because, I reply, so many people throughout history have had their names changed, or have simply disappeared from view. Some have deduced that Offred’s real name is June, since, of all the names whispered among the Handmaids in the gymnasium/dormitory, “June” is the only one that never appears again. That was not my original thought but it fits, so readers are welcome to it if they wish.

Having taught The Handmaid’s Tale for well over a decade in A.P. Literature, and also having written a book on Atwood, I felt my stomach drop when I first read this—forcing myself to recall that I had taught as authoritative what Atwood contested: June as the original given name of Offred. The source of that, for me, was a published critical analysis, in fact.

This caution offered by Atwood, I believe, speaks to our English classes, where text is too often reduced to an assignment, to a game of guess what the teacher wants you to say this texts means.

As teachers of English, of course, we have many responsibilities. Making students aware of traditional and text-based expectations for assigning meaning to text is certainly one of those responsibilities.

But this must not be the only ways in which we invite students to read, enjoy, and then draw meaning from text.

Choice in what they read as well as a wide variety of ways for students to respond to text—these must become the expanded set of responsibilities we practice in our classrooms.

Occasionally, if not often, we should as teachers be as gracious as Atwood, providing the space for students to read and then respond with their own athority in a class climate grounded in “readers are welcome to it if they wish.”

If You Are Grading, You May Not Be Teaching

Throughout my career of about two decades as a high school English teacher and then approaching another two decades in higher education (as a teacher educator and first-year/upper-level writing professor), I have avoided and delayed grading as well as eliminated testing from my classes.

My experiences with first-year and upper-level writing instruction have further confirmed that if you are grading, you may not be teaching.

Specifically, teaching citation and scholarly writing has revealed a problem that directly exposes why grading often works against our instructional goals.

First, let me stress again that the essential problems with grading include how traditional practices (such as assigning grades that are averaged for quarter and/or semester grades that are then averaged for course grades) tend to blur the distinction between summative and formative grades, inhibiting often the important role of feedback and student revision of assignments.

The blurring of formative and summative grades that occurs in averaging, as I have confronted often, deforms teaching and learning because students are being held accountable during the learning process (and thus discouraged from taking risks).

To briefly review the problems with grades and averaging, let me offer again what my major professor argued: Doctors do not take a patient’s temperature readings over a four-day stay in the hospital in order to average them, but does consider the trajectory of those readings, drawing a final diagnosis on the last reading (or readings). Thus, averaging is a statistical move that distorts student growth, deforms the value of reaching a state of greater understanding.

As I have detailed before, consider a series of grades: 10, 10, 85, 85, 85, 85, 85, 85, 100, 100 = 730.

The average is 73, which most teachers would assign, but the mode is 85, and if we note these grades are sequential and cumulative (10 as the first grade in terms of time, and 100 the last grade), a legitimate grade assignment could be 100.

In other words, using the same data, a teacher could assign 73, 85, or 100 to this student, and all can be justified statistically.

But another problem with grades and averaging that speaks to this post is something my students taught me when they complained about their math classes. Several students informed me that they had never passed a single math test, but had passed math courses.

The trick? Students earned bonus points for homework, etc., that were added to each test, on which students never reached a passing score.

This process means that cumulatively students never acquired so-called basic or essential math skills, but passed the courses, resulting in course credit that grossly misrepresented student learning.

Therefore, returning to my claim that grading may not be teaching, when we subtract for so-called errors to assign grades, we are allowing students to move through the learning process without actually learning the element being graded. In most cases, I believe, that strategy is teaching students that the element really doesn’t matter.

This dynamic is particularly corrosive when teaching scholarly writing and citation. Citation is one area of writing that doesn’t have degrees; you either cite fully or you don’t.

Many students, similar to the math students noted above, have never reached any level of proficiency with citing because they have mostly had points deducted for improper citation and then gone on their merry way, never having learned to cite fully.

If citation is essential, to grade and never require mastery of citation have two very negative consequences: (1) students do not attain an essential skill (and may exit formal education without the skill), and (2) students fail to understand the importance of drafting, receiving feedback, and revising.

Academic writing is challenging for developing young writers since it demands complex technical demands (such as citation and document formatting) and high expectations for content and style. Students need years and dozen of experiences reading and writing academic writing across multiple disciplines and varying conventional expectations.

But we cannot expect students to acquire the nuances of citation if we simply grade and never allow or expect them to cite fully and properly as an essential aspect of an academic writing experience.

As I make this case, I want to stress that as writing teachers we are trying to balance expectations for students and provide them low-stakes opportunities to draft with little or no consequences.

Students should have both writing assignments that demand minimum proficiency with key skills such as citation and writing contexts that foster and allow taking risks and working outside conventions.

Grading, I witness daily, inhibits both of those in ways that suggest the non-graded writing class is the best opportunity for students to learn in holistic and authentic ways that reveal themselves in student writing samples.

Because of their experiences being graded, I struggle to help students see that citation, grammar, mechanics, style, and content all work in unison either to support or erode their authority as writers and scholars.

I struggle to break through students resisting the drafting, feedback, revision process because they have been taught to submit instantly perfect work; that their identifiable flaws are the loss of points—not necessary areas to learn, grow, and excel.

As I end my thirty-fourth year teaching, I cannot stress hard enough that if you are grading, you may not be teaching, and your students likely are not learning the very things you value enough to assess.

Education’s Fatal Flaw: “[T]he considerable gap”

In my upper-level writing and research course, Scholarly Reading and Writing in Education, students have been practicing critical discourse analysis of how media cover selected issues in education in order to compare that coverage to the research base on that topic.

They have recently submitted initial drafts of the major scholarly essay and are now drafting a public commentary drawn from the same analysis. One student in last evening’s seminar approached me with a question.

She was very concerned that her topic seemed to show a distinct disconnect between education policy and the research base, wondering if that was unique to her topic, and why that failure existed.

Her question came during the workshop time after we had read and discussed a recent public commentary of mine on school safety and the threat of gun violence as a model for their commentaries. I noted that her observation was accurate, and that it was not simply her topic, but common across all of public education—as I noted in my commentary that challenges popular school safety measures not supported by research

Coincidentally, I came across the next morning a Twitter thread about the broader failure in education to embrace progressivism:

While progressivism in education (often linked directly to John Dewey) has been routinely blamed for causing educational failure, as Alfie Kohn has addressed, the reality is that education has failed progressivism:

The rarity of this approach, while discouraging to some of us, is also rather significant with respect to the larger debate about education. If progressive schooling is actually quite uncommon, then it’s hard to blame our problems (real or alleged) on this model. Indeed, the facts have the effect of turning the argument on its head: If students aren’t learning effectively, it may be because of the persistence of traditional beliefs and practices in our nation’s schools.

Kohn’s analysis is a mere decade old, and if anything, his observations have intensified as the U.S. continues to double-down on traditional and technocratic practices such as standards and high-stakes testing.

However, if we look back to 1942, Lou LaBrant exposed the exact same dynamic grounded in a public outcry over low literacy among men enlisted in the military:

Within the past ten years we have made great strides in the teaching of purposeful reading, reading for understanding (the kind of reading, incidentally, which the army and navy want). Nevertheless, we hear many persons saying that the present group of near-illiterates are results of “new methods,” “progressive schools,” or any deviation from the old mechanical procedures. They say we must return to drill and formal reciting from a text book. (p. 240)

However, LaBrant completely discredits the blame:

1. Not many men in the army now have been taught by these newer methods. Those few come for the most part from private or highly privileged schools, are among those who have completed high school or college, and have no difficulty with reading.

2. While so-called “progressive” schools may have their limitations, and certainly do allow their pupils to progress at varied rates, above the second grade their pupils consistently show superior ability in reading. Indeed, the most eager critics have complained that these children read everything they can find, and consequently do not concentrate on a few facts. Abundant data now testify to the superior results of purposeful, individualized reading programs.

3. The reading skills required by the military leaders are relatively simple, and cause no problem for normal persons who have remained in school until they are fourteen or fifteen. Unfortunately the large group of non-readers are drop-outs, who have not completed elementary school, come from poorly taught and poorly equipped schools, and actually represent the most conservative and backward teaching in the United States. (pp. 240-241)

Just 5 years later, LaBrant penned what would become a refrain of her six-plus decades as an educator: “A brief consideration will indicate reasons for the considerable gap between the research currently available and the utilization of that research in school programs and methods” (p. 87).

“[T]he considerable gap” between policy/ practice and research has, then, defined public education throughout the twentieth and into the twenty-first centuries.

Again, as I confront about fortifying schools against gun violence and the research base on those so-called safety measures, practices such as grade retention and even corporal punishment [1] remain policy all across the U.S. despite decades of evidence overwhelmingly rejecting their use. Grade retention, for example, has been formally refuted by the National Council of Teachers of English (NCTE), yet states continue to adopt grade retention based on high-stakes tests for third graders.

As LaBrant challenged decades ago, literacy today is failing students because policy remains anchored to discredited practices and ideologies such as the “word gap,” reading programs, leveled texts, isolated phonics and grammar instruction, and test-prep.

Possibly one of the most troubling examples of this phenomenon is the relentless and bi-partisan obsession with charter schools, especially the abusive practices found in so-called “no excuses” charters. As this review details,

A report, Charter Schools and the Achievement Gap, finds that, though charter schools on average perform no better than traditional public schools, urban “no-excuses” charter schools—which often use intensive discipline to enforce order—demonstrate promising results. It recommends that these schools and their practices be widely replicated within and outside of the charter school sector. We find three major flaws with this conclusion.

This endorsement of “no excuses” charter schools, again, simply ignores the broader research base that cautions against charter schools broadly and “no excuses” practices more specifically.

So, as I answered my student’s insightful question, I noted a few important ways to understand “the considerable gap” between policy/practice and research.

First, educators—unlike doctors and lawyers, for example—have never controlled the field of education. Public education has always been hostage to partisan politics and mind-numbing bureaucracy.

Let me caution here that I am not making a narrow Libertarian swipe at “government” schooling—since we are government—but acknowledging that just as education has failed progressive and critical theory and practice, public institutions have mostly failed the promise of democratic government because of partisan politics and bureaucracy.

Next, and related, the evidence vacuum that exists in the dynamic between political leaders and the public, again, can be witnessed in the school safety debate. Politicians both speak to and perpetuate public misconceptions about fortifying school—the public’s irrational trust in armed police on campuses, surveillance cameras, and metal detectors (all of which have been shown to make schools more dangerous, not safer).

But that same evidence vacuum occurs throughout the adoption and implementation of education policy.

LaBrant’s 1947 unmasking of “the considerable gap” ends with her imploring English teachers and NCTE:

This is not the time for the teacher of any language to follow the line of least resistance, to teach without the fullest possible knowledge of the implications of his medium. Before we, either as individuals or as a Council, experiment with methods of doing specific things or block out a curriculum, let us spend some time with the best scholars in the various fields of language study to discover what they know, what they believe uncertain and in need of study. Let us go to the best sources, and study the answers thoughtfully. (p. 94)

As teachers strike across the U.S. in 2018, let’s us carry LaBrant’s message forward because the only hope that exists for our schools and the students they serve is to close the gap by allowing teachers as professionals to practice our field guided by the evidence too long ignored by the political bureaucracy that has defined public education for more than a century.


[1] The list of ideologies and practices that represent “the considerable gap” is far too long to include in the discussion above, but here are many of the key ones worth recognizing: “grit,” growth mindset, merit pay, VAM, standards, and high-stakes testing. Please refer to the Categories in the right menu for posts related to each of these.

The Never-Ending Allure of Scientific Racism

[Header Photo by Braňo on Unsplash]

Who in their right mind would argue with a Harvard geneticist?

I mean Harvard. And geneticist.

And then, who in their right mind would argue with a Harvard geneticist published in the New York Times.

I mean New York Times.

And therein lies the essential problem with the NYT publishing David Reich’s How Genetics Is Changing Our Understanding of ‘Race,’ followed up, of course, by the eager “Hey, look! A Harvard geneticist said this thing we have been saying! A Harvard geneticist!” (The short version of Andrew Sullivan’s Denying Genetics Isn’t Shutting Down Racism, It’s Fueling It.)

Not to belabor, but to make a case, possibly that most people can grasp in a way that isn’t oversimplified and misleading (see Reich’s mess as I will detail below), I want to focus on the argument at the core of Reich’s piece that both misrepresents and conveniently ignores how we should best understand race and then racism.

Here’s the key part from Reich:

It is true that race is a social construct. It is also true, as Dr. Lewontin wrote, that human populations “are remarkably similar to each other” from a genetic point of view.

But over the years this consensus has morphed, seemingly without questioning, into an orthodoxy. The orthodoxy maintains that the average genetic differences among people grouped according to today’s racial terms are so trivial when it comes to any meaningful biological traits that those differences can be ignored.

Reich suffers from what many so-called elite experts struggle to resist; he feels quite qualified to hold forth on everything just because some people look to him as an expert in one thing.

That he has framed this “orthodoxy” as “average genetic differences among people grouped according to today’s racial terms are so trivial” and “those differences can be ignored” serves two disturbing purposes: first, it sets him up to explain that science argues these differences are, in fact, not trivial, and second, it provides him cover for never confronting the actual orthodoxy about race (how it becomes a blunt tool of racism) in the U.S. and much of the Western world.

So let me now offer a counter-argument, although I am but a lowly education professor.

To be frank, I don’t know a damned person of any intelligence who thinks there are not easily identifiable differences among humans along a wide spectrum of characteristics to classify people. There is no blasphemy to stating that men and women are different, that our social identification of people by skin color (most common use of “race”) also can be used to recognize differences.

But Reich completely misses the boat on the consequences of identifiable differences among humans, and here is the most important point, how identifiable differences become substantial in the hands of the powerful.

You see, the thing Reich and scientific racism refuse to confront is the issue of power.

Here is how human structures have mostly worked: Any group that gains power becomes to some degree insular (tribal) and then idealizes those distinct qualities of the tribe in order to create structures that honor those features while using identifiable differences in the weak to keep them subjugated.

In other words, while Reich seems to think there is some sort of “I don’t see race” orthodoxy in the U.S. and West, he fails to see himself that this isn’t the case, and that “not seeing race [or differences]” isn’t even the goal.

The problem, then, is not if we can isolate, quantify, and thus emphasize something called “intelligence,” and it isn’t even that when we have done and do that now, that we can then also identify differences.

The problem is two-fold: The markers for intelligence are determined by those in power (thus, they are arbitrary) and tend to represent well those in power while marginalizing those who are powerless, and then, that process invariably uses the allure of “scientific” to entrench power deeper for the powerful and disadvantage further the weak.

The reading of “scientific” as “objective” in the pursuit of highlighting and labeling differences is where Reich and others completely fail this debate; this, in fact, is the primary province of scientific racism.

So humans are confronted with the ever-growing body of knowledge about our genetics, what makes us human as well as what makes us unique among and even within our tribes, and we cannot simply take off our socially constructed races like we are discarding an old suit.

The pursuit of quantifying intelligence, the purview of scientific racism, is at its core about proving that the winners deserved to win, about proving that the losers deserved to lose, about denying the power of privilege and inequity.

I am deeply skeptical of Reich’s hand wringing since it remains trapped in the codes of “scientific” and absent any real confrontation of not that humans have differences but how power shapes what happens to those differences.

I am skeptical because that track record on science and racism is quite ugly, and it isn’t one that is tucked away in our dark past.

The daily use of measurement in education and how that makes differences fatalistic (the wealthy are nearly guaranteed their privileges and the disadvantaged are bound to their lives of inequity) is how we do the science of intelligence now.

That is an orthodoxy that should be exposed, unpacked, and dismembered.

Recommended

Populations are not races

Testing, the Problem Not the Solution

Let’s start with a thought experiment.

Imagine a world where being a runner is held in high regard, well above students’ aptitude in reading, ‘riting, and ‘rithmetic.

Teacher A at XYZ Elementary School takes her third-grade class out to the school track, lining them up to run the 100-meter dash to set a baseline of data for determining the fastest runners in the class.

Across town at ABC Elementary School, Teacher Z ushers her third-graders to the high school to establish her baseline data, sending off these children on 2 laps of the 5K cross country trails.

Mid-year, Student J transfers from XYZ Elementary School, where J had placed 1st in the initial 100-meter dash, to ABC Elementary School just in time for the year-end 10K to assign final grades.

J had excelled all year in the 40-yard dash, but floundered at the 10K, not able to finish the run and receiving an I for third grade, thus was retained.

In this brief allegory, we should confront the realities about high-stakes testing that are often muted by our blind faith in the perennial existence of tests such as IQ testing, state standards-based testing, and college entrance exams such as the SAT and ACT:

  • Regardless of standards, curriculum, textbooks, or even what teachers teach in the classroom, as Gerald Bracey has warned: What you test is what you get (WYTIWYG).
  • The testing format and context (see above the 100-meter dash v. a 10K) have a significant impact on the outcomes; in the thought experiment, which student is labeled a “fast runner” changes because of the type of test, not necessarily the abilities or even effort by the teachers and the students.
  • Pre- and post-testing are not as effective or fair as we tend to assume—notably since the real world includes a great deal of transient students. (Caution: A universal set of standards, curriculum, and tests may solve this problem, but cannot address the first two bullets above.)
  • What is tested and how are always political decisions by some authority in power. This confirms that all testing is political and that no testing is objective or neutral.
  • Testing is always reductive (giving evaluative power to a limited but claimed representative set of acts over behaviors that require more time and greater nuance) and serves mostly goals of efficiency, not goals of authenticity.

Now let’s turn to the soap opera that is education reform, fatally committed to the accountability paradigm (ever-new standards and ever-new high-stakes tests—all promised to be better than those before, even as those before were declared the best ever)

First, let’s visit Chicago, PARCC pushback prompts Illinois to remake controversial test for 3rd-8th graders:

Math and reading exams known as PARCC spawned angst and outright rebellion when the tests launched in 2015, ushering in a new era of state testing in Illinois public schools.

But that new era appears to be short-lived, with this spring’s PARCC exams possibly the last for the state’s third- to eighth-grade students, educators say.

Here is yet one more brick removed from the crumbling wall of Common Core—a standards revolution that guaranteed world-class standards and tests that would usher in a new era of education reform across the U.S.

Next, and related, while the Common Core wall crumbles, and the concurrent rush to hold teachers accountable for student test scores on those Common Core tests flounders, one of the primary advocates and funders of the Common Core disaster has been Bill Gates and his foundation.

Interesting to note, then, that once again, as Nancy Flanagan details, Gates has changed his tune in the wake of his most recent promises failing:

Looks like Bill Gates, having totally solved the common standards problem, mastered the vexing “teacher evaluation using student test data” challenge, and designed right-sized schools, is now moving deeper into the heart of what has traditionally been teachers’ core professional work. Curriculum, that is.

“Our goal is to work with the field to make sure that five years from now, teachers at every level in secondary school have high-quality aligned curriculum in English, math, and science,” Bill Gates said in a speech last fall, describing curriculum as “an area where we feel like we’ve underinvested.”

And third, even internationally, the default urge in education reform is not only new testing, but more: Setting more exams to combat stress among school students is utterly absurd.

As I warned three years ago, Tests don’t improve learning. And PARCC will be no different.

In fact, educators for well over three decades have warned that accountability driven by standards and high-stakes testing has never been the appropriate reform mechanism for the core problems facing universal public education: crippling inequity in both the lives and formal education of the most vulnerable students.

Tests, then, are the problem and not the solution.

Tests are a distraction, keeping our gaze on students and teachers and away from the inherent inequity of the tests themselves—instruments of those in power who decide what matters and how by what is tested and how.

In education, the problem has never been about the quality of tests (or standards, or curriculum, or textbooks) but about the presence of those tests and the power they wield.

We remain trapped in refusing to learn the bitter lessons from chasing better tests.


See Also

Thinking about Tests and Testing: A Short Primer in “Assessment Literacy,” Gerald Bracey

Seventeen reasons why football is better than high school, Herb Childress

The Politics of Education Policy: Even More Beware the Technocrats

Man Prefers Comic Books That Don’t Insert Politics Into Stories About Government-Engineered Agents Of War (The Onion) includes a simple picture of a 31-year-old white male with the hint of a soon-to-be Van Dyke:

The fictional “man,” Jeremy Land, explains:

“I’m tired of simply trying to enjoy escapist stories in which people are tortured and experimented upon at black sites run by authoritarian governments, only to have the creators cram political messages down my throat,” said Land, 31, who added that Marvel’s recent additions of female, LGBTQ, and racially diverse characters to long-running story arcs about tyrannical regimes turning social outsiders into powerful killing machines felt like PC propaganda run amok. “Look, I get that politics is some people’s thing, but I just want to read good stories about people whose position outside society makes them easy prey for tests run by amoral government scientists—without a heavy-handed allegory for the Tuskegee Study thrown in. Why can’t comics be like they used to and just present worlds where superheroes and villains, who were clearly avatars for the values of capitalism, communism, or fascism, battle each other in narratives that explicitly mirrored the complex geopolitical dynamics of the Cold War?”

The satire here is the whitesplaining/mansplaining inherent in the politics of calling for no politics.

It strains the imagination only slightly to understand how this commentary on comic book fanboys also parallels the persistent combination in education of calling for no politics while using policy and a narrow definition of data and evidence to mask the racial and gender politics of formal schooling.

Let’s imagine, then, instead of the fictional Land an image of David Coleman (who parlayed his Common Core boondoggle into a cushy tenure as the head of the College Board) or John Hattie (he of the “poverty and class size do not matter” cults that provide Hattie with a gravy train as guru-consultant).

A close reading of David Coleman’s mug shot reveals a whole lot of smug.

In his “visible learning” hustle, John Hattie likely prefers to keep his enormous profits invisible.

Coleman and Hattie as technocrats feed the systemic racism, classism, and sexism in formal education policy and practice by striking and perpetuating an objective pose that serves as a veneer for the normalized politics of political and economic elites in the U.S.

As Daniel E. Ferguson examines, Coleman’s Common Core propaganda, the rebranded traditional mis-use of New Criticism into “close reading,” argues:

Close reading, as it appears in the Common Core, requires readers to emphasize “what lies within the four corners of the text” and de-emphasize their own perspective, background, and biases in order to uncover the author’s meaning in the text.

However, Ferguson adds,

Critical reading, in contrast, concerns itself with those very differences between what does and does not appear in the text. Critical reading includes close reading; critical reading is close reading of both what lies within and outside of the text. For Paulo Freire, critical reading means that “reading the world always precedes reading the word, and reading the word implies continually reading the world.”

And thus, close reading serves the cult of efficiency found in the high-stakes standardized testing industry that depends on the allure of believing all texts have singular meanings that can be assessed in multiple-choice formats—a dymanic Ferguson unmasks: “The story beyond the four corners of Coleman’s video is one of a man whose agenda is served by teachers following a curriculum that requires students to read in a way assessable through standardized tests he oversees and profits from.”

Simultaneously, of course, keeping students and teachers laser-focused on text only detracts them from the richer context of Martin Luther King Jr. and the broader implications of racism and classism informed by and informing King’s radical agenda.

Simply stated, close reading is a political agenda embedded in the discourse of objectivity that whitewashes King and denies voice and agency to King, teachers, and students.

Concurrently, Hattie’s catch phrase, “visible learning,” serves the same political agenda: Nothing matters unless we can observe and quantify it (of course, conveniently omitting that this act itself determines what is allowed to be seen—not the impact of poverty or the consequences of inequity, of course).

Hattie’s garbled research and data [1] match the recent efforts in education reform to isolate student learning as the value added (VAM) by individual teachers, yet another off-spring of the cult of efficiency manifested in high-stakes standardized testing.

Just as many have debunked the soundness of Hattie’s data and statistics, the VAM experiment has almost entirely failed to produce the outcomes it promised (see the school choice movement, the charter school movement, the standards movement, etc.).

Coleman and Hattie work to control what counts and what matters—the ultimate in politics—and thus are welcomed resources for those benefitting from inequity and wishing to keep everyone’s gaze on anything except that inequity.

The misogyny and racism among comic book fanboys allows the sort of political ignorance reflected in The Onion‘s satire.  If we remain “within the four corners of the text” of Marvel’s Captain America, for example, we are ignoring that, as I have examined, “Captain America has always been a fascist. … But … Captain America has always been our fascist, and that is all that matters.”

3e281
Captain America: Steve Rogers #1 (c) Marvel

The politics of education policy seeks to point the accusatory finger at other people’s politics, and that politics of policy is served by the technocrats, such as Coleman and Hattie, who feed and are fed by the lie of objectivity, the lie of no politics.


[1] See the following reviews and critiques of Hattie’s work:

28 November 2017 Education Reader

I am the teacher South Carolina wants to retain, and I am barely hanging on, Rachel Caulder

Teachers need autonomy. Thankfully, I teach in a school that does not use curriculum alignment documents or strict pacing guides, and my administration values the judgment of teachers within our classrooms. Teachers in districts that are solely focused on numbers are restricted, and students suffer because no allowance is made for differentiation or reteaching for content-mastery. In districts with strict pacing guides, teachers are left with no option but to stay the course — even when they know they are failing their students.

Why do schools use grades that teach nothing? Jonathan Lash

At the college where I serve as president, we do evaluate student work; we just use a higher-quality method. Our students receive written evaluations not only on every assignment, but also for every course and learning activity. These evaluations are designed to be formative teaching tools.

For similar reasons, we completely stopped accepting SAT and ACT for admissions two years ago, after an internal study revealed standardized test scores are poor predictors of student success at Hampshire. We also recognized the bias of standardized tests against low-income students, and the negative influence of standardized testing on education.

A North Carolina Teacher’s Guest Post on His/Her EVAAS Scores

NEPC Review: Tackling Gaps in Access to Strong Teachers: What State Leaders Can Do (The Education Trust, October 2017)

The Every Students Succeeds Act (ESSA) directs states and districts to identify equity gaps in students’ access to excellent educators and transformative school leaders. States are encouraged to use Title II funds strategically in order to identify and remedy these gaps. A new report from The Education Trust draws on ESSA documents and state teacher equity plans to provide guidance to state leaders, including some sound advice—but with significant omissions. The report does not engage with thorny issues around alternative pathways into teaching, and it largely skirts issues around incentives for supporting teacher recruitment and retention in hard-to-staff schools. The report also does not consider what attracts teachers into the profession and into particular school environments. Likewise, the report fails to draw on the explicit remedies sought by ESSA to link high-quality leadership with strong teacher recruitment and retention. Instead, the report casts the teacher equity problem primarily in terms of labor supply shortages and treats teachers like interchangeable widgets. Relying heavily on advocacy sources, it misses an opportunity to unpack the root causes of the teacher retention problem, particularly the corrosive impact of past federal and state policies on the teaching profession. The report does not help state leaders understand how they might build incentives and cultures that draw strong teachers into high-need schools, and they will thus be left with an incomplete and insufficient set of tools for ensuring that all students have equitable access to excellent educators.

Go public and perish? Supporting the engaged scholar, Jennifer Ditchburn

Despite the fact that university presidents and the people who run university communication departments are only too happy to have their scholars out building a profile, the academic system is not set up to help them connect with the public. Writing a piece for Maclean’s or appearing on CBC’s The National doesn’t count toward tenure or get you a promotion: publish or perish is about peer-reviewed journals and books.

Time for public engagement is not often budgeted into a professor’s employment – scholars do this on top of their personal and academic responsibilities (I always feel a bit sheepish when I approach a busy prof to write something for me). The challenges are arguably tougher for some women in academia, whose pursuit of tenure or awards is already interrupted by maternity leave or childcare responsibilities.

The Missing Link In Student Writing

Judicial Negligence Compounds Political Negligence in South Carolina

Conservative politics as a very thin veneer for racism and class warfare has long characterized the South, including South Carolina, regardless of party affiliation—once Democratic and now the same sort of recalcitrant Republican.

Strom Thurmond personified this ugly fact of my home state—him a brash racist and among the now seemingly endless line of powerful white men who also viewed and treated women as subhuman as well. The current disaster of Roy Moore stands as yet more of that same, embodying a crass blend of political, judicial, and morally bankrupt popular in the South, the Bible Belt.

The twenty-first century, regretfully, has not exorcised these ghosts in the machine, as SC remains nearly a cartoon version of Southern stereotypes.

SC public schools (and public universities, in fact) exist in 2017 as a bold middle finger to everything promised by a democratic nation. But despite the political rhetoric, SC has failed its public schools; public schools have not failed our state, whose political leaders care none at all about poor, black, or brown children being currently (and historically) mis-served by K-12 education.

Political negligence of public schools—or more accurately, negligence of public schools that serve the most vulnerable children and communities in the state—is one of the perverse traditions that defines SC.

That tradition has a willing accomplice in the judicial negligence of the state as well. Cindi Scoppe explains:

In the three years since the S.C. Supreme Court ruled that the Legislature had to provide a decent education to all children, one justice wrote in this month’s final chapter of the quarter-century-old school adequacy case, “we have had the benefit of seeing the defendants make steady progress toward remedying their failure to provide our state’s children with a minimally adequate education.”

Particularly encouraging, he wrote, is the fact that the state has “recently come to realize that merely pouring more money into an outmoded system will not lead to success.”

Popularized as the Corridor of Shame, political and judicial negligence actually thrives in pockets all over SC, not just along the I-95 corridor that does in many ways bisect the more affluent midlands and upper state from the crippling rural poverty dominating much of the lower state except for pockets of affluence in coastal havens for the wealthy and the riches of tourism.

The conservative ideology driving political negligence has withstood the slow drag of the courts in SC, which has now fallen lockstep into that same sterile argument about “pouring more money into an outmoded system”—as if SC has even flooded public institutions with money.

Political and judicial negligence in SC—a microcosm of the same negligence nationally—remains entrenched in commitments to ideology over evidence, hard truths neither political leadership nor judicial pronouncements will admit.

First, and foremost, one hard truth is that public schools in SC are mostly labeled failures or successes based on the coincidence of what communities and students those schools serve. Schools serving affluent (and mostly white) communities and students are framed as “good” schools while schools serving poor (and often black and brown while also over-serving English language learners and students with special needs) communities and students are framed as “bad” or “failing.”

This political lie is grounded in the three-decades political charade called education reform—a bureaucratic nightmare committed to accountability, standards, and testing as well as a false promise that in-school only reform could somehow overcome the negative consequences of social inequity driven by systemic racism, classism, and sexism.

The ironic and cruel lesson of education reform has been that education is not the great equalizer.

Education reform is nothing more than a conservative political fetish, a gross good-ol’-boy system of lies and deception.

Second, and in most ways secondary, another hard truth is that while education is not the great equalizer, public schooling tends to reflect and then perpetuate the inequities that burden the lives of vulnerable children.

In-school only reform driven by accountability, standards, and testing fails by being both in-school only (no education reform will rise about an absence of social/policy reform that addresses racism and poverty) and mechanisms of inequity themselves.

Affluent and white students are apt to experience a higher quality of formal schooling than black, brown, and poor students, who tend to be tracked early and often into reduced conditions that include test-prep, “basic” courses, and teachers who are early career and often un-/under-certified.

Nested in this hard truth is that much of accountability-based education reform depends on high-stakes standardized testing, which is itself a deeply flawed and biased instrument. Tests allow political negligence since data appear to be objective and scientific; in fact, standardized testing remains race, class, and gender biased.

Like school quality, test scores are mostly a reflection of non-academic factors.

Ultimately, SC’s children and then the state itself are being cheated by a failure to admit hard truths. I agree, then, with the big picture conclusion drawn by Scoppe:

It was never clear to me whether our constitution requires the state to provide a good education to all children, or simply to operate public schools. What was always more than clear was that it is the job of the Legislature to provide an education to every child in this state. And that it is insane — and morally indefensible — not to provide a decent education to all children. What was always more than clear was that it is up to the Legislature not only to provide the funding but also, as Justices Beatty and Toal and Kay Hearn always emphasized, to make sure the districts are organized appropriately and school officials have the right powers and duties and we have the right laws about what is taught and how it is taught and that the problems are corrected when the schools don’t deliver.

This is a moral imperative about children, about human dignity and agency.

Let me end with the ignored but obvious hard truth: Education funding matters, but doing the same thing over and over while expecting different results is insanity.

Millions and millions of tax dollars in SC have been squandered on ever-new standards and ever-new tests; where is the political and judicial rhetoric about that? SC for decades now has spent hundreds of thousands of dollars on school report card that have accomplished nothing except demonizing schools that happen to serve poor and black/brown children.

SC must seek instead the political will to implement first social policy that addresses the scar of poverty and racism in our state. Concurrent with that, education reform must end its affair with accountability and begin a journey committed to education equity.

Our children deserve more than the accidents of their births, and then, as a people, we owe every child an equitable and challenging education that invites them into an honest attempt at democracy and freedom.

Political and judicial negligence is inexcusable, but remains a SC tradition.

Pre-Service Teacher Education vs. the World

I cannot promise below anything as exciting as battling a potential new partner’s seven evil exes, but I do want to wade into an important but too often overlooked aspect of how we assign power and blame to teacher impact of student achievement.

In two recent posts, I have confronted teacher blaming as well as teacher buy-in because far too many people simultaneously overstate teacher impact on student outcomes while ignoring that teachers in the U.S. have very little professional autonomy.

First, and I will not belabor this point, teacher quality contributes to only about 10-15% of measurable student achievement, dwarfed by out-of-school factors accounting for about 60% or more.

Yet, what is also important to emphasize is that teacher practices in public schools are highly regulated, increasingly so over the past thirty years of accountability driven by standards and high-stakes testing.

Teacher professional autonomy has been nearly absent in the U.S. over the last century-plus in the U.S.—likely since it is seen as a woman’s profession—but current in-service teachers will attest that their practices are significantly restrained by state mandates and schools polices anchored to state standards and a wide assortment of high-stakes tests (from state accountability to the SAT/ACT and Advanced Placement as well as International Baccalaureate).

Part of the reason I resist the inherent teacher-blame in pieces such as Goldstein’s on how writing is taught rests on my own experiences as a teacher educator of English teachers for 15 years.

My journey to teacher education began as adjunct teaching in local colleges throughout the 1990s, culminating with two wonderful years as the co-lead instruction in the Spartanburg Writing Project (SWP).

That fist summer institute of SWP introduced me to Dawn Mitchell as well as how common her struggle is among in-service teachers across the U.S.

While we at SWP worked diligently to teach our participants best practice in teaching writing, they—as did Dawn—routinely met resistance in their real-world schools and classrooms.

Principals and parents balked repeatedly at changed practices, even as those changes move from unwarranted to warranted instruction.

Once I became a full-time teacher educator, I had to anticipate a recurring refrain from the wonderful young people I was helping move into the field of teaching English; they nearly all said they valued what I had taught them about best practices in teaching reading and writing, but they were not able to implement most of those practices once they secured a job teaching.

So here is the dirty little secret of education blame in the U.S.: we simultaneously want to hold teachers accountable for student achievement even though we know teacher quality is a small percentage of those measurable outcomes and even though teachers are often implementing practices that are not supported by research but by mandate.

If we return to the Goldstein article and consider why student writing continues to fall short of our expectations, we must accept that how we measure student writing proficiency significantly shades what we believe about student proficiency and that teachers are mostly practicing in their classes what they are required to do (teach to standards, teach to tests) even when those mandates conflict significantly with what we know is best practice in fostering young students as writers.

Ultimately, there is a type of education reform that has never truly been implemented—seeking ways to increase teacher professional autonomy.

As someone with almost two decades as a public school English teacher and now 15 years as a college professor, I can attest that professional autonomy is one of the most powerful aspects of university teaching; we are hired for our expertise and then given the respect we deserve for behaving as professionals in our classrooms.

There is much about teacher certification as well as in-service teaching that deserves attention and reform, but currently, the discourse around teacher blame and why students (and schools) fail completely ignores the key cause behind all of this discord: accountability driven by standards and high-stakes tests, which is all folded into federal and state legislation.

Both teacher education and in-service teacher practices would be exponentially improved by teacher educator and teacher autonomy—and then we would find a much more valid context for holding both accountable.


See Also

Many Teachers Have ‘No Say’ in Decisions About Their Own PD, Survey Finds