Tag Archives: teaching

Recommended: Why We Cannot Go Back to Basics (Rethinking Schools)

[Header Photo by Element5 Digital on Unsplash]

Note

The article below appears in Rethinking Schools and brings together several problems with and connections between the “science of reading” and book banning/censorship movements that I have been address since 2018.


Why We Cannot Go Back to Basics: Reclaiming The Right to Teach Literacy, Daniel Ferguson, Laurie Rabinowitz, and Amy Tondreau

Although the “culture war” and “reading war” have been described as separate causes promoted by disparate organizations, their stories are more connected than they appear. Both book banning and SoR dogmatism limit what teachers can teach and what students can read, narrowing the ability of public schools to address children’s diverse needs. We see this most explicitly in conservative parent groups, including Moms for Liberty, who have made it clear they endorse both. This should be a wake-up call to critically examine the potential impact of phonics-based policies on public school students and teachers. 


Recommended

SOR Movement Maintains Conservative Assault on Teachers and Public Schools [Updated]

Beware Scripted Curriculum: More Trojan Horse Education Reform

Big Lies of Education: National Reading Panel (NRP)

We Teach English in Times of Perpetual Crisis: Selling a Story of Reading (and Literacy) [Webinar Companion Post]

Recommended: The Balancing Act by Dominic Wyse and Charlotte Hacking

Thomas, P.L. (2024, March). We teach English in times of perpetual crisis: The long (and tedious) history of reading crisis. English Journal, 113(4), 21-26. https://publicationsncte.org/content/journals/10.58680/ej2024113421

Thomas, P.L. (2024, May). Teaching English in the “science of reading” era: We teach English in times of perpetual crisis: Selling a story of reading. English Journal, 113(5), 16-22. https://publicationsncte.org/content/journals/10.58680/ej2024113516 [Access HERE until open access at EJ]

Thomas, P.L. (2024, September). We teach English in times of perpetual crisis: The media continue to misread teaching reading and literacy. English Journal, 114(1), 14-19. https://publicationsncte.org/content/journals/10.58680/ej2024114114 [Access HERE until open access at EJ]

Thomas, P.L. (2024, November). We teach English in times of perpetual crisis: For all ELA teachers, “the time is always now.” English Journal, 114(2), 21-26. https://publicationsncte.org/content/journals/10.58680/ej2024114221 [Access HERE until open access at EJ]

Thomas, P.L. (2023). The “science of reading,” education faddism, and the failure to honor the intellectual lives of all children: On deficit lenses and ignoring class and race stereotyping. Voices in the Middle, 30(3), 17-21. https://publicationsncte.org/content/journals/10.58680/vm202332439

The Science of Reading Movement: The Never-Ending Debate and the Need for a Different Approach to Reading Instruction (policy brief) – NEPC


Beware Scripted Curriculum: More Trojan Horse Education Reform

[Header Photo by José León on Unsplash, cropped]

It took a few years, but there was always a long game.

And there was a few decades of preparation along the way.

George W. Bush built the foundation for Trojan Horse education reform in the 1990s, including a false “miracle” narrative and efforts to establish scripted curriculum (a colleague and I examined that here).

Education reform, however, was never about improving learning or teaching, but about ideological agendas, conservative agendas.

The crisis/miracle cycles started with that Texas “miracle,” but included the Chicago “miracle” (to bolster Arne Duncan), the DC “miracle” (to promote Michelle Rhee’s grift), and the Harlem “miracle” (that solidly merged education reform as bi-partisan under Obama with the help of grifter Duncan).

What may prove to be the most successful (and harmful) “miracle,” however, is the media manufactured Mississippi “miracle,” grounded in 2019 NAEP scores.

Six years later, the real end game of these manufactured and false “miracles” are merging with an initial effort by W. Bush—de-professionalizing teachers with scripted curriculum. Note the connection in a recent misleading but recurring endorsement by Patrinos (from the Department of Education Reform, funded by Walton money in Arkansas) of that Mississippi “miracle”:

Teaching at the right level and a scripted lessons plan are among the most effective strategies to address the global learning crisis. After the World Bank reviewed over 150 education programs in 2020, nearly half showed no learning benefit.

And then, this disturbing piece by Korbey: Why US schools have fallen in love with scripted lessons.

After taking a swipe at NCTE, Korbey makes the same but false connection as Patrinos above:

Nearly all the states that have seen reading scores improve recently – including Mississippi, Louisiana, Tennessee and Alabama – have changed state law to encourage districts to choose from approved lists of HQIM.

Conveniently omitted in public advocacy and endorsements of scripted curriculum, is that this is a correlation; however, research has shown that curriculum, instruction, and teacher training are not the keys to increased test scores. Grade retention is:

[S]tates whose policies mandate third-grade retention see significant and persistent increases in high-stakes reading scores in all cohorts…. [T]here is no consistent evidence that high-stakes reading scores increase in states without a retention component.

And another omission is that research has shown scripted reading programs de-professionalize teachers, fail to serve the individual needs of students, and have “whitewashed” the curriculum, alienating the most under-served students in our schools [see Recommended below].

And thus, the end game:

Education reform is dedicated to perpetual education crisis for market and political goal.

Scripted curriculum, then, is not designed to improve reading proficiency, but to create one more step toward AI replacing teachers the same way self-checkout replaced cashiers in our grocery stores.

Recommended

Does the “Science of Reading” Fulfill Social Justice, Equity Goals in Education? (pt. 1)

America Dishonors MLK By Refusing to Act on Call for Direct Action (pt. 2)

Scripted Curriculum Fails Diversity, Students, and Teachers: SOR Corrupts Social Justice Goals (pt. 3)


Buyer Beware: Marketing Education Often an Incomplete Story

[Header Photo by Merakist on Unsplash]

Mainstream media loves a compelling story. And, regretfully, media tends to care very little how accurate or complete that story is.

Media coverage of education is almost entirely a series of misleading stories grounded in either crisis or miracle rhetoric.

One of the darlings of the media is the charter school, the one aspect of the school choice movement that has garnered bipartisan support.

However, as a type of school choice, charter schools must market themselves and recruit. So when media and school marketing combine, I urge “Buyer Beware”:

Here, The State (Columbia, SC) has platformed the principal of a charter school, who makes a couple important (but misleading) claims: the charter school is exceptional and that is because the school practices separating boys and girls for instruction.

“Exemplary High Performing School” is causally connected by Wooten to the boy/girl instructional segregation; however, rarely can a school conduct the sort of scientific research in-house to determine causation, and more importantly, student achievement (test scores) remain overwhelmingly a reflection of the students’ socioeconomic status (60+%), not the school, instruction, or teacher quality.

Here is the missing parts to this story:

Note that Langston Charter Middle has the third lowest poverty index (PI) in the state (12.9), and for comparison, in the same district, the Washington Center has one of the highest PI (96) in the state. [Note that Greenville has a incredibly wide range of low and high poverty schools because the district is large and covers an area of the state with significant pockets of poverty and affluence; and thus, neighborhood schools tend to reflect that socioeconomic reality.]

Further, if we look at Langston Charter Middle’s state report card, the “exceptional” seems to be missing:

Yes, the academic achievement is “excellent,” but again, this data point reflects mostly the very low PI for the students being served.

Note that when Langston Charter Middle is compared to schools with similar student demographics (Daniel Island School, 8.2PI, and Gold Hill Middle, 11.5 PI), the “exceptional” appears to be typical among similar schools:

Media and marketing do more harm than good for public education. When the media is fixated on incomplete and misleading stories and schools feel compelled to market themselves for customers, we all lose.

The OpEd run by The State is not about an exceptional school or the success of separating girls and boys for instruction (although that does speak into a current political ideology that wants this to be true).

The story, as usual, is incomplete, and the marketing is at best misleading.

Once again, many in the US do not want to hear or see the full story: Our schools and student achievement mostly reflect the socioeconomic status of the students’ parents, homes, and communities.

When it comes to media coverage of our schools, I must emphasize: Don’t buy the story being sold.


See Also

School Rankings Reflect “Social Capital Family Income Variables,” Not Education Quality

Misreading Reading Scores (Again) [Unpublished OpEd Submission]

[This piece has been submitted to national newspapers with no responses.]

[Header Photo by Kelly Sikkema on Unsplash]

Every two years reading scores make headlines. And this year, as has been the case since COVID, the news is not good. Scores are down (again), and the causes being pointed to for the drop are also wrong (again).

National Assessment of Educational Progress (NAEP) is the national program mandated with tracking student achievement. The 2024 results reveal that reading scores have hit their lowest point in 32 years. This decline is notable because in recent years many states have passed aggressive reading legislation, often labeled as the “science of reading” (SOR).

The SOR movement makes a few key claims: the US has a reading crisis, teachers fail to use “scientific” evidence for instruction, and educators and policymakers are making excuses by acknowledging poverty when addressing low reading proficiency.

When 2019 NAEP reading scores were released, Mississippi was proclaimed a “miracle” state for improving grade 4 reading scores despite being a high-poverty state, implying (without evidence) that those increases were caused by Mississippi implementing SOR policy. In the years that followed, the Mississippi “miracle” became the poster child for other states following the SOR legislative formula; to date 40 states and the District of Columbia have passed SOR legislation.

However, the Mississippi “miracle” story was an incomplete misreading of reading proficiency and policy.

With the average 2024 NAEP reading scores in further decline, the SOR era in reading reform appears to be failing. This is especially true for vulnerable students whose scores have dropped the most. Interpreting these scores correctly is key to forging a better path forward.

Thus, we must seek a more credible story about 2024 NAEP reading scores.

Let’s consider three sets of data from the Department of Defense schools (DoDEA), Florida, and Mississippi. These student populations include significant racial and socioeconomic diversity as well as multilingual learners and other vulnerable populations of students.

Florida and Mississippi have long been applauded for aggressive education and reading reform, and in 2024, their grade 4 reading scores remained in the top 25% of states, seemingly defying the odds. But Florida and Mississippi scored again well below top-scoring DoDEA schools.

Although many rush to ascribe this success to SOR policies, we should really be looking at a different (ultimately harmful) policy: third-grade retention based on state testing.

As education analysts John Westall and Amy Cummings concluded in a report on reading policy: “[S]tates whose policies mandate third-grade retention see significant and persistent increases in high-stakes reading scores in all cohorts…. [T]here is no consistent evidence that high-stakes reading scores increase in states without a retention component.”

In other words, by holding back the lowest performing students in third grade, grade 4 scores appear higher. Florida and Mississippi retain thousands of K-3 students annually.

Inflated scores are not learning; by eighth grade NAEP reading scores for Florida and Mississippi drop into the bottom 25% of states. The widely applauded “gains” in grade 4 are, in fact, a mirage.

Here is a different story: DoDEA schools are the top-scoring schools on NAEP tests and tell a story we’ve resisted admitting in the US. Maroun and Tieken found in 2024, replicating decades of similar research, that 60+% of student test scores are not linked to teacher quality, instruction, or programs but to out-of-school factors like socioeconomic background, home environment, and parental involvement to name a few.

While DoDEA schools have significant populations from poor and working-class backgrounds and serve diverse as well as vulnerable populations of children, these students have healthcare, food security, stable housing, and parents with stable work—and consistently high reading scores.

NAEP reading scores, again, are not a story about teacher and reading program failure or even student reading proficiency. These scores tell a complex story about a long history in the US of negligence, the lack of political will to address not only the education of all our children, but also their lives outside of school.

Media Manufactures Mississippi “Miracle” (Again) [Updated]

[Header Cropped from Photo by Miracle Seltzer on Unsplash]

I almost feel sorry for Louisiana. (See Update 2 below)

When the 2024 reading scores for NAEP were released, LA seemed poised to be the education “miracle” of the moment for the media and political leaders.

Since mainstream media seems to know only a few stories when covering education—outliers, crises, and miracles—the outlier gains by LA compared to the rest of the nation, reportedly still trapped in the post-Covid “learning loss,” was ripe for yet another round of manufacturing educational “miracles.”

However, the media is not ready to let go of the Mississippi “miracle” lie: There Really Was a ‘Mississippi Miracle’ in Reading. States Should Learn From It.

To maintain the MS “miracle” message, journalists must work incredibly hard to report selectively, and badly.

For example, Aldeman celebrates, again, MS as a outlier for for the achievement of the bottom 10% of students (carelessly disregarding that outlier data is statistically meaningless when making broad general claims):

But one state is bucking this trend: Mississippi. Indeed, there’s been a fair amount of coverage of Mississippi’s reading progress in recent years, but its gains are so impressive that they merit another look.

Next, Aldeman highlights reading gains by Black students in MS, omitting a damning fact about the achievement of Black (and poor) students in MS (which mirrors the entire nation):

That’s right, MS has the same racial and socio-economic achievement gaps since 1998, discrediting anything like a “miracle.”

But the likely most egregious misrepresentation of MS as a reading “miracle” is Aldeman “debunking” claims that MS gains are primarily grounded in grade retention, not the “science of reading.”

Notably, Aldeman seems to think linking to the Fordham Institute constitutes credible evidence; it isn’t.

So let’s look at the full picture about grade retention and MS’s reading scores on NAEP.

First, the research on increased reading achievement has found that only states with retention have seen score increases. Westall and Cummings concluded in a report on reading policy: “[S]tates whose policies mandate third-grade retention see significant and persistent increases in high-stakes reading scores in all cohorts…. [T]here is no consistent evidence that high-stakes reading scores increase in states without a retention component [emphasis added].” [Note that Aldeman selective refers to this study late in the article, but omits this conclusion.]

The positive impact of retention on test scores has not been debunked, but confirmed. What hasn’t been confirmed is that test score gains are actual achievement gains in reading acquisition.

Next, MS (like FL and SC, for example) has risen into the top 25% of states in grade 4 reading on NAEP, but then plummets into the bottom 25% of states by grade 8 (despite their reading reform having been implemented for over a decade), suggesting those grade 4 scores are a mirage and not a miracle:

And finally, MS has consistently retained about nine thousand students each year (mostly Black and poor students) for a decade; if the state was actually implementing something that works, the number of students being retained would decrease and (according the SOR claims that 95% of students can be proficient) disappear.

A final point is that media always omits the most important story, what research has shown for decades about student achievement:

Almost 63% of the variance in test performance was explained by social capital family income variables…. The influence of family social capital variables manifests itself in standardized test results. Policy makers and education leaders should rethink the current reliance on standardized test results as the deciding factor to make decisions about student achievement, teacher quality, school effectiveness, and school leader quality. In effect, policies that use standardized test results to evaluate, reward, and sanction students and school personnel are doing nothing more than rewarding schools that serve advantaged students and punishing schools that serve disadvantaged students.

High-poverty states and states with high percentages of so-called racial minorities are not, in fact, beating the odds—again, note that states have not closed the racial achievement gap or the socio-economic achievement gap.

Yes, too often our schools are failing our most vulnerable students. But the greater failures are the lack of political will to address the inequity in the lives of children and the lazy and misleading journalism of the mainstream media covering education.


Update 1

The Mississippi “miracle” propaganda is part of a conservative Trojan Horse education reform movement.

Note this commentary from the Walton-funded Department of Education Reform (University of Arkansas): Mississippi’s education miracle: A model for global literacy reform. The key reveal is near the end of the commentary:

Teaching at the right level and a scripted lessons plan are among the most effective strategies to address the global learning crisis. After the World Bank reviewed over 150 education programs in 2020, nearly half showed no learning benefit.

The goal is de-professionalizing teachers and teaching, not improving student reading proficiency.

Updated 2

The political, market, and media hype over both MS and LA are harmful because that misrepresentation and exaggeration drive the fruitless crisis/reform cycles in education and distracts reform from the larger and more impactful causes of student achievement.

To understand better education reform, I recommend the recently released Opportunity to Learn Dashboard.

According to the press release from NEPC:

Funded and maintained by the National Center for Youth Law (NCYL) and The Schott Foundation for Public Education, the Opportunity to Learn Dashboard tracks 18 indicators across 16 states. The project seeks to provide information about factors impacting the degree to which children of different ethnicities and races are exposed to environments conducive to learning.

However, indicators directly related to schools explain only a minority of the variation in achievement-related outcomes. Therefore, the dashboard includes out-of-school factors such as access to health insurance and affordable housing, as well as within-school factors such as exposure to challenging curricula and special education spending.

For both MS and LA, we must acknowledge the significant and robust systemic (out-of-school) disadvantages minoritized and impoverished students continue to face in both states:

Note here my points raised about lingering opportunity/achievement gaps exposed by NAEP scores in both states:

To emphasize again, NAEP scores do not reveal education “miracles” in either MS or LA. In fact, NAEP scores continue to show that education reform as usual is a failure.


Recommended

Does the “Science of Reading” Fulfill Social Justice, Equity Goals in Education? (pt. 1)

America Dishonors MLK By Refusing to Act on Call for Direct Action (pt. 2)

Scripted Curriculum Fails Diversity, Students, and Teachers: SOR Corrupts Social Justice Goals (pt. 3)

If We Are Scripted, Are We Literate? (Presentation)

Reading Deserves a New Story, Different Reform

[Header Photo by Gaelle Marcel on Unsplash]

You know the story: Students today can’t read.

And those who can, don’t read.

But there is more.

Children who can’t read have been cheated by their teachers, who fail to teach reading skills such as phonics.

And our national reading crisis is a threat to our very nation, especially our international economic competitiveness.

However, there are a few problems with this story.

If you were to find a Time Machine, you could travel to any year over the past century and hear the exact same story.

As well, this crisis rhetoric has been used historically and currently with math—and every other content area tested in the US.

Here is a story about reading you probably are not familiar with: There is no reading crisis, and there is no evidence that reading test scores are driven by reading instruction or programs.

Further, again, there is nothing unique or catastrophic about reading test scores or reading achievement by US students.

Historically and currently, reading test scores and achievement reflect a fact that has been replicated for decades:

Almost 63% of the variance in test performance was explained by social capital family income variables….The influence of family social capital variables manifests itself in standardized test results. Policy makers and education leaders should rethink the current reliance on standardized test results as the deciding factor to make decisions about student achievement, teacher quality, school effectiveness, and school leader quality. In effect, policies that use standardized test results to evaluate, reward, and sanction students and school personnel are doing nothing more than rewarding schools that serve advantaged students and punishing schools that serve disadvantaged students.

Now, consider a newer story: Post-Covid students are suffering a historic learning loss:

Reardon’s call for “long-term structural reform” must follow a new story about reading and a different approach to reading reform.

First, since the vast majority of causal factors reflected in reading standardized test scores are out-of-school conditions, the new reading story and different reform must address universal healthcare, food security and eliminating food deserts, home and housing stability, and stable well-paying job for parents.

Another out-of-school reform needed for reading is guaranteeing students have access to books and texts in their homes, communities (public libraries), and then in their schools (school and classroom libraries).

A simple program that gives every child from birth to high school graduation 20 books a year (10 chosen by the child/parents and 10 common texts) would build a library and ensure access to texts, one of the strongest research-based elements of reading acquisition.

Without social reform, reading scores will likely remain flat and inadequate.

The most important different aspects of a new story and reading reform is confronting traditional approaches to in-school reform in the US common since the 1980s. A different approach to reading reform must include the following:

  • De-couple reading reform and instruction from universal or prescribed reading programs and center teaching children to read (not implementing reading programs with fidelity). Admit there is no one way to teach all students to read, and provide the contexts that allow teachers to serve individual student needs.
  • Reform the national- and state-level testing of reading. The US needs a standard metric for “proficient” and “age level” (instead of”grade level”) shared on NAEP and state tests in grades 3 and 8; and that achievement level needs to be achievable and not “aspirational” (such as is the case with NAEP currently). National and state testing must be age-based and not grade-based to better provide stable data on achievement.
  • End grade retention based on standardized testing. Retention is punitive, and it harms children while also distorting test data.
  • Monitor and guarantee vulnerable populations of students who are below “proficient” to insure they are provided experienced and certified teachers and assigned to classes with low student/teach ratios.
  • Address teaching and learning conditions of schools, including teacher pay and autonomy.
  • Honor and serve students with special needs and multi-lingual learners.

While we have no unique or catastrophic reading crisis in the US—and even hand wringing over learning loss seems unfounded—we have allowed a century (or more) of political negligence to ignore the negative impact of children’s lives on their learning.

We have remained trapped in a manufactured story of reading crisis and that poverty is an excuse.

All the available evidence suggests otherwise.

Crisis, miracles, blame, and punishment have been at the center of the story everyone is familiar with. That story has never served the interests of students, teachers, or public education.

In an era of intense political hatred and fearmongering, this is a tenuous call, but if we really care about students learning to read, and if we truly believe literacy is the key to the economic and democratic survival of our country, reading deserves a new story, an accurate story, and a different approach to reform grounded in the evidence and not our cultural mythologies and conservative ideologies.

See Also

Big Lies of Education: Series

NAEP Serves Manufactured Education Crisis, Not Teaching and Learning

[Header Photo by Andy Feliciotti on Unsplash]

I teach an upper-level writing and research course for undergraduates as part of their general education requirements. The overarching project asks students to gather media coverage of an education topic in order to analyze the credibility of that coverage.

Since the course is undergraduate, I ask them to approach their analysis through critical discourse analysis, but I narrow that lens some for them. The process includes the following:

  • Identify the pattern of claims about the topics.
  • Evaluate the validity of the claims in the context of a literature review of the educational topic (limited to peer-reviewed, published recent journal articles).
  • Consider whose interests these claims serve (the CDA element).

I note that claims about education in the media tend to fall in a range of accurate, misleading, and false; however, for this analysis, identifying whose interest the claims serve is the key aspect of the evaluation.

False and accurate claims are typically easy to manage for students, but the misleading claims can be complicated.

For example, in public discourse about police shooting victims, two accurate data points are often cited: The majority of people shot and killed by police in the US are white and Black people are shot and killed at a higher rate than white people.

Failing to address both data points and clarifying why rates are more important than raw data contributes to media coverage being misleading, and thus, selectively emphasizing true data is often a form of manipulation and serves a particular population or ideology.

With another release of NAEP reading and math scores, we have an opportunity to address how media and political leaders tend to offer false and misleading claims based on NAEP score, but also, that NAEP itself serves to perpetuate the manufactured education crisis, which benefits the media (more clicks), political leaders, and the education market place.

Regardless of what national and state scores on NAEP are, the foundation of media and political claims is always “crisis.”

Ironically, perpetual “crisis” rhetoric and education reform since the early 1980s has had one clear outcomes—maintaining the status quo of educational and socioeconomic inequity in the US.

To consider this, let’s focus on Massachusetts and Tennessee.

Other than top-scoring DoDEA schools, MA sits atop reading scores in the US in both grades 4 and 8:

As a relatively low-poverty state, MA should rank above states with higher poverty students. However, MA certainly serves students in pockets of poverty as well as other vulnerable populations of students who tend to have low standardized test scores.

None the less, MA has joined the standard chorus in the US about reading. The Education Trust released a report in March 2024 providing “5 Things You Need to Know about the literacy crisis in Massachusetts.”

To be fair, MA is similar to most of the US where standardized tests scores have dropped post-Covid and those drops have coincided with MS’s Mass Literacy initiative from 2018:

Perpetual reform and perpetual crisis in education, regretfully, seems only to fuel more reform and more crisis.

Note that MA also has something in common with almost all states regardless of whether states have high or low NAEP results. Achievement gaps by race and socioeconomic status have remained fixed for almost three decades:

While a top-scoring state like MA is shouting “crisis” primarily based on a sort of national psychosis about the “science of reading,” TN is trying to have it both ways with a reading crisis and a celebration of 2024 NAEP scores.

An October 2023 report from the TN Department of Education, “Tennessee’s Commitment to Early Literacy,” forefronts the “Literacy Crisis in Tennessee” based on (you guessed it) historically poor rankings in NAEP reading scores.

One important point here is that the media and political discourse tend to focus on “bad” statistics such as rankings and averages—which is how TN establishes their “crisis.”

Yet, while the 2024 NAEP data has spurred a great deal of misguided doom and gloom, TN is putting a positive spin on their results: Nation’s Report Card Shows Meaningful Academic Gains as a Result of Tennessee’s Commitment to Public Schools.

For political leaders, “we have a crisis” and “I have saved us from the crisis” are not a sequential series of events, however, but a permanent rotation.

So why this positive spin for TN?

While the national average on NAEP reading has dropped, TN has experienced in 2024 a slight uptick. Because most everyone else was dropping, then, TN has seen a rise in their rankings (a key example of why ranking is a “bad” statistic).

Important again is that like MA and most states, TN scores for racial and socio-economic gaps remain fixed: “This performance gap was not significantly different from that in 1998.”

These responses to NAEP by MA and TN reveal a stark lesson that NAEP serves the interests of the media, politicians, and the education market place, but at least since 1998, NAEP hasn’t provided the data needed for any sort of genuine education reform or analysis.

Education is a political and market football, in fact.

Here are a few better takeaways from NAEP:

  • NAEP’s achievement levels are designed to be confusing and support the manufactured education crisis (see here).
  • Using NAEP to rank and sort is misleading and doesn’t support needed reform.
  • NAEP scores do offer some important facts related to achievement gaps and the pervasive influence of affluence and poverty on educational outcomes, but the media and political leaders choose to ignore those lessons.
  • Decades of NAEP reinforce this conclusion by Maroun and Tienken: “Policy makers and education leaders should rethink the current reliance on standardized test results as the deciding factor to make decisions about student achievement, teacher quality, school effectiveness, and school leader quality. In effect, policies that use standardized test results to evaluate, reward, and sanction students and school personnel are doing nothing more than rewarding schools that serve advantaged students and punishing schools that serve disadvantaged students.”
  • Media persist in focusing on only two stories about education: Crisis and outliers; both of which serve the interests of anyone expect students and teachers.

Like my students in my upper-level writing and research course, we would all benefit from evaluating the claims being made by media and political leaders in order to determine, first, is the claims are true (they often as misleading or false), and then to confront in whose interests these claims are being made.

Maybe this isn’t surprising given the current and historical political climate in the US, but almost never are the interests of students and teachers being served—especially when the interests of the most vulnerable students are the issue.

The “Science of Reading” Ushers in NAEP Reading Decline: Time for a New Story

With the release of the 2024 NAEP reading results, a disturbing new story is developing:

The media has long been obsessed with reading in the US, crying “crisis” every decade over the past century. The most recent media-based reading crisis has prompted aggressive and new reading legislation reaching back over a decade, policy and programs identified as the “science of reading” (SOR).

The hand wringing over the 2024 NAEP reading results, however, seems to focus on learning loss and post-Covid consequences—not that reading achievement on NAEP was flat during the balanced literacy era and now has dropped steadily during the SOR era:

The senior cohort in the 2024 NAEP reading scores represent the SOR era begun in 2012.

Suddenly, media appears to forget that the SOR movement was built on a series of baseless claims: the US has a reading crisis (despite NAEP score being flat for decades) because teachers do not know how to teach reading and rely on failed reading programs and balanced literacy.

The foundational claim of the SOR movement has been firmly discredited: “[T]here is no indisputable evidence of a national crisis in reading, and even if there were a crisis, there is no evidence that the amount of phonics in classrooms is necessarily the cause or the solution.”

But a key element of the SOR story is often overlooked: “One of the excuses educators have long offered to explain America’s poor reading performance is poverty.”

In other words, the SOR story argues that the US has a reading crisis that is entirely the result of in-school policies and practices, that SOR-based reading instruction guarantees 95%+ of students will achieve reading proficiency.

How then is the recent 5-year decline in NAEP scores being blamed on out-of-school factors, Covid learning loss? The story being sold is such blame is merely an excuse.

The problem here is that the entire SOR story is a series of misrepresentations and ideological claims not grounded (ironically) is research or evidence.

As I have noted, NAEP achievement levels are confusing since “proficient” is well above grade level and “basic” tends to correlate with most state metrics for “proficient” (see here for a full explanation and state/NAEP correlations).

However, journalists persists is misrepresenting NAEP scores in order to feed their manufactured “crisis” story: Two-Thirds of Kids Struggle to Read, and We Know How to Fix It.

With the release of 2024 NAEP scores on reading, we have an opportunity to embrace a different story, a credible story, by examining scores from Department of Defense (DoDEA) schools as well as Mississippi and Florida.

First, note that DoDEA schools again are the top scoring schools in grade 4 reading, but MS and FL rank in the top 25% of states despite challenging populations of students being served (both states appear to be outliers defying the odds):

Both MS and FL have been praised for their reading and education reform; however, there are two parts to this “miracle” story that are often left out, that show there is a mirage, not a miracle.

First, MS and FL join many states that have enacted SOR reading reform over the past decade-plus, yet the research on that reading reform highlights something other than reading instruction or programs.

Westall and Cummings concluded in a report on reading policy: “[S]tates whose policies mandate third-grade retention see significant and persistent increases in high-stakes reading scores in all cohorts…. [T]here is no consistent evidence that high-stakes reading scores increase in states without a retention component [emphasis added].”

States implementing K-3 grade retention are gaming the system by pulling out the lowest performing students and then re-inserting them into the testing population when older.

In fact, MS has been retaining about 9000-10,000 K-3 students a year since 2014, and FL retains about 17,000 students annually. [1]

Beyond the impact of grade retention on test scores, we should also ask: If SOR “works,” why do states continue to retain about the same number of students per year?

But NAEP also tells a story about SOR that has been ignored for years. Both MS and FL rank in the top 25% of grade 4 but the bottom 25% by grade 8 while DoDEA remains the top scoring schools in both grades:

Grade retention creates a mirage of achievement in grade 4 that disappears by grade 8, further evidence that SOR is not working at either grade.

Reading achievement as measured on testing has never been about reading instruction, teacher quality, or reading programs.

DoDEA school reading achievement is a testament to what research has shown for decades about student achievement:

Almost 63% of the variance in test performance was explained by social capital family income variables….The influence of family social capital variables manifests itself in standardized test results. Policy makers and education leaders should rethink the current reliance on standardized test results as the deciding factor to make decisions about student achievement, teacher quality, school effectiveness, and school leader quality. In effect, policies that use standardized test results to evaluate, reward, and sanction students and school personnel are doing nothing more than rewarding schools that serve advantaged students and punishing schools that serve disadvantaged students.

DoDEA student populations are diverse, often coming from impoverished and working class backgrounds; these schools also serve vulnerable and challenging populations of students.

However, teacher pay is high, and those students have healthcare, food and housing security, and parents with stable work.

DoDEA students almost all have the advantages mostly afforded children living in privilege so that how and what they are taught can matter.

If reading and literacy matter—and they do—and education matters in the US, we are well past blaming teachers, declaring false “miracles,” and jumping on the reading program merry-go-round once again.

Students must have their lives addressed so that their education can serve them well.

NAEP scores tell us little about reading (or math), but confirms again and again that the US is a country determined to ignore the corrosive impact of inequity on the lives and education of children.


Update

Media has only one story—a false one—about outliers in NAEP scores. Compare the coverage of MS in 2019 with LA 2024:

[1] Note that in the early 2000s, FL was the “miracle” state and established the Florida Model that essentially became the MS “miracle.”

Next up is Louisiana, and most of the coverage is claiming LA’s success is because the state has copied MS.

And a part of the lineage is more grade retention. Here are the currently available data on LA grade retention:

Writing Process: Scholarly/Academic Writing Edition

[Header Photo by 🇸🇮 Janko Ferlič on Unsplash]

Like many academics working in higher education, I spent several days over my holiday break preparing my courses for spring (two first-year writing seminars and one upper-level writing/research course) and then an intense three days writing and submitting a scholarly chapter on growth mindset and grit for an upcoming book.

I am fortunate, I think, because my teaching life and my writing life continually inform each other. Especially when teaching my writing-intensive courses, I teach as a writer and scholar, fore-fronting my writing/scholarship in my teaching.

My chapter on mindset and grit gave me a perfect opportunity to think deeply about and prepare new materials for my courses this spring (access those artifacts in this folder: Scholarly Essay Process).

As a writing teacher, I have been struggling throughout my 40-plus-year career with the negative impact of templates and scripts for students developing the skills and knowledge they need to be autonomous and compelling writers.

I have rejected, for example, the five-paragraph essay model, and I have challenged the mechanical implementation of the writing process as a sequential series of steps.

The problem is that this crusade against templates and scripts is not as simple (or effective) as I initially believed many decades ago.

Another problem with rejecting templates and scripts is that a significant amount of scholarly and academic writing is bound by scripts, word-count limits, formatting requirements, and citation/style guidelines.

My evolved and more nuanced position on templates and scripts in writing instruction and assignments acknowledges that beginning writers need opportunities to read widely in order to develop their own “scripts” for a wide variety of writing types. Of course they also need structure, but starting with the rigid template does far more harm than good for emerging writers.

Then, as students-as-writers move into high school and college, they need more experiences with authentic templates and guidelines found in much of academic and scholarly writing.

The editors of the chapter I just completed, for example, sent writers an content outline for chapters to follow as well as a word count limit and citation/style sheet requirements (APA).

When I write reviews for a think tank, I receive the same structures and very rigid expectations for staying within those limits (including their own in-house style sheet).

The irony, then, is that this spring, my first-year writing seminar will focus on challenging scripts and “rules” for essays and writing while my upper-level writing/research class will be writing a strictly scripted major scholarly essay (I assure upper-level students that this experience will prepare them for graduate school, and I recently received an email from a former student in this course telling me “thank you” for just that).

While I feel like my teaching of writing has better bridged the gap between helping students acquire the broad concepts of effective and compelling writing (versus imposing on them artificial templates and “rules”), I continue to struggle with fostering in students the sort of writing process that would better serve them.

Similar to my stance on the essay form, I teach that the writing process is not sequential or a rigid template, but a set of concepts that most writing addresses to help produce a writing final product needed for the purposes of that project. In other words, these broad concepts are fairly stable but the so-called “steps” may differ and the time spent on each “step” likely will vary for different writing purposed.

For scholarly writing, the writing process includes much more than composing sentences and paragraphs. Here, then is a brief overview of my recent process this week writing and submitting my book chapter on mindset and grit.

Let me start with a caveat that I think should be shared with students.

When most scholars start a writing project, we are dealing with content that we have expertise in; my project on mindset and grit has years of blogging and gathering research behind the brief process I followed over three days.

My first steps included revisiting the chapter guidelines sent by the editors, confirming formatting, citation, word count, etc.

Then, as I stress to students, I prepared my Word document, conforming to APA guidelines and inserting the subheads, etc., along with the chapter template required by the editors. One concern I have with students is they tend to address formatting last, and I urge them to address this tediousness first. (See my submitted and not yet edited copy here.)

Next, I put the required page break in the end of the document and prepared my working references list. To create the list, I reviewed my many blogs on the topics, searched through my library data bases, reached out to other scholars for recommendations, and carefully culled sources from the references of the sources I had gathered (working from the most recent publications).

Let me stress here that as I detail my process, as I worked, these “steps” became more and more recursive in that as I worked in one “step” I would invariably return to and revise other “steps” (I caught simple formatting edits and typos, for example, in many of the “steps” being detailed here even as that is considered the editing “step”).

One goal as I worked was to create a compelling opening that included a thesis paragraph clearly aligned with the subheads and organization of the chapter. I drafted that opening on the first day and then I carefully edited and formatted all of my references, checking APA and loosely thinking about removing or adding needed sources. See the opening here:

Literacy educator and scholar Lou LaBrant (1947) asserted almost eight decades ago: “A brief consideration will indicate reasons for the considerable gap between the research currently available and the utilization of that research in school programs and methods” (p. 87). While valid in the mid-2020s, a slightly more nuanced argument needs to be proposed: Scientific research on teaching and learning is often lost in translation once it is packaged by the education marketplace and reduced to legislation and policy. In other words, what is popular, packaged, and mandated in education is too often an oversimplified and even misguided version of scientific findings, nothing more than a fad. An even more complicating problem, as well, is that classroom practices likely should be guided by more than experimental and quasi-experimental research (Wormeli, n.d., The problem).

Over the past decade-plus, two examples of research lost in translation include growth mindset and grit. Carol Dweck (2008), often publishing with others (Dweck & Yeager, 2019) examines the role of mindset is academic success. Grit is grounded in the research and advocacy of Angela Duckworth (2018); however, a great deal of the popularization of grit occurred through the journalism and advocacy of Paul Tough (2013) who promoted “no excuses” charter school practices, specifically the Knowledge Is Power Program (KIPP) charter chain (Abrams, 2020). While growth mindset and grit are distinct concepts and educational movement, they tend to share similar spaces and problems in practice.

This chapter explores the central claims of growth mindset and grit before considering the validity of those claims in the context of the following critical questions: How are growth mindset and grit grounded while also perpetuating bootstrapping, rugged individualism and meritocracy myths? What are the roles of deficit ideologies (word gap, victim blaming, racism, sexism, classism, etc.) in popular advocacy for growth mindset and grit? As well the research and popular claims about growth mindset and grit are interrogated at three levels: (1) research validity and robustness, (2) evidence-based or ideologically based, and (3) racism and classism.


The next morning I reviewed and organized all of sources to comply with the structures required in the chapter. Here, I think, is where students are lost because of their previous experiences writing inauthentic research papers (in which many students gather the required number of sources and then simply walk the reader through their sources, writing about the sources and not their topic).

I created a table by my topics, mindset and grit, and then by the three major themes/patterns I planned to address; the key here, for students, is recognizing the need to focus on the patterns in their discussion and to cite multiple sources for those patterns.

I also created a listing of sources by my major topics, and then carefully reviewed them all to be sure I had classified them correctly and to identify the few I wanted to cite or quote more fully (I stress to students who have more experience with MLA and textual analysis that quoting is only one way to give evidence in scholarly writing and is often discouraged in many disciplines when not doing textual analysis).

Analyzing and organizing my evidence is designed to creating writing that offers a compelling generalization that is valid followed by a representative source or two to support the pattern; for example:

However, the current public discourse around mindset has made a significant turn to being critical and even skeptical (Study finds, 2018; Tait, 2020; Young, 2021a, 2021b). This shift is spurred by the growing research base that fails to replicate the primary claims of mindset advocacy or shows negative correlations or harm in implementing mindset intervention over other aspects of learning and achievement (Brez et al., 2020; Burgoyne et al., 2020; Burnette et al., 2018; Dixson et al., 2017; Ganimian, 2020; Li & Bates, 2019; Macnamara & Burgoyne, 2023; Sisk et al., 2018; Schmidt et al., 2017). Brez at al. (2020) conclude: “The pattern of findings is clear that the intervention had little impact on students’ academic success even among sub-samples of students who are traditionally assumed to benefit from this type of intervention (e.g., minority, low income, and first-generation students)” (p. 464). And Macnamara and Burgoyne (2023) make a more problematic assertion:

Taken together, our findings indicate that studies adhering to best practices are unlikely to demonstrate that growth mindset interventions bene t students’ academic achievement. Instead, significant meta-analytic results only occurred when quality control was lacking, and these results were no longer significant after adjusting for publication bias. This pattern suggests that apparent effects of growth mindset interventions on academic achievement are likely spurious and due to inadequate study design, flawed reporting, and bias. (p. 163)


Again, I need to emphasize that students must understand that several of these steps require and prompt continuous revision and editing. I returned to my title and the thesis paragraph for revision as I drafted the two major subhead sections and the subheadings under those. In other words, I was then in a constant state of seeking coherence in the chapter whereby all the parts match and create the whole (which then is reinforced by the final section/closing of the chapter).

For students, I will stress that I drafted an opening on the first day, drafted the first major subheading section the second day, and then drafted the second major section and closing the third day. But the writing parts were embedded in a great deal of reading, cataloguing, and organizing.

I also completed a full initial draft, but then let that sit for a while before doing a full re-read, revision, and editing session with the entire chapter in front of me; I did several re-read-revise-edits along the way as well.

For students, then, here is what they should see as elements of a writing process for academic/scholarly writing:

  • Identify writing assignment guidelines, formatting requirements, and citation style.
  • Prepare your Word document per those guidelines, creating your initial title, subheads, and any guiding bullet points or questions detailed in the assignment.
  • Create working references list, addressing citation formatting before working further.
  • Create an initial compelling opening (multiple paragraphs) with a thesis paragraph that correlates with the title, the organization, and subheads of the essay.
  • Read, re-read, organize, and catalogue (patterns/themes) references based on the organization of the assignment; identify the representative anchor sources that will be used to elaborate on the patterns identified and cited with multiple valid sources. Be sure to carefully identify direct quotes and include citation, page or paragraph numbers, etc., when creating a matrix of patterns and analyses of the evidence.
  • Revise and edit throughout these steps, even significant revisions such as addressing the title, the thesis paragraph, or organization if the review of the evidence prompts those revisions.
  • Create a full first draft, and then let that sit. The final step should be a careful re-read to revise and edit before submitting.

The essay form and the writing process are important concepts for developing writers and students to understand, and that understanding must come from authentically engaging with both in supportive environments.

The challenge with teaching students to write generally and then as academics/scholars is that there are too many moving parts and simply no hard and fast “rules” to govern either the essays they write or the process they use to write them.

The Outlier Story: How Education Journalism (Almost) Always Gets It Wrong

[Header Photo by Will Myers on Unsplash]

The first two decades of my career as a literacy educator were spent as a high school English teacher in rural Upstate South Carolina, the high school I had graduated from and my home town.

This began in 1984 when SC had passed sweeping education legislation that would become the standard legislative approach across the US—accountability policy grounded in state standards, high-stakes testing (grades 3 and 8 with exit exams in high school starting in grade 10), and school report cards.

SC was an early and eager adopter of the “crisis” rhetoric fueled by A Nation at Risk report released under the Reagan administration.

That high school and town were populated mostly by working-class and poor people; the town and smaller towns served by the high school were dead or dying mill towns.

Schools had far more poverty than the data showed because rural Southerners often refused to accept free and reduced meals (the primary data point for measuring poverty in schools).

However, for many years the high school ranked number 1 in the entire state for student exit exam scores in math, reading, and writing. Because of our student demographics (and notably because these students had relatively low or typical scores in grade 8 testing), we were what many people would refer to as a “high flying” or “miracle” school.

In more accurate statistical terms, we were an “outlier” data point in the state.

I have been in SC education for an ongoing five decades, and the overwhelming body of data related to student achievement in the state has matched what all data show across the US—measurable student learning is most strongly causally related to the socioeconomic status and educational levels of those students’ parents.

Further, the full story about how we achieved outlier status includes two aspects.

One is that from grade 8 to grade 10 testing, the population of students changed because of students dropping out of school (and these were among the lowest scoring students in grade 8). In fact, students were often encouraged to drop out and enroll in adult education (a two-fer win for the school because they would not be tested and enrolling in adult ed removed them from the drop-out data).

A second part of the story is that students scoring low in grade 8 were enrolled in two math and two ELA courses in grade 10. The “extra” courses were specifically designed as test-prep for state testing. We rigorously adopted a teach-to-the-test culture.

For the state writing exam, for example, we discovered that the minimum text a student could produce was an “essay” with a three-sentence introduction, a five-sentence body, and a three-sentence conclusion. Students in the “extra” ELA course wrote dozens of 3-5-3 essays in grade 10 with the teacher focusing on helping students avoid the “errors” that would flag the text as a below standard.

Many of us found the 3-5-3 approach to writing became a huge problem when students were required to write in other courses; even as students “passed” the state writing exam, they were not performing well as writers in other courses, and even refusing at times to write more than 3-5-3 essays.

For the high-stakes accountability era, we did do a great deal of good because many students across the US passed all their courses but could not receive a diploma because of exam exams. Most of our students graduated, and not because we did anything underhanded.

Yet, I must stress that how we accomplished our outlier status was likely not scalable, but more importantly, our approach should not be replicated by other schools.

Fast-forward 40 years, and education journalism has written hundreds and hundreds of stories not only in pursuit of “outlier” schools, but carelessly framing them as both proof of the on-going (permanent) education crisis and that “status quo” education refuses to implement what we know “works.”

The newest iteration of this misleading story in education is the “science of” movement grounded in the “science of reading” story first popularized by Emily Hanford, who wrote about a “miracle” school in Pennsylvania. This compelling but false story has been parlayed into an even more successful podcast as well as spawning dozens of copy-cat articles by education journalists across the country.

Media, however, never covered Gerald Coles’s careful debunking of the “miracle” school Hanford featured. Similar to my story above about the beginning of my teaching career, the full story of that school was quite different than what was covered in the media.

And as 2024 drew to a close, education journalists simply have no other lens that this: Which School Districts Do the Best Job of Teaching Math?

To be blunt, education journalists are mistakenly compelled to focus on the “exceptional” districts (outliers) while ignoring the more compelling red line that, again, shows what, in fact, is normal and what can and should be addressed in terms of educational reform—the negative impact of poverty on educational attainment.

So here is a story you likely will not read: Education journalism is failing public education, and has been doing so for decades.

Education journalists are blindly committed to the “crisis” and “outlier” stories because they know people will read and listen to them.

The “outlier” story makes for a kind of “good” journalism, I suppose, but the problem is that these stories become popular beliefs and then actual legislation and policy.

The current”science of” movement is riding a high wave because of the “science of reading” tsunami. But like all the misguided reforms since the original false education story, A Nation at Risk, this too will crash and reveal itself as a great harm to students, teachers, and our public school system.

This is boring, I know, but most outlier stories are ultimately false or they simply are not replicable or scalable, as I explained in my opening story.

If we genuinely care about student learning, teaching, and the power of public education, we need education journalists more dedicated to the full story and the not the outliers that help drive their viewing numbers.


Recommended

Big Lies of Education: A Nation at Risk and Education “Crisis”

Big Lies of Education: Reading Proficiency and NAEP

Big Lies of Education: National Reading Panel (NRP)

Big Lies of Education: Poverty Is an Excuse

Big Lies of Education: International Test Rankings and Economic Competitiveness

Big Lies of Education: Grade Retention