Testing, the Problem Not the Solution

Let’s start with a thought experiment.

Imagine a world where being a runner is held in high regard, well above students’ aptitude in reading, ‘riting, and ‘rithmetic.

Teacher A at XYZ Elementary School takes her third-grade class out to the school track, lining them up to run the 100-meter dash to set a baseline of data for determining the fastest runners in the class.

Across town at ABC Elementary School, Teacher Z ushers her third-graders to the high school to establish her baseline data, sending off these children on 2 laps of the 5K cross country trails.

Mid-year, Student J transfers from XYZ Elementary School, where J had placed 1st in the initial 100-meter dash, to ABC Elementary School just in time for the year-end 10K to assign final grades.

J had excelled all year in the 40-yard dash, but floundered at the 10K, not able to finish the run and receiving an I for third grade, thus was retained.

In this brief allegory, we should confront the realities about high-stakes testing that are often muted by our blind faith in the perennial existence of tests such as IQ testing, state standards-based testing, and college entrance exams such as the SAT and ACT:

  • Regardless of standards, curriculum, textbooks, or even what teachers teach in the classroom, as Gerald Bracey has warned: What you test is what you get (WYTIWYG).
  • The testing format and context (see above the 100-meter dash v. a 10K) have a significant impact on the outcomes; in the thought experiment, which student is labeled a “fast runner” changes because of the type of test, not necessarily the abilities or even effort by the teachers and the students.
  • Pre- and post-testing are not as effective or fair as we tend to assume—notably since the real world includes a great deal of transient students. (Caution: A universal set of standards, curriculum, and tests may solve this problem, but cannot address the first two bullets above.)
  • What is tested and how are always political decisions by some authority in power. This confirms that all testing is political and that no testing is objective or neutral.
  • Testing is always reductive (giving evaluative power to a limited but claimed representative set of acts over behaviors that require more time and greater nuance) and serves mostly goals of efficiency, not goals of authenticity.

Now let’s turn to the soap opera that is education reform, fatally committed to the accountability paradigm (ever-new standards and ever-new high-stakes tests—all promised to be better than those before, even as those before were declared the best ever)

First, let’s visit Chicago, PARCC pushback prompts Illinois to remake controversial test for 3rd-8th graders:

Math and reading exams known as PARCC spawned angst and outright rebellion when the tests launched in 2015, ushering in a new era of state testing in Illinois public schools.

But that new era appears to be short-lived, with this spring’s PARCC exams possibly the last for the state’s third- to eighth-grade students, educators say.

Here is yet one more brick removed from the crumbling wall of Common Core—a standards revolution that guaranteed world-class standards and tests that would usher in a new era of education reform across the U.S.

Next, and related, while the Common Core wall crumbles, and the concurrent rush to hold teachers accountable for student test scores on those Common Core tests flounders, one of the primary advocates and funders of the Common Core disaster has been Bill Gates and his foundation.

Interesting to note, then, that once again, as Nancy Flanagan details, Gates has changed his tune in the wake of his most recent promises failing:

Looks like Bill Gates, having totally solved the common standards problem, mastered the vexing “teacher evaluation using student test data” challenge, and designed right-sized schools, is now moving deeper into the heart of what has traditionally been teachers’ core professional work. Curriculum, that is.

“Our goal is to work with the field to make sure that five years from now, teachers at every level in secondary school have high-quality aligned curriculum in English, math, and science,” Bill Gates said in a speech last fall, describing curriculum as “an area where we feel like we’ve underinvested.”

And third, even internationally, the default urge in education reform is not only new testing, but more: Setting more exams to combat stress among school students is utterly absurd.

As I warned three years ago, Tests don’t improve learning. And PARCC will be no different.

In fact, educators for well over three decades have warned that accountability driven by standards and high-stakes testing has never been the appropriate reform mechanism for the core problems facing universal public education: crippling inequity in both the lives and formal education of the most vulnerable students.

Tests, then, are the problem and not the solution.

Tests are a distraction, keeping our gaze on students and teachers and away from the inherent inequity of the tests themselves—instruments of those in power who decide what matters and how by what is tested and how.

In education, the problem has never been about the quality of tests (or standards, or curriculum, or textbooks) but about the presence of those tests and the power they wield.

We remain trapped in refusing to learn the bitter lessons from chasing better tests.


See Also

Thinking about Tests and Testing: A Short Primer in “Assessment Literacy,” Gerald Bracey

Seventeen reasons why football is better than high school, Herb Childress

Advertisements

The Politics of Education Policy: Even More Beware the Technocrats

Man Prefers Comic Books That Don’t Insert Politics Into Stories About Government-Engineered Agents Of War (The Onion) includes a simple picture of a 31-year-old white male with the hint of a soon-to-be Van Dyke:

The fictional “man,” Jeremy Land, explains:

“I’m tired of simply trying to enjoy escapist stories in which people are tortured and experimented upon at black sites run by authoritarian governments, only to have the creators cram political messages down my throat,” said Land, 31, who added that Marvel’s recent additions of female, LGBTQ, and racially diverse characters to long-running story arcs about tyrannical regimes turning social outsiders into powerful killing machines felt like PC propaganda run amok. “Look, I get that politics is some people’s thing, but I just want to read good stories about people whose position outside society makes them easy prey for tests run by amoral government scientists—without a heavy-handed allegory for the Tuskegee Study thrown in. Why can’t comics be like they used to and just present worlds where superheroes and villains, who were clearly avatars for the values of capitalism, communism, or fascism, battle each other in narratives that explicitly mirrored the complex geopolitical dynamics of the Cold War?”

The satire here is the whitesplaining/mansplaining inherent in the politics of calling for no politics.

It strains the imagination only slightly to understand how this commentary on comic book fanboys also parallels the persistent combination in education of calling for no politics while using policy and a narrow definition of data and evidence to mask the racial and gender politics of formal schooling.

Let’s imagine, then, instead of the fictional Land an image of David Coleman (who parlayed his Common Core boondoggle into a cushy tenure as the head of the College Board) or John Hattie (he of the “poverty and class size do not matter” cults that provide Hattie with a gravy train as guru-consultant).

A close reading of David Coleman’s mug shot reveals a whole lot of smug.

In his “visible learning” hustle, John Hattie likely prefers to keep his enormous profits invisible.

Coleman and Hattie as technocrats feed the systemic racism, classism, and sexism in formal education policy and practice by striking and perpetuating an objective pose that serves as a veneer for the normalized politics of political and economic elites in the U.S.

As Daniel E. Ferguson examines, Coleman’s Common Core propaganda, the rebranded traditional mis-use of New Criticism into “close reading,” argues:

Close reading, as it appears in the Common Core, requires readers to emphasize “what lies within the four corners of the text” and de-emphasize their own perspective, background, and biases in order to uncover the author’s meaning in the text.

However, Ferguson adds,

Critical reading, in contrast, concerns itself with those very differences between what does and does not appear in the text. Critical reading includes close reading; critical reading is close reading of both what lies within and outside of the text. For Paulo Freire, critical reading means that “reading the world always precedes reading the word, and reading the word implies continually reading the world.”

And thus, close reading serves the cult of efficiency found in the high-stakes standardized testing industry that depends on the allure of believing all texts have singular meanings that can be assessed in multiple-choice formats—a dymanic Ferguson unmasks: “The story beyond the four corners of Coleman’s video is one of a man whose agenda is served by teachers following a curriculum that requires students to read in a way assessable through standardized tests he oversees and profits from.”

Simultaneously, of course, keeping students and teachers laser-focused on text only detracts them from the richer context of Martin Luther King Jr. and the broader implications of racism and classism informed by and informing King’s radical agenda.

Simply stated, close reading is a political agenda embedded in the discourse of objectivity that whitewashes King and denies voice and agency to King, teachers, and students.

Concurrently, Hattie’s catch phrase, “visible learning,” serves the same political agenda: Nothing matters unless we can observe and quantify it (of course, conveniently omitting that this act itself determines what is allowed to be seen—not the impact of poverty or the consequences of inequity, of course).

Hattie’s garbled research and data [1] match the recent efforts in education reform to isolate student learning as the value added (VAM) by individual teachers, yet another off-spring of the cult of efficiency manifested in high-stakes standardized testing.

Just as many have debunked the soundness of Hattie’s data and statistics, the VAM experiment has almost entirely failed to produce the outcomes it promised (see the school choice movement, the charter school movement, the standards movement, etc.).

Coleman and Hattie work to control what counts and what matters—the ultimate in politics—and thus are welcomed resources for those benefitting from inequity and wishing to keep everyone’s gaze on anything except that inequity.

The misogyny and racism among comic book fanboys allows the sort of political ignorance reflected in The Onion‘s satire.  If we remain “within the four corners of the text” of Marvel’s Captain America, for example, we are ignoring that, as I have examined, “Captain America has always been a fascist. … But … Captain America has always been our fascist, and that is all that matters.”

The politics of education policy seeks to point the accusatory finger at other people’s politics, and that politics of policy is served by the technocrats, such as Coleman and Hattie, who feed and are fed by the lie of objectivity, the lie of no politics.


[1] See the following reviews and critiques of Hattie’s work:

28 November 2017 Education Reader

I am the teacher South Carolina wants to retain, and I am barely hanging on, Rachel Caulder

Teachers need autonomy. Thankfully, I teach in a school that does not use curriculum alignment documents or strict pacing guides, and my administration values the judgment of teachers within our classrooms. Teachers in districts that are solely focused on numbers are restricted, and students suffer because no allowance is made for differentiation or reteaching for content-mastery. In districts with strict pacing guides, teachers are left with no option but to stay the course — even when they know they are failing their students.

Why do schools use grades that teach nothing? Jonathan Lash

At the college where I serve as president, we do evaluate student work; we just use a higher-quality method. Our students receive written evaluations not only on every assignment, but also for every course and learning activity. These evaluations are designed to be formative teaching tools.

For similar reasons, we completely stopped accepting SAT and ACT for admissions two years ago, after an internal study revealed standardized test scores are poor predictors of student success at Hampshire. We also recognized the bias of standardized tests against low-income students, and the negative influence of standardized testing on education.

A North Carolina Teacher’s Guest Post on His/Her EVAAS Scores

NEPC Review: Tackling Gaps in Access to Strong Teachers: What State Leaders Can Do (The Education Trust, October 2017)

The Every Students Succeeds Act (ESSA) directs states and districts to identify equity gaps in students’ access to excellent educators and transformative school leaders. States are encouraged to use Title II funds strategically in order to identify and remedy these gaps. A new report from The Education Trust draws on ESSA documents and state teacher equity plans to provide guidance to state leaders, including some sound advice—but with significant omissions. The report does not engage with thorny issues around alternative pathways into teaching, and it largely skirts issues around incentives for supporting teacher recruitment and retention in hard-to-staff schools. The report also does not consider what attracts teachers into the profession and into particular school environments. Likewise, the report fails to draw on the explicit remedies sought by ESSA to link high-quality leadership with strong teacher recruitment and retention. Instead, the report casts the teacher equity problem primarily in terms of labor supply shortages and treats teachers like interchangeable widgets. Relying heavily on advocacy sources, it misses an opportunity to unpack the root causes of the teacher retention problem, particularly the corrosive impact of past federal and state policies on the teaching profession. The report does not help state leaders understand how they might build incentives and cultures that draw strong teachers into high-need schools, and they will thus be left with an incomplete and insufficient set of tools for ensuring that all students have equitable access to excellent educators.

Go public and perish? Supporting the engaged scholar, Jennifer Ditchburn

Despite the fact that university presidents and the people who run university communication departments are only too happy to have their scholars out building a profile, the academic system is not set up to help them connect with the public. Writing a piece for Maclean’s or appearing on CBC’s The National doesn’t count toward tenure or get you a promotion: publish or perish is about peer-reviewed journals and books.

Time for public engagement is not often budgeted into a professor’s employment – scholars do this on top of their personal and academic responsibilities (I always feel a bit sheepish when I approach a busy prof to write something for me). The challenges are arguably tougher for some women in academia, whose pursuit of tenure or awards is already interrupted by maternity leave or childcare responsibilities.

The Missing Link In Student Writing

Judicial Negligence Compounds Political Negligence in South Carolina

Conservative politics as a very thin veneer for racism and class warfare has long characterized the South, including South Carolina, regardless of party affiliation—once Democratic and now the same sort of recalcitrant Republican.

Strom Thurmond personified this ugly fact of my home state—him a brash racist and among the now seemingly endless line of powerful white men who also viewed and treated women as subhuman as well. The current disaster of Roy Moore stands as yet more of that same, embodying a crass blend of political, judicial, and morally bankrupt popular in the South, the Bible Belt.

The twenty-first century, regretfully, has not exorcised these ghosts in the machine, as SC remains nearly a cartoon version of Southern stereotypes.

SC public schools (and public universities, in fact) exist in 2017 as a bold middle finger to everything promised by a democratic nation. But despite the political rhetoric, SC has failed its public schools; public schools have not failed our state, whose political leaders care none at all about poor, black, or brown children being currently (and historically) mis-served by K-12 education.

Political negligence of public schools—or more accurately, negligence of public schools that serve the most vulnerable children and communities in the state—is one of the perverse traditions that defines SC.

That tradition has a willing accomplice in the judicial negligence of the state as well. Cindi Scoppe explains:

In the three years since the S.C. Supreme Court ruled that the Legislature had to provide a decent education to all children, one justice wrote in this month’s final chapter of the quarter-century-old school adequacy case, “we have had the benefit of seeing the defendants make steady progress toward remedying their failure to provide our state’s children with a minimally adequate education.”

Particularly encouraging, he wrote, is the fact that the state has “recently come to realize that merely pouring more money into an outmoded system will not lead to success.”

Popularized as the Corridor of Shame, political and judicial negligence actually thrives in pockets all over SC, not just along the I-95 corridor that does in many ways bisect the more affluent midlands and upper state from the crippling rural poverty dominating much of the lower state except for pockets of affluence in coastal havens for the wealthy and the riches of tourism.

The conservative ideology driving political negligence has withstood the slow drag of the courts in SC, which has now fallen lockstep into that same sterile argument about “pouring more money into an outmoded system”—as if SC has even flooded public institutions with money.

Political and judicial negligence in SC—a microcosm of the same negligence nationally—remains entrenched in commitments to ideology over evidence, hard truths neither political leadership nor judicial pronouncements will admit.

First, and foremost, one hard truth is that public schools in SC are mostly labeled failures or successes based on the coincidence of what communities and students those schools serve. Schools serving affluent (and mostly white) communities and students are framed as “good” schools while schools serving poor (and often black and brown while also over-serving English language learners and students with special needs) communities and students are framed as “bad” or “failing.”

This political lie is grounded in the three-decades political charade called education reform—a bureaucratic nightmare committed to accountability, standards, and testing as well as a false promise that in-school only reform could somehow overcome the negative consequences of social inequity driven by systemic racism, classism, and sexism.

The ironic and cruel lesson of education reform has been that education is not the great equalizer.

Education reform is nothing more than a conservative political fetish, a gross good-ol’-boy system of lies and deception.

Second, and in most ways secondary, another hard truth is that while education is not the great equalizer, public schooling tends to reflect and then perpetuate the inequities that burden the lives of vulnerable children.

In-school only reform driven by accountability, standards, and testing fails by being both in-school only (no education reform will rise about an absence of social/policy reform that addresses racism and poverty) and mechanisms of inequity themselves.

Affluent and white students are apt to experience a higher quality of formal schooling than black, brown, and poor students, who tend to be tracked early and often into reduced conditions that include test-prep, “basic” courses, and teachers who are early career and often un-/under-certified.

Nested in this hard truth is that much of accountability-based education reform depends on high-stakes standardized testing, which is itself a deeply flawed and biased instrument. Tests allow political negligence since data appear to be objective and scientific; in fact, standardized testing remains race, class, and gender biased.

Like school quality, test scores are mostly a reflection of non-academic factors.

Ultimately, SC’s children and then the state itself are being cheated by a failure to admit hard truths. I agree, then, with the big picture conclusion drawn by Scoppe:

It was never clear to me whether our constitution requires the state to provide a good education to all children, or simply to operate public schools. What was always more than clear was that it is the job of the Legislature to provide an education to every child in this state. And that it is insane — and morally indefensible — not to provide a decent education to all children. What was always more than clear was that it is up to the Legislature not only to provide the funding but also, as Justices Beatty and Toal and Kay Hearn always emphasized, to make sure the districts are organized appropriately and school officials have the right powers and duties and we have the right laws about what is taught and how it is taught and that the problems are corrected when the schools don’t deliver.

This is a moral imperative about children, about human dignity and agency.

Let me end with the ignored but obvious hard truth: Education funding matters, but doing the same thing over and over while expecting different results is insanity.

Millions and millions of tax dollars in SC have been squandered on ever-new standards and ever-new tests; where is the political and judicial rhetoric about that? SC for decades now has spent hundreds of thousands of dollars on school report card that have accomplished nothing except demonizing schools that happen to serve poor and black/brown children.

SC must seek instead the political will to implement first social policy that addresses the scar of poverty and racism in our state. Concurrent with that, education reform must end its affair with accountability and begin a journey committed to education equity.

Our children deserve more than the accidents of their births, and then, as a people, we owe every child an equitable and challenging education that invites them into an honest attempt at democracy and freedom.

Political and judicial negligence is inexcusable, but remains a SC tradition.

Pre-Service Teacher Education vs. the World

I cannot promise below anything as exciting as battling a potential new partner’s seven evil exes, but I do want to wade into an important but too often overlooked aspect of how we assign power and blame to teacher impact of student achievement.

In two recent posts, I have confronted teacher blaming as well as teacher buy-in because far too many people simultaneously overstate teacher impact on student outcomes while ignoring that teachers in the U.S. have very little professional autonomy.

First, and I will not belabor this point, teacher quality contributes to only about 10-15% of measurable student achievement, dwarfed by out-of-school factors accounting for about 60% or more.

Yet, what is also important to emphasize is that teacher practices in public schools are highly regulated, increasingly so over the past thirty years of accountability driven by standards and high-stakes testing.

Teacher professional autonomy has been nearly absent in the U.S. over the last century-plus in the U.S.—likely since it is seen as a woman’s profession—but current in-service teachers will attest that their practices are significantly restrained by state mandates and schools polices anchored to state standards and a wide assortment of high-stakes tests (from state accountability to the SAT/ACT and Advanced Placement as well as International Baccalaureate).

Part of the reason I resist the inherent teacher-blame in pieces such as Goldstein’s on how writing is taught rests on my own experiences as a teacher educator of English teachers for 15 years.

My journey to teacher education began as adjunct teaching in local colleges throughout the 1990s, culminating with two wonderful years as the co-lead instruction in the Spartanburg Writing Project (SWP).

That fist summer institute of SWP introduced me to Dawn Mitchell as well as how common her struggle is among in-service teachers across the U.S.

While we at SWP worked diligently to teach our participants best practice in teaching writing, they—as did Dawn—routinely met resistance in their real-world schools and classrooms.

Principals and parents balked repeatedly at changed practices, even as those changes move from unwarranted to warranted instruction.

Once I became a full-time teacher educator, I had to anticipate a recurring refrain from the wonderful young people I was helping move into the field of teaching English; they nearly all said they valued what I had taught them about best practices in teaching reading and writing, but they were not able to implement most of those practices once they secured a job teaching.

So here is the dirty little secret of education blame in the U.S.: we simultaneously want to hold teachers accountable for student achievement even though we know teacher quality is a small percentage of those measurable outcomes and even though teachers are often implementing practices that are not supported by research but by mandate.

If we return to the Goldstein article and consider why student writing continues to fall short of our expectations, we must accept that how we measure student writing proficiency significantly shades what we believe about student proficiency and that teachers are mostly practicing in their classes what they are required to do (teach to standards, teach to tests) even when those mandates conflict significantly with what we know is best practice in fostering young students as writers.

Ultimately, there is a type of education reform that has never truly been implemented—seeking ways to increase teacher professional autonomy.

As someone with almost two decades as a public school English teacher and now 15 years as a college professor, I can attest that professional autonomy is one of the most powerful aspects of university teaching; we are hired for our expertise and then given the respect we deserve for behaving as professionals in our classrooms.

There is much about teacher certification as well as in-service teaching that deserves attention and reform, but currently, the discourse around teacher blame and why students (and schools) fail completely ignores the key cause behind all of this discord: accountability driven by standards and high-stakes tests, which is all folded into federal and state legislation.

Both teacher education and in-service teacher practices would be exponentially improved by teacher educator and teacher autonomy—and then we would find a much more valid context for holding both accountable.


See Also

Many Teachers Have ‘No Say’ in Decisions About Their Own PD, Survey Finds

Rethinking Literacy (and All) Assessment

To whatever degree I have been an effective teacher over a 33-year (and counting) career directly and indirectly connected to teaching literacy has been grounded in my inclination to assess constantly my practices against my instructional goals.

Teaching is some combination of curriculum (content, the what of teaching), instruction (pedagogy, the how of teaching), and assessment (testing, the monitoring of learning). When I was in teacher education as a candidate, the world of teaching was laser-focused on instruction—our learning objectives scrutinized and driving everything.

Over the three decades of accountability grounded in standards and high-stakes testing, however, and the rise of backward design, both how students are tested (test formats) and what tests address have become the primary focus of K-12 teaching.

Accountability’s state and national impact has increased the importance of standardized testing—the amount of tests students are required to take but also the format of in-class assessments teachers use to prepare students for those tests.

High-stakes and large-scale testing is governed in many ways by efficiency—formats such as multiple choice that can be marked by computer; and therefore, many K-12 teachers model their assessment content and formats on what students will face in these high-stakes environments.

Over my career, then, I have watched teaching to the test move from a practice shunned by best practice to the default norm of K-12 education.

As a committed practitioner of de-grading and de-testing the classroom, I offer below some big picture concepts that I believe every teacher should consider in order to improve the quality of grading and testing practices, in terms of if and how our assessments match our instructional goals instead of how efficient our tests are or how well our classroom assessments prepare students for (really awful) large-scale high-stakes tests.

The principles and practices below are imperative for literacy instruction and learning, but apply equally well to all learning goals and content.

Holistic v. skills (standardized tests). Let’s imagine for a moment that you wish to learn to play the piano, and you are given lessons on scales, proper fingering, etc., using worksheets. After a unit on playing the piano, you are given a multiple-choice test on that material, scoring an A. 

Having never played the piano or practiced at the piano, what do you think of that A?

To be proficient in the context of efficient skills-based tests is not the same as being proficient in holistic behaviors. While the testing industry has sold us on the idea that efficient skills-based tests (usually multiple choice) correlate strongly with the authentic goals for learning we seek, we should be far more skeptical of that claim.

Along with the problem of efficiency in standardized tests and selected-response tests in class-based assessment is the historical and current purposes of large-scale testing—for example, IQ and college entrance exams such as the SAT and ACT.

IQ testing has its roots in identifying low academic ability (identifying people who were expendable) and has never overcome problems with race, class, and gender bias.

College entrance exams began as a process for distinguishing among top students; therefore, test items that create spread are “good,” regardless of how well the question achieves our instructional goals.

For classroom teachers who seek assessments that support better teaching and learning, then, we should be seeking to assess in holistic ways first, and then to expose students to the formats and expectations of high-stakes testing.

One goal for rethinking assessment is to emphasize allowing and requiring students to practice whole behaviors (composing original texts, reading full texts by choice, etc.) and then to assess students’ levels of proficiency by asking them to repeat whole behaviors in testing situations.

Accomplishment v. deficit perspective. I am certain we have all experienced and many of us have practiced this standard approach to grading a student’s test: Marking with an “X” the missed items and then totaling the grade somewhere on the sheet, such as 100 – 35 = 65.

Let’s consider for a moment the assumptions and implications (as well as negative consequences) of this process.

First, this implies that students begin tests with 100 points—for doing nothing. Further, that creates an environment in which students are trying not to lose something they did not earn to begin with.

Now, a much more honest and healthy process for all assessments is that students begin with zero, nothing, and then the teacher evaluates the test for what the student accomplishes, not looking for and marking errors (something Connie Weaver calls, and rejects, as the “error hunt”).

By avoiding a deficit perspective (starting with 100 and marking errors) and embracing an accomplishment perspective (starting with zero and giving credit for achievement), we are highlighting what our students know and helping them to overcome risk aversion fostered by traditional (behavioral) practices in school.

Moving toward an accomplishment perspective is particularly vital for literacy development since taking risks is essential for growth. It is particularly powerful when giving feedback on and grading student writing (I learned this method during Advanced Placement training on scoring written responses to the exam).

Collaboration v. isolation. “[T]he knowledge we use resides in the community,” explains Gareth Cook, examining Steven Sloman and Philip Fernbach’s The Knowledge Illusion: Why We Never Think Alone, adding, “We participate in a community of knowledge. Thinking isn’t done by individuals; it is done by communities.”

However, traditional approaches to assessment are nearly always done in isolation; collaboration in testing situations is deemed cheating, in fact.

Consider for a moment your own lives as readers and writers. What do we love to do when reading a new novel? Talk with a trusted friend about the book, right? Community and collaboration fuel a better understanding of the work.

When writing, feedback is essential, another eye on our ideas, an uninvested editor to catch our mistakes.

While many of us have embraced community and collaboration in our instruction—implementing workshops or elements of workshops—we rarely allow collaboration in assessment.

See this post for an example of collaborative assessment in my introductory education course.

Feedback v. grades. One of the most frustrating aspects of practicing a de-graded classroom is that my students often identify on their opinion surveys of my courses that I do not provide adequate feedback—because they conflate grades (which I do not give throughout the semester) with actual feedback on their assignments (which I do offer, abundantly and quickly).

Most teachers, I believe, spend far too much time grading and then students receive insufficient feedback that requires them to interact with and learn from that help.

One element of my concern is that when teachers provide extensive feedback on graded work, most students check the grade and do not engage at all with the feedback; this is a waste of the teacher’s time and not contributing to student learning.

Ideally, we should be providing ample and manageable feedback on work that requires students to address that feedback, either in some response or through revision (see below).

For literacy instruction, fore-fronting feedback, requiring and allowing revision, and then delaying grades all support a much more effective process than traditional grading.

Revision v. summative assessment. That process above embraces revision over summative grading.

Whole literacy experiences, low-stakes environments that encourage risk, high-proficiency modeling and mentoring, and then opportunities to try again, to revise—these are the tenets of powerful and effective literacy instruction and assessment.

When students experience reading and writing as one-shot events mainly produced to be graded, they are cheated out of the awareness that literacy is cyclical, and recursive—to read and then to read again, to write and then to write again.

For Paulo Freire, literacy is agency, empowerment; we must read the world and re-read the world, write and re-write the world.

At the very least, we should decrease summative assessments and grading while increasing how often we require and allow revision.

Many argue that reducing grading also removes necessary accountability for student engagement, and while I find these arguments less compelling, I do replace my use of grades with minimum requirements for credit in any class or course. And I use those minimum requirements to emphasize the aspects of learning experiences I believe are most important.

Therefore, drafting of essays and revision are required, just as conferencing is.

Ultimately, our assessment and grading policies and practices send very strong messages about what matters in our classes; we must be diligent we are sending the messages we truly embrace.

Recalibrating grade scales (with a caveat) and no more averaging grades. Debates and policies about what numerical grades constitute each letter grade—such as whether a 90, a 93, or a 94 is the lower end of the A-range—are little more, to me, than rearranging chairs on the deck of the Titanic.

Instituting uniform grade scales in schools, districts, or entire states is unlikely to produce the results proponents claim; however, some policy moves concerning grades are both warranted and highly controversial—such as creating a floor score (such as a 50 or 62) for an F.

Rick Wormeli and others have very effectively demonstrated the inequity of traditional grading scales that have about 10 points per letter grade until the F, which may have 50-70 points.

Low numerical summative grades and the flawed practice of averaging grades have very negative consequences for students—the worst of which is creating a statistical death penalty for students early in a course that may encourage those students to stop trying.

Creating a floor grade on F’s is instructionally and statistically sound, then, but only if combined with the minimum requirement concept discussed above. In other words, converting a zero to 50 or 62 when a student does poorly on an assignment is not the same thing as converting a zero to 50 or 62 when a student submits no work at all.

The latter must not be allowed since students can game the system by doing no work until late in the grading period and depending on averages to produce a passing grade for the course.

Therein lies the failure of averaging grades.

Averages skew the weight of grades earned while learning instead of honoring the assessment or assessments after students have had ample time to learn, practice, and create a showcase artifact of learning.

As well, averages are not as representative of reality as modes, for example. Consider the following grades earned by a student: 10, 10, 85, 85, 85, 85, 85, 85, 100, 100.

The average for these grades is 73, but the mode is 85, and if these grades are earned in this order (10 early and the 100 last) on cumulative assessments, the 100 is also a potentially fair grade.

Grade and grade scales, then, are incredibly flawed in their traditional uses. Combining a revised, equitable numerical/letter grade structure (with minimum requirements of participation included) and choosing modes over averaging or portfolio assessment instead of averaging is recommended if de-grading is not an option.

The concepts above about rethinking assessment are effective ways to interrogate current assessment practices, and they are urgent for improving literacy instruction.

I do urge seeking ways to de-grade and de-test the classroom regardless of what is being taught, but in the real world, I recognize that goal may seem impossible.

The ways I offer above to rethink assessment, I believe, are quite practical and certainly are justifiable once we consider if and how our assessment practices do or don’t reflect our teaching and learning goals.

And thus: “A critical pedagogy asks us to reconsider grading entirely,” argues Sean Morris, “and if we can’t abandon it whole-hog, then we must revise how and why we grade.”

Reader 22 May 2017 [UPDATED]: Connecting Dots

Why people are rich and poor: Republicans and Democrats have very different views

See: UPDATE 21 (20 May 2017): Grit, Education Narratives Veneer for White, Wealth Privilege

Minorities Who ‘Whiten’ Résumés More Likely to Get Interview, Michael Harriot

“Whitening” is an all-encompassing term for when prospective employees scrub their résumés of anything that might indicate their race. Applicants with cultural names will sometimes use their initials. Community or professional work with African-American fraternities, sororities or other organizations are deleted. One student omitted a prestigious scholarship he was awarded because he feared it might reveal his race.

Although the practice sounds demeaning and reductive in the year 2017, apparently it works. In one study, researchers sent out whitened résumés and nonwhitened résumés to 1,600 employers. Twenty-five percent of black applicants received callbacks when their résumés were whitened, compared with 10 percent of the job seekers who left their ethnic details on the same résumés.

The results were the same for employers who advertised themselves as “equal opportunity employers” or said that “minorities are strongly encouraged to apply.”

Whitened Résumés: Race and Self-Presentation in the Labor Market, Sonia Kang, Katy DeCelles, András Tilcsik, and Sora Jun

Abstract

Racial discrimination in labor markets is a critical process through which organizations produce economic inequality in society. Though scholars have extensively examined the discriminatory decisions and practices of employers, the question of how job seekers try to adapt to anticipated discrimination is often overlooked. Using interviews, a laboratory experiment, and a résumé audit study, we examine racial minorities’ attempts to avoid discrimination by concealing or downplaying racial cues in job applications, a practice known as “résumé whitening.” While some minority job seekers reject this practice, others view it as essential and use a variety of whitening techniques. When targeting an employer that presents itself as valuing diversity, however, minority job applicants engage in relatively little résumé whitening and thus submit more racially transparent résumés. Yet, our audit study shows that organizational diversity statements are not actually associated with reduced discrimination against unwhitened résumés. Taken together, these findings suggest a paradox: Minorities may be particularly likely to experience disadvantage when they apply to ostensibly pro-diversity employers. These findings illuminate the role of racial concealment and transparency in modern labor markets and point to an important interplay between the self-presentation of employers and the self-presentation of job seekers in shaping economic inequality.


Experts: Conflicts over Confederate names and symbols likely to continue, Paul Hyde

But Thomas said school administrators should encourage student debate over historical figures such as Wade Hampton — as an important lesson in democracy.

“If we really think that public education is to prepare people to live in a democracy, children need to have experiences with democratic processes,” Thomas said. “I think this specific protest should be seen as an opportunity for students to see what the democratic process looks like, with everybody’s voice mattering. Principals and superintendents of public schools — they have incredibly hard jobs — but they are the people who have to show students what moral courage is. If administrators and teachers can’t show moral courage, how do we expect our children to?”

See: Dismantling Monuments: History as a Living Document


When Standardized Tests Don’t Count | Just Visiting, John  Warner

And yet, when it comes to marginalized and vulnerable populations within Charleston County Schools, these standardized assessments provide a rational for top-down oversight and control.

This is entirely common and predictable. “Accountability” is often weaponized against those without the means to defend themselves.

I have no wish to upend the academic culture of the Citadel over their terrible CLA scores, but maybe some of those who are willing to give our elite storied places a pass can extend the same spirit to those who have no such protections.

See Are America’s top schools ‘elite’ or merely ‘selective?’

Why The New Sat Is Not The Answer, Akil Bello and James Murphy

If anything, the discord between them is likely to grow as the College Board pursues an equitable society using a test that is designed to mark and promote distinctions.

For all the positive changes the College Board has made, the new SAT shouldn’t be counted among them. It is a test, not a solution.

Every attempt to manage academia makes it worse, Mike Taylor

The problem is a well-known one, and indeed one we have discussed here before: as soon as you try to measure how well people are doing, they will switch to optimising for whatever you’re measuring, rather than putting their best efforts into actually doing good work.

In fact, this phenomenon is so very well known and understood that it’s been given at least three different names by different people:

  • Goodhart’s Law is most succinct: “When a measure becomes a target, it ceases to be a good measure.”
  • Campbell’s Law is the most explicit: “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.”
  • The Cobra Effect refers to the way that measures taken to improve a situation can directly make it worse.

America has locked up so many black people it has warped our sense of reality, Jeff Guo

According to a Wonkblog analysis of government statistics, about 1.6 percent of prime-age white men (25 to 54 years old) are institutionalized. If all those 590,000 people were recognized as unemployed, the unemployment rate for prime-age white men would increase from about 5 percent to 6.4 percent.

For prime-age black men, though, the unemployment rate would jump from 11 percent to 19 percent. That’s because a far higher fraction of black men — 7.7 percent, or 580,000 people — are institutionalized.

UNEQUAL ENFORCEMENT: How policing of drug possession differs by neighborhood in Baton Rouge

BR inequity