-
The Education of Oronte Churm
Oronte Churm is the pen name of John Griswold, who teaches in the MFA program at McNeese State University, proudly nestled in Cajun country on the Louisiana Gulf.
Title
Where Your Testing Money Goes

Jim Barkus, Chief Reader for AP Literature, told us our punctuality each day and steady application to the task of reading student essays would get the job done by Saturday evening; we weren’t to worry about our speed. It’s a little hard not to think of speed, though.
By

Jim Barkus, Chief Reader for AP Literature, told us our punctuality each day and steady application to the task of reading student essays would get the job done by Saturday evening; we weren’t to worry about our speed. It’s a little hard not to think of speed, though. The scale of this production is staggering.
According to the College Board, there are 9,000 college faculty and AP teachers “from around the world” grading (“reading”) the eight million essays written for 2.3 million AP exams taken in 22 subject areas in May 2007. By the end of the summer, readers will have gathered at The College of New Jersey, Colorado State University, the Ocean Center in Daytona Beach, Trinity University in Texas, the University of Nebraska, and here, in Louisville.
Our share is some 900,000 essays/problems in English literature, French, and Statistics. Two years ago, Barkus said, there were 40,000 fewer exams taken (120,000 essays), and they try to staff appropriately. Unfortunately, 75 readers have failed to show, so he asked us to work an extra half hour each day until ETS can be assured we’ll finish.
The essays are read holistically, based on a rubric and a ten-point scale, and there are constant efforts to keep everybody normalized with their grading. Barkus said that “while [he’s] distressed at the death of apostrophe”—the crowd laughed; it’s that sort of crowd—“students can get the highest score with a missed apostrophe.” About 10% of essays are back-checked, or read by pit bosses at each table, at least in the first three days. Barkus said we aren’t to think of this as “Big Brother systematically checking our work, but after 100 essays, the mind does slip.”
Sixty percent of readers are recruited from colleges and universities (a mix of tenured and non-tenured faculty, and Ph.D. candidates), and 40% from secondary ed. Only about 20% are new readers; many have been readers for several years, and some have done it for decades. Barkus said that ETS is “very concerned” that 20-25% of readers should represent minorities, but that this reading "didn’t quite yield 18% declared minorities.”
The actual reading takes place in what looks like an airport hanger, in the Kentucky Convention Center. It’s noisy and cold. One does not speak of the draft coming from the exposed ductwork 50 feet overhead; this is a wind, strong enough to move papers on the tables, and one of the six people at my table was given a linen tablecloth to wear around his shoulders to keep warm. A man at the next table of six readers said, “We’re working inside the box that Disneyland came in.”
Readers in English lit have been assigned to one of three questions that students faced last month. Those reading Question 1 spend the week reading compare/contrasts of two poems by Richard Wilbur and Billy Collins. Those with Question 2 read about a relationship in Dalton Trumbo’s Johnny Got His Gun. I’m in the group for Question 3, which asked students to write about how a character’s relationship to the past plays out in a novel or play of their choosing. Nearly 40 titles are provided, from Ethan Frome to Mrs. Dalloway to A Streetcar Named Desire, but they could use others not listed. I’d say 20% of the essays I saw today were on Great Expectations, followed closely by Great Gatsby, and Beloved.

Students had two hours to handwrite the three essays, without books or revision to speak of, and some of the third essays written (Question 3, if they went in order) look rushed. Occasionally someone doodles on the page that should have an essay written on it, or writes cute things to us. Someone at my table had a story about a student who wrote, halfway through an essay, “I’ve been accepted at Harvard, and my boyfriend just proposed to me, so I don’t feel like finishing this, but I want you to have a nice day.”
At breaks there’s a rush for the snack tables; apples, donuts, and mini-yogurt in the morning, and popcorn, ice cream, and pretzel mix in the afternoon, go quickly. The crush is terrible to see. I suspect someone at ETS made a decision not to provide bottomless coffee urns in the room; the coffee would only cause more frequent bathroom breaks and spilled messes on student booklets. Needless to say, it’s uncomfortable sitting all day on folding chairs, hunched over handwritten exam books, and they started us on four-minute stretching breaks too. I’d love to take a picture of 1,000 middle-aged teachers doing down-dog yoga poses, but my little camera won’t fit them all in the frame.
I still have doubts about aspects of the grading process, which I’ll take up next time. There are vocal critics to standardized testing in general, and the attempts to normalize the grading of so many readers, even on the same essay in practice sessions, remind me of students’ claims that “writing is subjective, so it can never be graded fairly.” But my second-day reaction to this enormous production is that the ETS has brought in an army of those best-qualified to judge, and while the mood here is friendly, even light, these people are serious as it’s possible to be about getting it right for the students’—not the company’s—sake.
Read more by
Inside Higher Ed Careers
Browse Faculty Jobs
Browse Administrative Jobs
Browse Executive Administration Jobs
Topics
College Pages
Popular Right Now
Study documents economic gains from liberal arts education
NYU social work school admits to institutional racism in wake of student email
Advice for students so they don't sound silly in emails (essay)
Advice for how to nurture your career network (essay)
How to write an effective diversity statement (essay)
Why we need to protect free speech on campuses (essay)
New research on graduate student mental well-being says departments have important roles to play in
Judge says that U of Texas at Austin can't revoke former student's Ph.D. on its own, outside court o
Opinions on Inside Higher Ed
Inside Higher Ed’s Blog U
Sign Up / Sign In
With your existing account from...
{* loginWidget *}With a traditional account...
{* #signInForm *} {* signInEmailAddress *} {* currentPassword *} {* /signInForm *}Newsletter enrollment
Existing account found
We have found an existing account for the email address.
Please sign in to update your newsletter preferences.
{* /signInForm *}Newsletter opt-out
Edit your newsletter preferences
Account Info
Sign In
Welcome back, {* welcomeName *}!
{* loginWidget *}Sign In
Welcome Back
Account Deactivated
Your account has been deactivated.
Account Reactivation Failed
Sorry, we could not verify that email address.
Email Verification Required
You must verify your email address before signing in. Check your email for your verification email, or enter your email address in the form below to resend the email.
{* #resendVerificationForm *} {* signInEmailAddress *}Almost Done
Please confirm the information below before signing in.
{* #socialRegistrationForm *} {* firstName *} {* lastName *} {* displayName *} {* emailAddress *} {* optInIHE *} {* optIn3rdParty *} {* agreeToTerms *}Almost Done
Please confirm the information below before signing in. Already have an account? Sign In.
{* #registrationForm *} {* firstName *} {* lastName *} {* displayName *} {* emailAddress *} {* newPassword *} {* newPasswordConfirm *} {* optInIHE *} {* optIn3rdParty *} {* agreeToTerms *}Thank You for Registering
We have sent a confirmation email to {* emailAddressData *}. Please check your email and click on the link to verify your email address.
Create New Password
We'll send you a link to create a new password.
{* #forgotPasswordForm *} {* signInEmailAddress *}Create New Password
We've sent an email with instructions to create a new password. Your existing password has not been changed.
Create New Password
This email address was registered with a social account. We've sent an email with instructions to create a new password, which can be used in addition to your linked social providers.
{| current_emailAddress |}
{| foundExistingAccountText |} {| current_emailAddress |}.
{| existing_displayName |} - {| existing_provider |} : {| existing_siteName |} {| existing_createdDate |}
{| existing_provider_emailAddress |}
Sign In to Complete Account Merge
Resend Verification Email
Sorry, we could not verify that email address. Enter your email below, and we'll send you another email.
{* #resendVerificationForm *} {* signInEmailAddress *}Change Password
Create New Password
We didn't recognize that password reset code. Enter your email below, and we'll send you another email.
{* #resetPasswordForm *} {* signInEmailAddress *}Create New Password
We've sent you an email with instructions to create a new password. Your existing password has not been changed.
Edit Your Account
Profile Photo
Linked Accounts
Link Your Accounts
This allows you to sign in to your account using that provider in the future.
Password
Deactivate Account
Change Password
Deactivate Your Account
Are you sure you want to deactivate your account? You will no longer have access to your profile.
{* deactivateAccountForm *} {* /deactivateAccountForm *}
Expand commentsHide comments — Join the conversation!