Search News


Browse Archives

News

After the SAT Report, What Next?

September 29, 2008

Share This Story

FREE Daily News Alerts

Advertisement

Sometimes, when a panel issues a special report on an important topic, it falls to those who wrote the report to bring along the skeptical rank and file, to help those who haven’t spent a year or more studying the issues understand why some change or another is needed.

At the annual meeting of the National Association for College Admission Counseling this weekend in Seattle, it seemed that the rank and file was more than ready for a special commission’s report calling for a rethinking of standardized testing in admissions. The session where the panel was to explain its views had to be moved to a larger ballroom when hundreds of admissions officers were unable to fit in the original room. But they weren’t coming to the session to question the panel’s suggestion that many colleges don’t need standardized testing. Many of those who spoke appeared already to be sold on the idea. Indeed, with the College Board and ACT not directly challenging the commission in its open forum, it fell to some committee members to say reasonably nice things about the SAT.

The greatest challenge to the commission’s thinking at the open forum came from those who questioned the commission’s view that much of the problem with the SAT and ACT isn’t the tests themselves, but how they are misused and the commercialization they encourage. While not disputing that the tests are misused, some would have gone further.

It’s “not just abuse,” said Susan Tree, a guidance counselor from Pennsylvania who is a leader in the association. “There are bad tests.” To applause, she cited “fundamental flaws in a test that has become one that continues to correlate more highly with family income and educational background than academic promise.”

And to more applause from the gathering of both college admissions officers and high school guidance counselors, she said she wanted to see “a vision for moving beyond an instrument that we keep tweaking and apologizing for.”

Others who spoke at the forum and elsewhere at the meeting generally agreed. Some focused broadly on the SAT, while others had specific complaints -- fees charged by the College Board, a new College Board policy making it easier for students to take the SAT repeatedly without reporting that to colleges, lack of oversight of the College Board. (While the NACAC commission’s recommendations were put forth to apply equally to the SAT and ACT, most of the anti-testing rhetoric at the meeting was directed at the SAT and the College Board, not the ACT.)

The NACAC panel didn’t call for the elimination of the SAT or ACT. Rather, it said that colleges shouldn’t use the tests unless they have conducted validity studies to be certain that the tests accurately predict what they claim to for a given college, and that they add important value to the admissions process. The NACAC panel said that these should be individual college studies, not those produced by the testing companies.

Some colleges -- especially those contemplating changes in admissions policies -- do in-depth studies of the validity of various requirements. But many don’t. While admissions officers were not lining up to be quoted saying that they require the SAT without institution-specific data that it means anything, many said privately that their institutions in fact lacked any solid evidence -- based on experiences at their institutions -- of the test’s value for their admissions processes. When asked why they require the SAT without evidence, the most common answers were “because we’ve done it that way for a long time” and “because the most prestigious colleges do it.”

Several admissions deans at institutions that require tests said that the NACAC commission’s recommendations showed a perfect understanding of the internal politics of colleges. Had the commission explicitly called for eliminating admissions testing, they said, the recommendation would have been controversial enough that skeptical presidents might not have gone along.

But it would be hard for a president to tell an admissions office not to conduct validity studies of a test used in the admissions process. And if, as these deans suspect, the NACAC panel was correct that the studies will show, at many institutions, little value for the SAT, the case for dropping the requirement will be much stronger, and will still have the blessing of the national association of admissions officers.

Another key part of the way the recommendations are framed is that they call for weighing the value of the tests against the negative consequences of the industry and culture that have grown up around them. Philip A. Ballinger, director of admissions at the University of Washington and a NACAC panel member, said that one possibility is that validity studies find that the SAT or ACT add something to the admissions process, but it might not be enough to justify their downsides.

“One of the key issues is what the SAT and ACT have become culturally -- they have become buckets of all sorts of things that have nothing to do with the test,” he said.

They are “attached to rankings,” and they are “driving policy decisions at universities,” he said. While validity studies at Washington have shown the tests to have some predictive value, he said, that may not be enough to justify them. The question is to look at the “wider balance” of the tests. “Is it of sufficient value to outweigh the other effects?”

It’s also possible, many said, that testing won’t go away, but that the emphasis on the SAT will.

William Fitzsimmons, dean of admission and financial aid at Harvard University and chair of the NACAC panel, said that his institution was “a long way from knowing whether we’ll make any change.” But he noted that other tests -- the SAT subject tests, Advanced Placement, and the International Baccalaureate test are examples -- also need to be considered, and may be superior to the SAT.

“The more curriculum-based the test, the better a predictor the test is at Harvard,” he said. And while he said he could see change over time, he said he had a hard time imagining Harvard as “test optional," but could imagine it requiring different tests.

That Fitzsimmons led the panel was also seen as critical by many admissions deans. Normally NACAC meetings feature a certain amount of Crimson envy, with college officials grousing about how Harvard gets all the media attention and has the endowment to attract the best students. But at this meeting, deans repeatedly praised Fitzsimmons for taking the lead and several said that -- academe being what it is -- the same report led by a dean of an institution that admitted more than 10 percent of applicants just wouldn’t have had the same credibility with presidents and trustees.

At a press briefing on the report, Fitzsimmons drew attention to a broader agenda panel members see for NACAC that could also change the dynamics of the testing industry. NACAC should assume the role, he said, of being a monitor and “whistle blower” about testing and related industries. He noted that much of the research and training about the use of tests has traditionally come from the testing companies that benefit from the tests’ use. If NACAC becomes a “third party” -- and an independent source of information -- educators and the public could have more reliable information.

One example of that is a study currently taking place by NACAC on the test-prep industry. The NACAC report notes that the average gains for students who take SAT courses are actually smaller than many people believe. But at the same time, Fitzsimmons said he was concerned that, on the high end of these services, it is possible that the gains are large. It’s important to find out and to make that information public, he said.

He returned to this theme in the public forum on the report, talking about NACAC becoming “a watchdog agency,” and filling “a leadership void” on testing issues -- and his call for the organization to move in that direction appeared to have strong support from the rank and file.

If NACAC does move in that direction, some said that it may also become more critical of the many businesses that benefit from the desire of so many students to boost their SAT scores. Even as the NACAC panel was calling for more scrutiny of these services, all the big players were visible in the association’s exhibit hall.

Mary Lee Hoganson, a retired school counselor and past president of NACAC, said that “we haven’t looked carefully enough at all of the commercialization.” She recalled that when groups like Princeton Review and Kaplan first started to buy space in the association’s exhibit hall, “there was a member outcry,” but now they are joined by many other companies. That “we’ve become desensitized to this shows how timely” the report is in raising questions about the testing industry. And the questions come in the wake of scrutiny by various government agencies into other corporate links to higher education, especially in financial aid.

On the question of the SAT itself, there was much evidence that some colleges are planning reviews or have already started. Jeff Rickey, dean of admissions and financial aid at Earlham College and a member of the NACAC panel, said that Earlham was planning a review over the next year of its testing requirement. At a session on colleges that have already dropped admissions testing, about 20 hands shot up when the audience was asked how many of their institutions were currently looking at dropping the SAT.

While the SAT report outlined educational and philosophical reasons for subjecting testing requirements to more scrutiny, many admissions deans here were talking about practical issues -- such as what happens when you drop a testing requirement. There presentations on this topic at the meeting were uniformly positive.

Ann B. McDermott, director of admissions at the College of the Holy Cross, said that she was terrified about a possible backlash when she woke up the morning of her institution’s announcement that it was going test-optional. Response was overwhelmingly positive, she said. She received thank you notes from guidance counselors. Application numbers went up, along with academic quality. And the applicant pool is more diverse racially and socioeconomically.

A change she’s especially pleased with is that she finds herself and her admissions colleagues talking more with prospective students about the college’s curriculum and approach to learning and less time on questions that she said used to dominate. “I think the discussion has gone beyond, 'What are your average test scores?’ ”

Jane Dane, dean of enrollment management at Salisbury University, said her experience suggests that public universities can move test-optional. (Most of the movement among competitive colleges to drop testing has come from private liberal arts institutions.) Dane spoke about how there are more layers of approval needed in a state university system, but said that the University System of Maryland ended up approving her institution’s shift.

She had been watching the liberal arts colleges but didn’t “see schools of our type” until George Mason University announced a test-optional program. “That was the one that got my attention,” she said. George Mason reports positive numbers still, as does Salisbury. Dane said that her institution -- on the advice of Maryland officials -- gave the no-test option only to applicants with at least a 3.5 grade point average. That won over the faculty and system officials, she said. So far, the key changes are both changes the college wanted: more economic diversity among applicants, and a higher course-completion rate by those who don’t submit test scores than by those who do.

Steve Syverson, vice president for enrollment at Lawrence University and a panel member, said that his institution is in the third admissions cycle without a test requirement, and about 25 percent of students don’t submit. Thus far, academic quality has in no way suffered as a result of the shift. The most meaningful change, he said, is realizing that admissions officers are “liberated” to admit whom they want.

In the past, he said, admissions officers felt pressure to reject some applicants of high quality because of their low SAT scores, which the university didn’t want to count when reporting its averages. Applicants were being rejected even though admissions officers knew they could succeed and add to the college. Syverson called this “a complete misuse” of test – but the sort of misuse that is common at institutions that require tests and care about their rankings (in other words, most of them).

So will many more colleges drop the SAT? One striking thing about the NACAC meeting was that at the sessions on testing, no one came forward to defend the SAT. At the press briefing, Charles Deacon, dean of admissions at Georgetown University and a panel member, said he thought the SAT did add value and he didn’t see his institution moving away from it. But as speaker after speaker talked in various sessions about not needing it, they weren’t challenged.

Ballinger, of the University of Washington, said he expected to see change, but over a period of years – at least for now. Many deans said that they could act if institutions seen as peers act, and that some were starting. Salisbury following George Mason fits that mold. “Let’s say a major flagship or system were to drop the use of the SAT or ACT,” or a nationally known private university, Ballinger speculated. “Change can happen very abruptly.”

See all postings »
Advertisement
Advertisement

Matching Jobs

Comments on After the SAT Report, What Next?

  • After the SAT Report, What Next?
  • Posted by Dianne at Jackson State University on September 29, 2008 at 8:45am EDT
  • The following statement,“fundamental flaws in a test that has become one that continues to correlate more highly with family income and educational background than academic promise” eludes to income and educational background which could mean, the poor and minorities; were any minority serving institutions reviewed or researched to see how they stand on this issue? I'm interested in their views on this subject.

  • How to Measure Academic Quality?
  • Posted by Jane S. Shaw , President at John W. Pope Center for Higher Education Policy on September 29, 2008 at 8:50am EDT
  • Schools that have dropped the SAT say that academic quality went up. How is that measured? Before or after the students are admitted? (For example, by average freshman grades?)

  • SAT Out? But What's In?
  • Posted by Patrick Mattimore , Teacher on September 29, 2008 at 10:00am EDT
  • Ok. So the competitive colleges drop the SAT I and replace that test with SAT IIs or IBs or AP exams. Sounds fair. Kids should be judged on specific subject matter they should have learned. Problem is that tests like the SAT Subject exams are highly correlated with the SAT I. So now it looks as if colleges are being fair but they are admitting nearly the same students anyway. The URMs still are URMs and twenty years from now colleges are still looking for ways to get those kids into college.

  • SAT subject tests
  • Posted by good student in rural area on September 29, 2008 at 10:50am EDT
  • Success on SAT subject tests is even more tied to the family economic status and background. If a student lives in a small town or lower economic area, he or she more than likely will have lower SAT subject scores because his or her schools often are not as knowledgeable or as rigorous as schools in more prestigious or urban areas. A student can be the top student in the school or subject but that doesn’t necessarily prepare him or her to take the SAT subject tests. Very few students in our “downstate” Midwest area take the SAT, let alone the subject tests. Our son was surprised and disappointed by his scores on subject tests after he had scored very well on the SAT without “prepping.” Nothing in his background would have shown him that he needed more preparation for the subject tests. I don’t think his school even knows SAT subject tests exist. We had to push for AP tests. Our family’s lack of prior exposure to the subject tests was definitely a disadvantage to our son.

  • The false debate rages on...
  • Posted by Matt on September 29, 2008 at 4:00pm EDT
  • It is readily apparent that lesser universities are against the SAT primarily because it is an objective measure of the students admitted to a given university. Scores of second rate colleges would love nothing more than to bolster their claims that they annually admit a student body that is equivalently bright to those at the elite universities. The fact is that they don't. They can't. Quite simply, they cannot attract the same interest from students with SAT scores that qualify them for the elite universities. How can these lower-tier colleges demonstrate that they are viable options for the top ranking students? They can't. Instead, they propose the "solution" of destroying the best objective standard of student merit. Equally insidious, they propose that we replace this objective standard with a fuzzy "holistic" approach to student admissions. It should be apparent to everyone that this argument is inherently biased to benefit lesser institutions by destroying an objective hierarchy that threatens the self-esteem of admissions counselors at good (but not great) universities. I have prepared many students (both from elite private schools and from charter schools in dangerous neighborhoods) and I can tell you that an A+ at the charter school would not earn you a C- at the private schools. This is indisputable. The more we shift our focus to "intangibles" and "holistic" assessment, the more we actively avoid using real, objective, measures of student merit. To disingenuously suggest otherwise is to actively promote the abandonment of our best means of evaluating students in favor of helping college counselors feel better about themselves. Are there problems with the SAT? Perhaps, but the burden of proof rests on those railing against it. What objective standard have they offered to surpass it? Exactly. Don't be fooled by this false debate.

  • SAT
  • Posted by Jerry in LA on September 30, 2008 at 9:45am EDT
  • Thank you Matt. Very well said.

    But indirectly, you answered you own questions by your use of the term “student merit”. That concept is evil to the higher ed community. Student merit is secondary (or lower) to “diversity”. In your example, many would rather admit the C-student from the charter school than the A-student from the private school. It will make the admissions people feel better.

    Note the statement in the article from Steve Syverson – ‘Thus far, academic quality has in no way suffered as a result of the shift. The most meaningful change, he said, is realizing that admissions officers are “liberated” to admit whom they want.’

    Hmmmm...'whom they want’. Not the ‘most qualified students’? We understand.

  • Not so sure ...
  • Posted by No SAT? on September 30, 2008 at 1:15pm EDT
  • However, it is NOT the 2nd and 3rd tier colleges for the most part who have gone SAT-optional. It is much more the 1st tier highly selectives. I'm not sure that the Matt argument entirely holds water when judged simply on the emperical evidence to date.

    The viewpoint expressed above though that is stated as if it's almost a tautology, fact, but really is anything but is this: "Kids should be judged on specific subject matter they should have learned." Who says? Why? That (used alone) could be more discriminatory than everything gong today with the SAT. Remember that "SAT" is an acronym for Scholastic APTITUDE Test. Emphasis on the concept of aptitude, NOT simply accumulated knowledge. but the ability to learn. A measure of academic promise, NOT achievement. And there is good research to indicate that the SAT does do this. Imperfectly? Sure. Better for some than others? Looks like it. But The SAT aside, the concept of aptitude testing seems to me much more important, useful, and doubtlessly less discriminatory than simply knowledge gained. I whole-heartedly disagree with the concept of basing admissions testing, and its input to the college-selection process, based on " ... specific subject matter they should have learned."

  • SAT a poor predictive measure
  • Posted by Patrick Mattimore , Teacher on September 30, 2008 at 5:35pm EDT
  • Well, Not So Sure, we definitely disagree. Your statement that there is good evidence that the SAT does a good job of measuring one's ability to learn is not supported by data. Even the College Board admits that the SAT I does a poorer job of predicting college performance than does a student's HSGPA. In fact, after combining HSGPA and SAT IIs the SAT I adds virtually nothing in predictive value to a person's FYCGPA. (Again, this is based on research on the CB's website).
    Malcolm Gladwell (a Canadian college graduate) gave a fascinating talk a couple of years ago about American's fascination with the SAT. He likened it to what he called the quarterback draft problem wherein college quarterbacks are often chosen for the NFL based upon intangibles and prototypes (in other words their potential as demonstrated at the combines) rather than their college performance. Gladwell suggested that many of those draft choices entered the NFL with "great potential" and ended up leaving within a few years (think Ryan Leaf) with that great potential still intact.
    Shouldn't our judgment about who gets into college be based upon past performance? Granted our subject tests as they now exist are inadequate to the task but if we develop standardized subject tests we can begin to adjust our high school curriculums so that students are being taught what colleges think they should know.
    BTW my statement that kids should be judged by what they know as demonstrated by subject tests is hardly a tautology. It is merely a matter of opinion and either part of the statement (implication that subject tests measure content mastery or that the subject tests are more appropriate admissions' measures) is certainly open to challenge.

  • So What?
  • Posted by DFS on October 3, 2008 at 4:20pm EDT
  • So what if the test in question can be statistically or sociologically linked to background?

    Standards are standards, and the definition of that word implies that someone should meet a standard!

    For whatever reason someone does not meet this standard, it remains incumbent on them to do so. Otherwise, change the standard.

    Each one of these tests are honest attempts to portray a standard, and everyone has had plenty of time to strive toward it.

    Did they or did they not meet it? Well, if they did not, the fault lies either with them, or with their teachers as the representatives of the local school system. Either way, there was plenty of time to reach it.

    Don't change the standards at the intended target; rather, meet the intermediate expectations along the way. We all know, and have known all along, what the target requires. Just get off of your asses and do your jobs!