Going Public

As the Council for Higher Education Accreditation gathers for its 2010 Annual Conference this week in Washington, I want to urge a change in the way we do accreditation in the United States to strengthen how it supports public accountability.

Let’s require that every institution of higher education prepare a "public learning audit" as part its accreditation materials. This would be a stand-alone statement disclosing the evidence that the institution has regarding student learning, and commenting on why the institution takes the approach to assessing learning that it does. The college or university would itself prepare the statement. The statement would be reviewed by the visiting team during periodic accreditation cycles, and approved by the relevant accrediting body. The learning audit would be publicly available to anyone, placed on the Web sites of the institution in question and of the accrediting body.

Earlham College’s public learning audit would highlight some aspects of our results from the National Survey of Student Engagement and the Collegiate Learning Assessment, and it would provide a link to our full scores on these instruments. It would also discuss the quite varied program by program assessments we do in each of our majors. It might discuss our growing interest in and experimentation with electronic portfolios of student work. And finally it would say something about what we have learned from assessment that is leading us to make changes to improve the education we offer. These elements are an honest reflection of what we are doing about assessment at Earlham, an approach we believe works well for our liberal arts mission. Another institution, one with a different mission or even a different perspective on how to carry through good assessment, would include other elements in their public learning audit.

Why do we need such public learning audits? An exchange between Peter Ewell (vice president of the National Center for Higher Education Management Systems) and the members of the Spellings Commission in the spring of 2006 was one of the more interesting but less constructive moments in the hearings that preceded the commission’s report. Ewell patiently reminded commission members that virtually every step toward better and more widely-conducted assessment of learning in higher education over the previous quarter century had happened because of accreditation. He showed that a good deal of progress had been made. Both at that session and in their final report, commission members, on the other hand, made it clear they had lost patience with accreditation.

“Accreditation, the large and complex public-private system of federal, state, and private regulators, has significant shortcomings,” (p. 14) concluded the Spellings Commission in its final report. No, not everyone would agree that the parenthetical phrase is an accurate, brief description of accreditation. Nevertheless, “significant shortcomings” is a blunt, clear conclusion. The report goes on to say “Accreditation reviews are typically kept private, and those that are made public still focus on process reviews more than bottom-line results for learning and costs” (p. 14). And later in the report, “Higher education institutions should make aggregate summary results of all postsecondary learning measures, e.g., test scores, certification and licensure attainment, time to degree, graduation rates, and other relevant measures, publicly available in a consumer-friendly form as a condition of accreditation” (p. 23).

There has been steadily rising agreement from all sides that we need to put more focus on learning outcomes in accreditation, but on the question of making accreditation more public we have been in a stalemate for years. Critics (such as those on the commission) have insisted that accreditation self-studies and visit reports be made public. Defenders of the current system argue that making these documents public would undermine the candor needed to make these documents useful for institutional improvement. Besides, note defenders, accreditation self-studies and visit reports are lengthy, complex documents; no one in the public would really want to read them.

Public learning audits would provide a middle ground and break the stalemate. Accrediting agencies would provide a rubric for preparing these statements. Colleges and universities would have considerable latitude within these rubrics about how to assess student learning. That latitude would allow an institution to shape its report around its mission(s), and to make its own choices regarding instruments or approaches for assessing learning. These statements would be prepared as stand-alone documents, with institutions knowing that these statements would become public.

Ten years (the normal length of time before an accreditation needs to be renewed) would be too long a shelf life for these learning audits, so the public learning audits would be revised every two years. At the time of re-accreditation, visiting teams would look back over the sequence of statements to assure that these were forthcoming and adequate.

We do not need to require that all the materials prepared for accreditation be made public. But we need to recognize, all of us, that the effectiveness of an institution of higher education with regard to student learning is a legitimate focus of public accountability. Any college or university enrolling students who receive federal financial aid should be subject to such accountability. Public learning audits would be a useful vehicle for providing such accountability. We do not need Congress or the Department of Education to act. Accrediting bodies could make the change themselves.