Report from higher education research group's annual meeting

Smart Title: 

At annual gathering of scholars of academe, researchers discuss a potpourri of topics, including the state of for-profit colleges and the impact of no-loan policies.

Student Created College Poker Site Causes Concern

Smart Title: 

Arizona State student thinks he may have created a safe alternative to online gambling sites. Some gaming experts aren't so sure.

Academic Performance and the BCS

Nothing captures our national enthusiasm for sports more than rankings.

We love them, consume them, argue about them, reject them, and embrace them. The industry of sports ranking keeps many print publication alive, and serves to inform tailgate celebrations throughout the college sports season with the illusion of substantive, scientific calibration of our sports enthusiasm. Among the many rankings, we of course have the BCS system that generates a list of what are presumably the best football teams in America, using methodologies praised by those whose teams score high and attacked by those whose teams fail to make the cut.

Those of us who inhabit the core of the university’s academic environment share the enthusiasm for measuring and evaluating the quality of our institutions, although we have less enthusiasm for the endless ranked lists that appear in popular publications.

While some dote on the U.S. News rankings, which like their BCS counterpart rely on hugely unreliable opinion surveys, we, however, prefer our own system for evaluating the Top American Research Universities that recognizes the importance of successful performance among highly competitive institutions without requiring a simple top to bottom ranking that often distorts more than it informs.

For over ten years, The Center for Measuring University Performance, now located at Arizona State University, has produced an annual report on the Top American Research Universities that uses objective data on nine measures to put universities into categories according to their performance.

We measure research, of course, by the amount of research expenditures of each university in two categories: Total Research that includes all sources, and Federal Research that includes the peer reviewed research activities sponsored by the Federal government. In addition we collect information on Endowment, Annual Giving, National Academy Membership, Faculty Awards, Doctoral degrees awarded, Postdoctoral Fellowships supported, and average SAT scores of entering students. For a full discussion of all these measures, see the most recent edition of The Top American Research Universities (2010) available online.

Our interest in intercollegiate athletics is long-standing as college sports form such a significant element in so many prominent and successful research universities, and we published a discussion of that phenomenon some years ago in The Sports Imperative in America’s Research Universities (2003) available online.

Given the recent attention to conferences and possible conference realignments, as well as national media attention to the academic quality of the universities in each conference, we thought it might be interesting to use our data to construct an index to the academic distinction of the universities in the six major BCS conferences. In our annual report, we group universities into clusters based on their performance among the top 25 or the second 25 on our measures.

A university that is in the top 25 on all nine of our measures, scores a 9 while a university that is in the second category falling between 26 and 50 in national rank would earn a 4.5. Some institutions fall into the top 25 on some measures and the second 25 on others. If they have six measures in the top 25 and three measures in the second 25, we would assign them an academic distinction score of 6 plus 1.5 or 7.5.

By combining these indexes of academic performance for the members of the conferences, we can produce a reliable indicator of the combined academic distinction of the institutions in each of the six BCS conferences.

It will come as no real surprise to those who watch our academic landscape to discover that the Big 10 leads the field with an academic distinction index of 55, followed closely by the Pac-12 with 48. The ACC falls some distance behind with an index of 28.5 and the SEC a significant distance away at 14, followed closely by the Big-Twelve and the Big East at 12.

As a reference, we also constructed an index for the Ivy League, to put all this into perspective. This premier academic conference would fall into second place, after the Big-10 and before the Pac-12.

Although the decisions about conference alignments and realignments turn primarily on issues of television, audiences, institutional athletic comparability, and of course money, the quality of an institution’s athletic conference is one of the elements that helps universities create and sustain a reputation for high quality, much prized by prospective students and alumni.

As these data show, high powered academics and high powered athletics coexist in many first rank institutions. However, we also conclude that having a first rate athletic program is no guarantee of high-powered academics but that many first-rate research universities have no difficulty sustaining outstanding athletic programs.

The following table provides the summary data for each conference. (Note: This article has been updated to correct an error.)


John V. Lombardi and Elizabeth D. Capaldi
Author's email:

John V. Lombardi is president of Louisiana State University, Elizabeth D. Capaldi is university provost and executive vice president at Arizona State University, and Craig W. Abbey is senior assistant vice president for institutional analysis at the State University of New York at Buffalo.

The Promise of Digital Humanities

Smart Title: 
Could the creative use of technology help humanities scholars win back public support?

Revised Rules on Financial Conflicts

Smart Title: 
U.S. issues final regulations to increase requirements on researchers and universities to report and eliminate conflicts of interest; standards eased slightly from 2010 proposal.

Updating the Common Rule

Smart Title: 

WASHINGTON -- Scientists and scholars have had no shortage of complaints about the impact that federal rules governing human research subjects have on their work.

Tenure Across Borders

Smart Title: 
Interdisciplinary research and collaboration get formal recognition in new USC guidelines for promotion.

Killing Peer Review

Smart Title: 
Can the social Web produce a "killer app" that would do away with the traditional editorial process at scholarly journals?

A Nudge for the Neediest

Smart Title: 
Study of impact of need-based financial aid finds that extra grants helped the students least likely to succeed, but did little to boost overall academic progress.

You Can Get the Grant

Self-confidence matters when seeking funds, and lack of confidence dooms the prose in many proposals, writes Mary W. Walters.


Subscribe to RSS - Research
Back to Top