Advertisement

News, Views and Careers for All of Higher Education

The Information Gap: Much Talk, Little Progress

In 2000, the National Center for Public Policy and Higher Education released the first 50-state report card on higher education performance. Measuring Up 2000 assessed states on how well they were doing in preparing students for college, providing access to college, making college affordable, and promoting completion of certificates and degrees. That groundbreaking report also highlighted areas where objective, comparative data were lacking, most notably student learning outcomes.

Eight years later, a number of states have used the report card to drive conversations about improving public higher education policy. But despite all the talk in Washington and state capitals about the need for better data and more robust accountability systems, we have made little progress in filling critical information gaps and have even moved backward in some areas. Our efforts to make higher education more accessible and affordable will stall unless we change this.

These information gaps extend from high school through graduate school and indicate that for every step forward, we have taken a step back in having the data states and institutions need to better inform decision-making about how to increase college access and success while containing costs.

In the area of college preparation, state-level data have moved forward and backward. On the positive side, states do have better data about who is making it through high school. But they know less about course-taking in high school math and science because fewer states are participating in national surveys in these areas today than in 2000. And while most states administer the 12th grade version of the National Assessment of Educational Progress (NAEP), state-level results are still not available.

The nation has made no headway in getting a better handle on who is making it to college. Nationally, we can track college enrollment rates by race/ethnicity and income, but at the state level, enrollment rates by income are still not available. Additionally, we can say little (if anything) about what happens to students who cross state lines for college after they first enroll.

There have been small steps forward in gauging college affordability, but there are more steps to be taken. We can now track undergraduate and graduate student loan borrowing separately, a significant improvement over 2000. The 2004 edition of the National Postsecondary Student Aid Study (NPSAS) provided valuable information about whether and how aid packages change for students after the freshman year; unfortunately, the study only covered about a quarter of the states. Moreover, we are still not in a position to assess unmet financial need for students at the state level.

Even on critical issues such as determining whether students are completing programs on-time or at all, we know a little more, but still not enough. The U.S. Department of Education’s Graduation Rate Survey now provides comparative data on first-time, full-time students completing degrees at three-, four-, five-, and six-year intervals. But these data provide a limited picture because a six-year timeframe is too short for many students (especially working adults) and because the survey cannot account for transfers or more importantly those who start as part-time students. We also have an incomplete picture of progress and completion for students who move across states during their college career, since not all states are participating in a data-sharing effort through the National Student Clearinghouse (and that database was not created to serve the analytic function we’re now asking of it).

Despite all the hue and cry about student learning since 2000, we have actually taken a step backward in gathering comparable state-level data. Most of the movement in the last eight years has focused on individual campuses and systems, through efforts such as the Collegiate Learning Assessment and the Voluntary System of Accountability. Perhaps the biggest step backward has been in the measurement of adult skills. The number of states participating in the National Assessment of Adult Literacy (NAAL) fell from 13 in 1992 to just six in 2003, and the 2003 data are still not available for all the participating states.

In just a few weeks, state legislatures will convene to face the biggest budget crisis in a generation. Unfortunately, they will have to make difficult decisions about priorities without the benefit of better information about the most urgent needs for getting more students to and through college at a price they can afford. This makes it more likely that we will see the usual responses — raising tuition, capping enrollment, cutting across-the-board — that will put states further behind in the race to grow a competitive work force.

We can fix this. It is time for every state — and the nation — to commit to getting the information needed to increase the size of our college-educated population, and to halt the worrisome slide of the United States relative to other advanced nations on higher education outcomes.

Dennis P. Jones is the president at the National Center for Higher Education Management Systems, a research and development center founded to improve the management effectiveness of colleges and universities. He serves on the National Advisory Group for Measuring Up 2008, the national and state report card on higher education issued by the National Center for Public Policy and Higher Education. Measuring Up 2008 will be released on December 3, when it will be available for viewing and download on the National Center’s Web site.

Got something to say?


Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.

Advertisement

Comments

re:

I think we can acknowledge and understand the problems with current practices for evaluating college performance, effectiveness, quality, etc. It’s problematic. We all get it. Time to move on.

But at the end of the day, people (largely outside of higher ed.) will be making decisions about what to subsidize. They will have to choose between health care, prisons, K-12 education, parks and recreation, welfare, roads and transportation, and many other services. All of these services will come to the table with very good, clear justifications for why they are important and should be a priority.

Rather than complain and get defensive about the problems inherent in measuring college performance, can’t we just give them something? It doesn’t have to be perfect and can even admit where we need to improve. It can also highlight what we do well. I don’t even think it has to be quantitative. So, let’s show them that we are doing something positive with the money they are giving us and always thinking about making our colleges better. Then, we can save the legitimate and valid measurements of college performance (if that is even possible) for our own internal processes.

Rather than complaining about budget cuts, our low salaries, and how we don’t have enough money to do everything we need to do, then maybe we can be more prepared when we ask people to support us.

PS, at 10:30 am EST on November 21, 2008

Ducking the Axe

I believe the comment from P.S. hits the nail on the head. Nearly every state is in a budget shortfall condition and education is on the cutting table too out of necessity. Every time money issues and education are examined, new layers of accountability are levied. I can’t speak for everyone obviously, but the assessment methodology practiced by most institutions lacks any checks and balances except purse strings, failing miserably to provide any real or useful data. Most methods are designed by the institution,to prove the institution and its programs worthy. This is tantamount to congress policing its self. Our educational system is terribly in-efficient, and it got that way by the constant push to show data that hints at the improvement of failing or flawed “Good Ideas.” It’s high time to move away from contriving data that proves our worth and start paying close attention to what is working well and market, market, Market!!!

Belt Tightener, at 3:55 pm EST on November 21, 2008

It seems to me that all these measures of academic performance entirely overlook what college should be all about, namely the development of critical thinking skills. What sort of consensus is there about what these skills are and how they might best be measure?

Frank Forman, private citizen, at 10:05 pm EST on November 23, 2008

Advertisement

 Jobs Related to The Information Gap: Much Talk, Little Progress

or search for jobs directly.

Professional Analyst II, Institutional Effectiveness/Institutional Research (Multiple Positions)
Lone Star College System

Located just north of Houston, Texas, our five campuses serve 1,400 square miles. Our student enrollment is nearly 50,000 in ... see job

Vice President for Enrollment
University of Tampa

The University of Tampa (UT) seeks an exceptional Vice President for Enrollment. see job

Executive Director of University Advancement
Plymouth State University

Plymouth State University Plymouth, NH Executive Director of University Advancement Plymouth State University invites ... see job

Professor & Director
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Department Office Support III
Princeton University

Position Summary: The Lewis-Sigler Institute for Integrative Genomics is interested in hiring a faculty ... see job

A/V Aide (Reg FT)
Community College of Allegheny County

All applicants must apply online at: www.ccacjobs.com. The College’s online application system will allow you to complete a ... see job

Offensive Coordinator — Football
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Department Office Support III
Princeton University

Position Summary: This position in Career Services provides secretarial support for one Associate Director ... see job

Executive Administrator to the President
Rhodes State College

James A. Rhodes State College, in Lima, OH, is West Central Ohio’s largest two-year college with nearly 3,700 students and ... see job

Short Term and/or Part Time Coach
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job