Search News


Browse Archives

News

IPEDS on Steroids

December 1, 2006

Share This Story

FREE Daily News Alerts

Advertisement

The U.S. Education Department has made no secret of its thirst for a new database to track individual college students' progress throughout their academic careers, which the federal Commission on the Future of Higher Education called "a vital tool" that would "allow policy makers and consumers to evaluate the performance of institutions by determining the success of each institution’s students without knowing the identities of those students." But department officials also recognize that the concept's political prospects, while possibly on the upswing, remain dicey, given the strong opposition of some key members of Congress and the even stronger opposition of some college officials, particularly at private nonprofit institutions.

Department officials say they still plan to pursue the "unit records" database, as it is commonly known, and they are moving on several fronts -- including by seeking money for pilot projects in their 2008 budget request -- to make it a reality. But in recent weeks, they have also begun talking to researchers and higher education leaders about an alternative to the unit records idea that some college officials might dislike even more: a proposal to radically expand the size and scope of the Integrated Postsecondary Education Data System (IPEDS), in ways that would require colleges to report significantly more data to the government, potentially increasing their costs and time commitments.

Mark S. Schneider, the Education Department's commissioner for education statistics, describes the expansion of the data collection system -- which he and other officials there have dubbed "Huge IPEDS" -- as a "fallback position, in case the student longitudinal records system cannot work or does not work."

But some college officials who are familiar with the department's plans take a more cynical view. They speculate that the department may be floating an idea that would greatly add to colleges' reporting burden -- one association official estimates it as increasing the average college's IPEDS workload by 10-12 times -- as a way of making the unit records database look like not such a bad idea after all.

"Even with their choice of language -- 'huge' -- I think they're trying to make it a little bit scary to institutions that do not want an extra burden," said an official at one college group, who asked not to be identified. "It seems like a lever for the department to make an even stronger case why unit records makes more sense: We can collect less from you, yet have better information for consumers."

In an interview Thursday, when a reporter started to ask Schneider whether the department was floating Huge IPEDS to make unit records look more appealing, he interrupted and finished the question himself. "Are we consciously manipulating or putting Huge IPEDS on the table as a way of scaring postsecondary institutions into supporting longitudinal records?" he said. "Do you know how many times I've been asked that? Do you think I'm going to give you a Yes or No answer to that?"

He continued: "Look. The bottom line is, people want and need more data, and we're going to get it one way or the other. At the current time, we are pushing the student level progress data system. But Huge IPEDS is an alternative."

The 'Unit Records' Debate

The Education Department initially put forward its proposal to create the unit records database in March 2005, and negative reaction came both from Republican leaders in Congress, who declared the proposal dead on arrival because of the perceived invasion of students' privacy, and from some academic leaders, particularly from private institutions.

But the work of the federal commission appointed last year by Education Secretary Margaret Spellings has breathed new life into the idea. Commissioners, and a sizable number of higher education researchers and leaders in the public college sector, have argued that such a database is necessary to really understand how today's college students are faring, given that they increasingly attend more than one institution and are more likely than not to go to college part time. Most existing national sources of data about student performance -- including IPEDS, which is the king of federal data collection systems -- track only full-time, first-time students, providing an incomplete sense of the overall picture. It also provides only aggregate data.

Exactly how the Spellings commission and the change of control in Congress will change the political outlook for unit records is unclear; certainly Republicans, who will be the minority party in the next Congress, have led the opposition to the idea, but Democrats may share some of their concerns. Schneider said in the interview Thursday that department officials are "pushing ahead" with unit records (a phrase that he, like other department officials, declines to use at this point because of the baggage it carries), planning to include a "proposal for a pilot study to test the feasibility" of the idea in the 2008 budget.

He also acknowledged that the department was exploring another possibility aimed at minimizing the privacy concerns surrounding the unit records database, in which colleges would submit their data on student progress and the personal information that identifies individual students to a "third party," which would be responsible for changing the personal information to a completely separate identifier, and then linking the new identifying information to the academic progress data. The government, then, would never touch or see the personal information about students. (Schneider declined to say who such a "third party" might be, but college lobbyists said department officials have suggested the National Student Clearinghouse, which now works closely with colleges, lenders and others to track students' financial aid information.)

Exploring Alternatives

Because the outlook for unit records is so uncertain -- Congress is unlikely to even consider the idea until the middle of next year at the earliest -- it is only prudent, Schneider said, for the department to explore alternative ways of finding better data on student academic progress. Expanding IPEDS is one logical option, he said, because the department can decide to change its guidelines for IPEDS without Congressional approval. Right now, he said, department officials are in the process of determining just what kind of additional information they might seek that would provide more useful graduation rate and outcomes data. "We're thinking about what the expansion might look like, how many cells [of information to ask for], how difficult it would be, how costly."

The list of data is long: Schneider mentioned as being "under consideration" adding variables on students' ethnicity and income level, whether they are financially dependent or independent, live in-state vs. out of state and on campus or off campus, and whether they are married or single, among others. That would allow policy makers, college officials and researchers to get a much better sense, he argued, of how different types of students are performing, though it would still have the underlying limitation of IPEDS of including only full-time, first-time students, omitting part timers. (Schneider said department officials are also planning to collect more data about college costs and prices through IPEDS, although that change is a separate matter and likely to proceed whether or not the department chooses to seek more academic information.)

Schneider acknowledged that the department was walking a delicate line in deciding how to proceed with the IPEDS expansion, given the uncertainty of the unit records discussion. "We know we want more information and better information. We're not sure how hard to push on expanding the student component of IPEDS, because if we're going to move into the longitudinal records, we don't want to go too far down the road on asking universities for more data in the aggregate. We don't want to increase the burden on universities by doing this, and then move on to [unit records]."

One college association official who had been told about the department's plans said the IPEDS changes, if carried out, would result in a "12-fold increase in IPEDS reporting requirements in terms of the burden going to campuses."

While that prospect worried some officials, others speculated that the department might be raising the idea precisely to build support for unit records. One college lobbyist, who said department officials had referred to the IPEDS expansion as "humongous IPEDS" and "IPEDS on steroids"  as well as "Huge IPEDS," called it the "Nightmare on Elm Street" scenario, "designed to scare people into saying, 'Okay, we'll take the modified unit records approach'" (the one with the third-party intervention).

Although Schneider scoffed at that suggestion, he did say that he believed "more and more postsecondary people are coming to the conclusion that it's cheaper, better, and faster to provide information as student records."

See all postings »
Advertisement
Advertisement

Matching Jobs

Comments on IPEDS on Steroids

  • IPEDS
  • Posted by Cindy , A reader on December 1, 2006 at 7:45am EST
  • All this data collection leaves me wondering just whom it is supposed to serve -- the "consumers" who may or may not choose to utilize the higher education they receive, or statisticians who are frothing for more ways to conjure up "trends" and validate their so-called work? I don't know who they're trying to fool by claiming that any type of student data collecting would be anonymous. It's impossible to track someone without a name and method to identify who they are and what they do. But, even if you could invent some way to do that, how will the numbers reflect "success"? Personally, I know several bright women who successfully completed their college program with honors, and who now are stay-at-home moms. Is that success or failure? I know of promising young men who have failed at business after business after business, and who are working in factories or as KFC or Wal-Mart managers. Is that success or failure on the college's part? I also know of a couple highly intelligent college grads who are bartenders -- and making significantly better salaries than they would be in their chosen fields. Is that failure or success? I also know a litany of successful people who never stepped inside a college door, who own their own businesses or invested profitably in the stock market, or who simply did well in their jobs. How do you track that? My personal opinion is that the government and education systems on all levels, be it early education or doctoral programs, are too wrapped up in generating and dissecting what they call quantitative and qualitative, outcome-based numbers that in reality don't reflect anything except a hypothetical marker set by people who lost touch with the real world eons ago. In fact, they're so out of touch I couldn't even honestly call them ivory tower professors -- they just seem to be out there in outer space somewhere, wanting to keep touch with real life by zoning in on ways to destroy people's right to privacy. With the IPEDS issue, why not just let the students absorb -- or not -- the learning materials they choose to study -- or not -- and allow life to run its course, as it will, of course, instead of attempting to compartmentalize and catalogue a subject with so many variables?

  • Useless information
  • Posted by ap on December 1, 2006 at 8:20am EST
  • Yes, I see it now: mothers and fathers of high school juniors logging in to the IPEDS-from-hell to check out the progression rates of Hispanic kids who are independent at California 2-year campuses. Really helpful stuff in making college-going decisions...

    It's curious how these Republican cost-cutting administrators are so intent on massively increasing the bureaucracy and the data collection systems for something that will make very little difference.

  • more data
  • Posted by Researcher too on December 1, 2006 at 8:20am EST
  • In listing the additional variables they named marital status? Think of all the great educational outcomes studies that can be done on married or unmarried students. Clearly, this administration is following the more is better approach and attempting to grab as much as they can.

    I also find it interesting that because the IPEDS is already in place the DOE may add fields to it and make it more difficult for institutions to respond without any oversight. So give the DOE a survey and they use it as leverage to get what they really want. Nice...

  • HUGE IPEDS!
  • Posted by feudi pandola on December 1, 2006 at 8:46am EST
  • We have MORE than enough data about higher education. In fact, we are drowning in our databases! The real issues in higher ed are very simple. Many students should never
    matriculate to college, be it two year, four year, whatever. Students and their familes waste billions of dollars trying to force students into college who have no desire whatsoever to be there. That is what all the "data" tells us; that is an inescapable conclusion of any objective read of the situation.

    The Department of Ed needs to get a grip. The bureaucrats are very well fed as it is and the American people do not need to waste any more valuable resources on micro-managing the obvious. Parents need to be honest with their children and accept their capabilities and interests. We need carpenters as well as surgeons. Get the word out!

  • Posted by Mike on December 1, 2006 at 9:31am EST
  • Why the ranting about this particular administration. All administrations are guilty of this sort of stuff. I for one do not believe for a second that, "if only the right people" were running things these outcomes would be better.

    That said, one of the few things governments have done effectively is to collect and disseminate data. I doubt whether the BLS would have a private counterpart emerge in its absence. So, there is some benefit to have access to college data.

  • college isn't for everyone
  • Posted by S.D. on December 1, 2006 at 9:31am EST
  • I agree, Feudi. I have three children. One loves school and will most likely go to college. One is extremely lazy, but very smart. It remains to be seen if he'll go on to college because he prefers the easy-way-out. The third child struggles through school and has difficulty reading. However, he is far from lazy and is the first child to work in the yard for extra money! If he goes to Vo-Tech and learns carpentry, home building, or something like that, I would be just as proud of him as the child who goes to college. He has a bright future, but it probably won't involve a four year college degree.

  • DATA REPORTING MYTH
  • Posted by LAR on December 1, 2006 at 9:50am EST
  • In a recent article in the Community College Week (11/20/06)"Michigan audit finds eight Community Colleges fumbled data recording and record keeping". Seems there needs to be a push for a data dictionary before any reliable data can be used.

  • Marital Status?
  • Posted by Anonymous on December 1, 2006 at 11:10am EST
  • A variable about marital status will probably induce a debate about whether or not to include partner status, whether "divorced" and "single" should be separate categories or the same, and so on. Seems like a way to endlessly muddy data collection with institutions who often can barely get their gender and major counts correct.

  • Not using the data they have
  • Posted by Rob Rittenhouse , CS Faculty at McMurry University on December 1, 2006 at 11:11am EST
  • Well, given that Spellings is apparently unaware of the information provided by her own bureaucracy (see http://www.insidehighered.com/news/2006/11/29/spellings ) I don't see either Huge IPEDS or the proposed unit record system as being worth bothering with.

    I do believe that this whole thing is being pushed by the standardized testing industry.

  • HUGE IPEDS
  • Posted by PEP on December 1, 2006 at 11:15am EST
  • Even the "small IPEDS" is riddled with errors because the definitions of the data points are not tight, those who provide the data at institutions are not unifomrly competent to do the work, and there is no audit. Whatever it currently tells us, useful or not, is at best highly suspect.

  • Follow the money
  • Posted by mae on December 1, 2006 at 11:30am EST
  • Check for campaign contributions of those who would benefit (ala GOP consistently hauling water for the for-profit diploma mills) and you will see one motivation.
    Then imagine the same folks quantifying as 'waste' all those who degrees earned by folks in the arts, literature, history, education, social work, and other non-corporate-cog professions that 'don't contribute to the economy' (in their limited view) and you will see another.
    Is the ideology-driven rationale for HugeIPEDS getting clearer now?

  • Some thoughts
  • Posted by Duncan on December 1, 2006 at 11:30am EST
  • With the advance of tech., it is a reasonable step to expand the data collection and allows more detailed analysis to things.

    On the other hand, there is a question of if it is necessary to collect that vast amount of data. There are times that sampling is good enough like what BLS is done. But, of cause, there is a question of which way is more efficient?

    At this point, I think IPEDS is mandatory for institutions that receiving aids from DOE. So there is some kind of balancing mechanism build in. If institions think the aids do worth the trouble of reporting, they will comply. But DOE will have to be careful in that there may be a point that institutions will simply opt to not receiving aids. If this happened, DOE will be forced to seeking more fund to increase incentives of institutions.

    The other good question is if collecting more data is necessary to improve United State's hihger education? Just think about some of the rising countries, did they spend all these resources in order to improve their education system? Or, just maybe, they simply follow the common sense?

  • Posted by Frank Conlon , Professor Emeritus at University of Washington on December 1, 2006 at 12:15pm EST
  • It is observed that since we can gather and store and work on greater amounts of data that we should do it. When my spouse taught in a private middle school some years ago one lunch time activity of some students was to blow jello through straws. Not all could do it, but over the course of the year competency increased with practice. Then some bright lad taped two straws together and apparently got a record for distance. He had the capacity to do it, but why should he?

    Having been involved with some aggregation of educational data, followed by disaggregation in new categories, I have discovered that the "data points" rarely have widely understood definitions, that data entry is done by the least trained and experienced personnel, that it all adds up to a bunch of, well, "data".

    I think the reason that some of the earlier posts on this subject have been critical of the present administration lies in the combination of perceptions where the GOP has talked for years about states rights and less big-government, and has embraced--particularly post 9/11--in an extremely active policy of centralizing authority and information. One ought be concerned about this not only on issues of individual's privacy. There is also a visible current of effort to homogenize education in the name of equity (while demanding that teachers recognize the wide variety of their students' preparations, background, capacities and "styles of learning."

    I would object to IPED and similar ideas if they had been put forward by Bill Clinton or any earlier President. The fact that the policies are being promoted by one of the most constantly ideologically driven administrations in recent history serves only to add further weight to my concern.

    Frank Conlon

  • re:
  • Posted by PS on December 1, 2006 at 4:30pm EST
  • As an institutional researcher very familiar with IPEDS, I can say the burden of a unit-record database on institutions will be minimal. The only people who think it will be a large burden are IT managers and IR people over 45 years old who have to write a SQL script to add 2+2 and can't use Excel or SPSS. The "institutional burden" argument doesn't make any sense in light of the technical software available today, but it does give the offices responsible for IPEDS leverage in asking for more resources.

    I think the database is a good idea. While I admit we know the answers to a lot of questions, the unit-record database will allow us to customize variables and get localized data. People complain that educators don't use data and research for improvement and I would guess it is because people feel it is not relevant to them.

    But with the unit-record database, I could discover not only the transfer rates of students for all 2-year colleges, but for the institution I work for and look at the characteristics of the students who don't transfer, controlling for other variables, and recommend improvements for ensuring students complete their degrees.

    Since when is using research for improvement, instead of for professors who write irrelevant and pointless articles no one will ever read except for the grad. students who are forced to in their class, a bad thing?

  • Reply to PS's naive observations
  • Posted by SE on December 4, 2006 at 5:10pm EST
  • Dear PS -

    Actually you are way off the mark when you say that "... The only people who think it will be a large burden are IT managers and IR people over 45 years old who have to write a SQL script to add 2+2 and can’t use Excel or SPSS. The “institutional burden” argument doesn’t make any sense in light of the technical software available today, but it does give the offices responsible for IPEDS leverage in asking for more resources."

    The truth is IT managers would welcome this collection methodology if students' privacy is maintained as described in one of the articles. The database would be a good source of comparative information and would avoid "Huge IPEDS" with many, many additional reports which really would induce a burden onto higher ed and IT in particular. The unit record database would be easy for IT to provide to "old" IR folk (or young, naive whippersnappers like you.)

    You appear to have an issue with "IT & IR people over 45"? Are you in a subservient position and rebelling?

    SE