News, Views and Careers for All of Higher Education
Sept. 21, 2006
“There is inadequate transparency and accountability for measuring institutional performance, which is more and more necessary to maintaining public trust in higher education.“
“Too many decisions about higher education — from those made by policymakers to those made by students and families — rely heavily on reputation and rankings derived to a large extent from inputs such as financial resources rather than outcomes.”
Those are the words of the Secretary of Education’s Commission on the Future of Higher Education, which on Tuesday handed over its final report to Secretary Margaret Spellings.
Less than a week before Spellings announces her plans to carry out the commission’s report, a panel of higher education experts met in Washington on Wednesday to discuss how colleges and universities report their learning outcomes now and the reasons why the public often misses out on this information. On this subject, the panelists’ comments fell largely in line with those of the federal commission.
The session, hosted by the Hechinger Institute on Education and the Media, at Columbia University’s Teachers College, included an assessment of U.S. News & World Report’s annual college rankings, which critics say provide too little information about where students learn best.
“The game isn’t about rankings and who’s No. 1,” said W. Robert Connor, president of the Teagle Foundation, a group that has sponsored a series of grants in “value added assessment,” intended to measure what students learn in college. Connor said colleges should be graded on a pass/fail basis, based on whether they keep track of learning outcomes and if they tell the public how they are doing.
“We don’t need a matrix of facets summed up in a single score,” added David Shulenburger, vice president of academic affairs for the National Association of State Universities and Land-Grant Colleges.
What students, parents, college counselors and legislators need is a variety of measuring sticks, panelists said. Still, none of the speakers recommended that colleges refuse to participate in the magazine’s rankings, or that the rankings go away.
“It’s fine that they are out there,” said Richard Ekman, president of the Council of Independent Colleges. “Even if it’s flawed, it’s one measure.”
Ekman said the Collegiate Learning Assessment, which measures educational gains made from a student’s freshman to senior year, and the National Survey of Student Engagement, which gauges student satisfaction on particular campuses, are all part of the full story. (Many institutions participate in the student engagement survey, but relatively few of them make their scores public.) Ekman said there’s no use in waiting until the “perfect” assessment measure is identified to start using what’s already available.
Still, Ekman said he is “wary about making anything mandatory,” and doesn’t support any government involvement in this area. He added that only a small percentage of his constituents use the CLA. (Some are hesitant because of the price, he said.)
Shulenburger plugged a yet-to-be completed index of a college’s performance, called the Voluntary System of Accountability, that will compile information including price, living arrangements, graduation rates and curriculums.
Ross Miller of the Association of American Colleges & Universities said he would like to see an organization compile a list of questions that parents and students can ask themselves when searching for a college. He said this would serve consumers better than even the most comprehensive ranking system.
The Spellings commission recommended the creation of an information database and a search engine that would allow students and policymakers to weigh comparative institutional performance.
Miller also said he would like to see more academic departments publish on their Web sites examples of student work so that applicants can gauge the nature and quality of the work they would be doing.
Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.
Advertisement
Isn’t it humurous that someone with a B.A. is trying to tell colleges how to better function. It was obvious on her appointment that Spelling is far more of a “professional politician” than she is a trained educator. Anyone that had a part in drafting NCLB should be ashamed to put in on their resume. How does one go from advising the president on domestic issues to heading up the nation’s education department? Certainly not by any academic training! Let’s leave the assessment of colleges and universities up to people that know what they’re talking about. We certainly don’t need to even come close to a post-secondary version of NCLB.
Dr. Clark Roush, Professor of Music at York College, at 9:50 am EDT on September 21, 2006
..about academics.
Geez...apparently one has to have a PHD in order to be knowledgable or to organize and manage a group.
Clearly you don’t like NCLB and you think Sec’y Spellings’ preparation is inadequate. Fine. Try being constructive and work to have your voice heard if you have any better ideas.
It is time to face the reality that policy-makers want evidence of student learning. It is going to happen whether you like it or not, and if you simply rail against it and make snarky comments, you will just look the fool and dragged along anyway.
TM, at 11:20 am EDT on September 21, 2006
I doubt anyone would want someone who had just finished a B.A. in pre-med running the American Medical Association. Sometimes being frank about the lunacy of proposals is a viable way of making people stop and think. My remarks were not nearly as “snarky” as one of the message headings here. What in your past would make you believe someone in the arts would not know anything about academics?
Dr. Roush, at 12:35 pm EDT on September 21, 2006
I agree that it is time we got people who don’t know anything about education out of the classrooms and let teachers do what they are trained to do, have practice doing, and know how to do well. Government-imposed tests don’t measure much.
Can you imagine what would happen if I walked into a police station and began telling the lieutenant to re-organize his office and his staff? I feel the same way when the farmer on the Board of Trustees at my college comes in and tells me how to teach my classes.
Jane, at 1:40 pm EDT on September 21, 2006
Yeah, Jane, but there’s a reason why the farmer is on your board: ACCOUNTABILITY.
Are we supposed to trust that you are doing your job of educating young people well?
AC, at 1:50 pm EDT on September 21, 2006
Educators must stand together! Enough is enough. NCLB was a political move that has done much more harm than good. Great educators are leaving the profession of teaching because of the pressures put on them by NCLB. Educators are asked every year to add more and more to their already full plate of responsibilities. There is even a push for longer school days and longer school years. Why not stop adding more to do? It is very difficult to even teach reading, math, science, english, history, etc. Then you add the curriculums of music, art, physical education, technology, ect. Enough is enough.
Michael B. Wood, Harding University, at 2:15 pm EDT on September 21, 2006
But isn’t it also true that in higher education the onus for actually learning lies with the student not the faculty member?
To compare student success in higher education with NCLB is a poor analogy. Students in higher education are suppossed to shoulder the responsibility for getting a complete education and speaking up when they are perceiving they’ve been short changed.
A better analogy may be to other professions that are based on human experimentation and development... After all we allow other professions — medicine for example — to report that the patient didn’t respond to treatment.
Linda, student at Eastern Michigan University, at 4:05 pm EDT on September 21, 2006
Researchers have a tough enough time figuring out what educational statistics really mean, how will the public be able to do so? For example, if college A has a higher gradudation rate than college B, does this mean that 1-college A is doing a better job than college B 2-students are more prepared in college A, 3-students in college A have less family responsibilities, 4-a diploma in college A is more valuable in the local marketplace due to better economy making students more motivated to graduate, 5-any combination of the above and other possible reasons. What colleges need to do is make sure that their curriculms are of high quality and that students are placed appropriately into courses and graded according to reasonable standards. If a college can determine that is has high quality and well run programs, support services and adminsitration, desirable outcomes such as increased graduation rates may follow but probably not as much politicians or the public may hope for.
CE, at 4:10 pm EDT on September 21, 2006
Obviously, some of you don’t like Spellings and the thought of being held accountable for your teaching through measurements angers you — but there are instructors out there that do not measure up (perhaps not you but they are out there) and Spellings is calling them on the carpet. It’s about time! And let us not forget that even though she may only have a BA she is surrounded by people with a great deal of expertise in the field and recieves constant input from many scholars. She is NOT making decisions alone.
LA, at 4:10 pm EDT on September 21, 2006
To make colleges and universities being more transparent from the point of view of their teaching results is a move in a right direction. Directly or indirectly ALL Americans pay money to the faculties and staff (including myself). But, doing this without significant improvement of a high school education beforehand is the same as fighting illegal immigrants from Mexico without building a fence; i.e. possible, but extremely hard. The difference between prospective students of different institutions might be so big that any comparison would be just zero informative. Maybe the outcome from reforming the education would be more useful for the society, if the Department of Education would leave colleges and universities alone for awhile, and concentrate the work on the K-12 part of the system?
Valentin Voroshilov, Boston University, at 4:25 pm EDT on September 21, 2006
Ah, but the Farmer is not on the board for “accountability.” The farmer is on the board because of political connections. Politics has become pervasive among upper administrators and college trustees/regents/governors, as political appointments (like the Secretary of Education) seek to implement divisive agendas that have little to do with success or accountability.
kk, Associate Professor School of Music at Ball State University, at 4:25 pm EDT on September 21, 2006
But last I checked, almost no doctoral students were taught how to teach, let alone how to assess student learning. Most faculty resist any efforts at systematic assessment of student learning, thus it is very difficult for me, or other policy-makers, to consider leaving it the “experts".
And Dr. Roush as far as your comparison to the a pre-med BA running the AMA, how would you know since they won’t make their staff listing public on their website? That type of lack of transparency and openness is at the heart of the concerns about higher ed accountability. Exactly the kind of issue to which your fellow academic Richard Vedder points. If institutions would make accreditation reports public, some of this might go away...for a while at least.
It’s not that I don’t thik someone in the arts wouldn’t know anything about academics, but I don’t think it is any less likely that someone with BA, some years of experience, and lots of contact with educators and education policy analysts, would know something about academics.
Only 9.8% of the US adult population has a graduate degree, only 17.2% a bachelor’s degree. The other 73% want to know where their tax dollars are going. Further, last I checked, most members of congress have college degrees...as do most state legislators. If their constituents were all telling them to leave higher ed alone they would likely listen...but they are not and so they don’t.
College costs keep rising. Students have complained about rising textbook costs until state legislatures and now congress have gotten involved...faculty have refused to listen.
Faculty and administrators by and large keep saying “trust us, we are the experts” but then people see what has happened with textbooks..."trust us” won’t cut it anymore.
The college lobbying groups promised Buck McKeon an alternative to the College Affordability Index...they never delivered. Trust us? Right.
My legislators keep hearing anecdotes from constituents that new grads from elite public institutions cannot write a coherent paragraph, and don’t seem to read for comprehension. They want an explanation...they want to know the value-added by four-year degree that cost the $20,000 and the taxpayers at least another $25,000.
But the only state employee group who has salary targets at the 60th percentile of peers and is all but guaranteed annual raises, keeps saying “trust us, we are experts and what we do is too difficult to measure.”
Gee, I wonder why accountability for student learning outcomes is of such interest these days....
TM, at 4:50 pm EDT on September 21, 2006
I am a college professor with a passion for teaching and learning. I began my academic career 16 years ago in the CSU system in California. In my naivette, fresh from my dissertation’s final meeting; I believed politics were secondary, if at all present in academia. Soon I learned that voicing my opinion on the importance of spelling out our department’s learning goals for our students was a taboo topic. I simply asked, what do we want our students to learn, know, or do well when they are done with the program we offer them? These two simple questions put me in a black: She is one of hose that want “learning outcomes". Well, 15 years later I am not longer in that department, I consult for educational institutions that have to spell out their learning goals for students in their self-study for reaccreditation. Why you may ask... Accountability and responsibility for what we purport to do in our profession. I still wonder how is it so difficult for some college professors to present evidence of their work. A measure, a clear statement, a representation, a learning outcomes(whatever you what to call it) of what students learn while they are in our classrooms(exposed to our lectures, examples, content, anecdocts, exams, etc.), is only evidence we are accomplishing our intented purposes. As professionals we are being asked to provide evidence we are successful. What is the difficulty with that. Why is it hard for college professors to account for the effects of their doings in their clasrooms?This college professor prefers to look inside and try to answer the question with evidence that tells me more about my passion for teaching and learning. Many of my colleagues do, I hope more would join in.
Angela Lievano, at 4:50 pm EDT on September 21, 2006
How unfair to blame faculty and administrators for the rise in the cost of textbooks! As if we choose only the most expensive books with no regard for either the books’ content or for our students’ budgets.
Laura Connolly, Econ Prof at University of Northern Colorado, at 7:45 pm EDT on September 21, 2006
We have college accreditation, audits by the state, individual college/programs accreditation, learning assessment, continuous improvement, strategic plans,etc etc etc ALREADY! In my little business school we are basically dedicating the equivalent of a whole full-time faculty to the maintaining of accreditation and assessment records and program reports just for our own business accreditation. Then we have annual reviews, tenure and promotion reviews, post-tenure reviews, annual activity reports...
But plain old academic reputation and student choice — that doesn’t count at all. Because they don’t create career paths and resume items for aspiring administrators. Or jobs for consultants.
Now, the last time I checked 90% of my state college’s budget came from the state budget or tuition payments.
The federal government can monitor how its own money (actually our money) is used (and already does), but by what authority do they have an overarching mandate to hold a state government institution or a private institution ‘accountable?’ The true conservatives (NOT the Bush administration)objected to NCLB because it was an extension of centralized control over local government, using our tax money as a stick.I can just see it now — legions of newly hired federal “college accountability inspectors", “league tables", benchmarks, scores etc. A nice gig if you can get it — a career path. And of course more budget for the Department of Education.
No wonder people like myself are ready to desert the Republican camp and vote for Democrats for the first time in our lives.
Do not be taken it by the ‘accountabilty’ and ‘who is qualified’ debate.It is a red herring.
But for everyone who insists on accountability as the benchmark, fine. Please let us know how you rate the success of the federal Department of Education and NCLB to date. Please give us “measures” of THEIR success over the last six years. How many notches did the US move up in international mathematics education? How much higher is the high school graduation rate nowadays? What benefit did we get from their use of our money vs. using that money in some other way?
PJ, at 9:55 pm EDT on September 21, 2006
I doesn’t matter if someone has a BA or PhD. There are plenty of bad teachers who have PhDs and plent of great teachers with BAs who are better are helping students learn than anyone with a PhD ever will be. In fact, someone with a PhD, a degree obtained by showing evidence through rigorous research (quantitative or qualititative), should have an *easier* time showing evidence of student learning. Sadly, as anyone who has gone through college knows, this is not the case. Learning is just not a priority for the average professor, at least not as much as issues like parking and office space. Fortunately, the time is near when the government will make it the average professor’s priority. Sorry, but the professors chose to ignore assessment and now it’s too late. I look forward to seeing syllabi written by government bureaucrats rather than professors; maybe then we will see true evidence — quantitative or qualitative — of learning.
PS, at 9:55 pm EDT on September 21, 2006
Advertisement
or search for jobs directly.
Research Associate III — (Part-Time) — 20 hrs./week * * * This position is grant funded * * * The Research Associate will be ... see job
The Office of Medical Education Services provides services to support Johns Hopkins University School of Medicine’s ... see job
Today, NLU serves more than 12,000 students from five Chicago area campuses, in addition to campuses in three states and ... see job
The Office of Institutional Research and Assessment at the University of North Carolina at Chapel Hill has a position opening ... see job
Creates and supervise operational plans: scheduling and staffing. Manage and utilize resources, staff, and budgets. Set ... see job
The Minnesota Private College Research Foundation seeks a Research Associate to join an exciting team of higher education ... see job
The Institutional Research Analyst in the Office of Planning, Institutional Effectiveness, and Research is responsible for ... see job
As one of the largest degree-granting higher education systems in North America, DeVry University provides high-quality, ... see job
Northeastern University, founded in 1898 and located in Boston, is a private research university that is a leader in ... see job
Division of Research and Faculty Development
Duties And Responsibilities: Harvard Business ... see job
Assessing Learning Outcomes
As an educator, assessing learning outcomes benefit both the instructor and the student. Why should educators assess learning outcomes? According to the APQC Institute Education for Best Practices, there are four important reasons: 1. to know how effective you are as an educator; 2. to help improve instruction; 3. to be accountable to stakeholders (i.e. students, perspective employers); 4. to help attract future students. Since the mission of most institutes of higher learning is to teach shouldn’t the outcome be learning. The educational level of the instructor is not as relevant as the learning outcomes of the students in the course.
Margaret Combs, Ms at American University of Kuwait, at 6:45 am EST on February 25, 2008