Rating My Professor - For Real
Students at the University of Minnesota have for years called for access to student course evaluations that they provide at the end of courses, saying they’ve got a right to know what peers have thought of the classes they’re considering. Now they might get their wish – at least part of it. The University Senate is considering a proposal to make student feedback about courses public. But student responses about questions specifically related to professors would remain private, in accordance with state privacy laws for employees.
The university hopes the data will help students make more informed class selections, and offer more comprehensive and relevant information than that which is currently available on student-driven feedback sites, such as RateMyProfessors.com (the Minnesota evaluations don’t have a question on instructor “hotness,” for example).
"We think this is an excellent step forward in providing students quality information,” said Robert McMaster, vice provost and dean of undergraduate education. “I’m not going to say anything negative about RateMyProfessors.com, but that’s a much different kind of thing than this rigorous, standardized approach.”
And while McMaster politely avoided the question of RateMyProfessor.com, faculty members and academic leaders at many campuses hate the site as much as some students love it. (Some students also dislike it, including Minnesota's own student government, which said third-party sites contain "polarized" and "unverifiable" data in a recent position statement asking for more transparency of official student feedback.) But at many campuses, the professors' and administrators' dislike for the site hasn't translated into giving students something more educationally meaningful to consider when evaluating potential courses.
In an email, Carlo DiMarco, senior vice president of strategic partnerships for MTV, which owns RateMyProfessors.com, defended the site's worth.
“I think it’s a good compromise given the constraints that we’re under here,” he said. “I haven’t heard much in the way of complaints about it, much in the way of advance concerns, as with other proposals in the past.”
Konstan said he didn’t have a problem with faculty evaluations that evaluate faculty members by name, but, like McMaster, he said that the new process would still be a more reliable alternative to third-party feedback sites.
He added that “anything can happen when you get a large group of faculty together,” but that he believes the motion will pass. Konstan acknowledged general faculty fears about student evaluators – that students might translate an easy course to a good course, for example – but said that aggregate evaluative data, as would be included in the new student resource, tends to paint a reliable picture of a course.
Excluding inappropriate or discriminatory comments, Konstan said, “My experience has been that when student say things consistently, there’s usually something behind them.” (Interestingly, a 2011 study from the University of Wisconsin at Eau Claire suggested something similar, in relation to RateMyProfessors.com. The study found that 10 reviews showed about the same consensus about a professor as did 50 reviews, a much larger sample size, or even more. The study also found that the site's users are "likely providing each other useful information about quality of instruction.")
More than that, he said, professors “can’t consistently high scores by being easy. Students know when they’re not learning much.”
McMaster said the same about a public question about how many hours per week students spent preparing for the course. Rather than opting for the smallest workload, he said he believed students would use the information to fill out their schedules. A course that required 10 hours of work per week might not be right for a semester schedule that also included heavy-hitters such as chemistry and economics, for example, he said.
Students support the plan, although they’ve advocated for the Minnesota state legislature to amend the law so that even more information can be made public.
A recent editorial in the student newspaper, the Minnesota Daily, endorsed a motion by the Minnesota Students Association to make the student course evaluation process more transparent, and advocated changing the law to allow for the release of instructor-specific data without an instructor’s explicit permission.
“We would like to see lawmakers and university leadership change this law,” the editorial says. “Doing so would allow for more transparency without making access to teacher evaluations easily available to those without a serious reason to look at them.”
It continues: “Teacher evaluations are vital to the University’s ability to remain a quality and competitive institution.”
Making course evaluation data available to students isn’t unique to the University of Minnesota. Yale University, for example, has made data about courses and instruction available to students for years through its website -- although two students recently accused it of forcing them to shut down a shadow site they said made it easier for students to compare courses by ratings. The American Association of University Professors picked up on the story, writing about it in its blog, “Academe.” A university spokesman said that the university acted because the students were "scraping data" from a Yale site and modifying course evaluation information in a way that was objectionable to the faculty, and that earlier attempts to reach a resolution with the students were met with delay.
John K. Wilson is co-editor of the American Association of University Professors’ "Academe" blog and author of the Yale post. Wilson said he’s personally in favor of offering students more information, not less.
“A classroom is not a secret space that must be kept in the shadows,” he said. “Students already have informal networks for sharing this information. Why not give them better data?”