On being seduced by The World University Rankings (2011-12)
Well, it’s ranking season again, and the Times Higher Education/Thomson Reuters World University Rankings (2011-2012) has just been released. The outcome is available here, and a screen grab of the Top 25 universities is available to the right. Link here for a pre-programmed Google News search for stories about the topic, and link here for Twitter-related items (caught via the #THEWUR hash tag).
Polished up further after some unfortunate fall-outs from last year, this year’s outcome promises to give us an all improved, shiny and clean result. But is it?
Like many people in the higher education sector, we too are interested in the ranking outcomes, not that there are many surprises, to be honest.
Rather, what we’d like to ask our readers to reflect on is how the world university rankings debate is configured. Configuration elements include:
- Ranking outcomes: Where is my university, or the universities of country X, Y, and Z, positioned in a relative sense (to other universities/countries; to peer universities/countries; in comparison to last year; in comparison to an alternative ranking scheme)?
- Methods: Is the adopted methodology appropriate and effective? How has it changed? Why has it changed?
- Reactions: How are key university leaders, or ministers (and equivalents) reacting to the outcomes?
- Temporality: Why do world university rankers choose to release the rankings on an annual basis when once every four or five years is more appropriate (given the actual pace of change within universities)? How did they manage to normalize this pace?
- Power and politics: Who is producing the rankings, and how do they benefit from doing so? How transparent are they themselves about their operations, their relations (including joint ventures), their biases, their capabilities?
- Knowledge production: As is patently evident in our recent entry 'Visualizing the uneven geographies of knowledge production and circulation,' there is an incredibly uneven structure to the production of knowledge, including dynamics related to language and the publishing business. Given this, how do world university rankings (which factor in bibliometrics in a significant way) reflect this structural condition?
- Governance matters: Who is governing whom? Who is being held to account, in which ways, and how frequently? Are the ranked capable of doing more than acting as mere providers of information (for free) to the rankers? Is an effective mechanism needed for regulating rankers and the emerging ranking industry? Do university leaders have any capability (none shown so far!) to collaborate on ranking governance matters?
- Context(s): How do schemes like the THE's World University Rankings, the Academic Ranking of World Universities (ARWU), and the QS World University Rankings, relate to broader attempts to benchmark higher education systems, institutions, and educational and research practices or outcomes? And here we flag the EU’s new U-Multirank scheme, and the OECD’s numerous initiatives (e.g., AHELO) to evaluate university performance globally, as well as engender debate about benchmarking too. In short, are rankings like the ones just released 'fit for purpose' in genuinely shed light on the quality, relevance and efficiency of higher education in a rapidly-evolving global context?
The Top 400 outcomes will and should be debated, and people will be curious about the relative place of their universities in the ranked list, as well as about the welcome improvements evident in the THE/Thomson Reuters methodology. But don't be invited into distraction and only focus on some of these questions, especially those dealing with outcomes, methods, and reactions.
Rather, we also need to ask more hard questions about power, governance, and context, not to mention interests, outcomes, and potential collateral damage to the sector (when these rankings are released and then circulate into national media outlets, and ministerial desktops). There is a political economy to world university rankings, and these schemes (all of them, not just the THE World University Rankings) are laden with power and generative of substantial impacts; impacts that the rankers themselves often do not hear about, nor feel (e.g., via the reallocation of resources).
Is it not time to think more broadly, and critically, about the big issues related to the great ranking seduction?
Read more by
Opinions on Inside Higher Ed
Inside Higher Ed’s Blog U
What Others Are Reading