Search News


Browse Archives

News

New Knock Against Earmarking

April 15, 2009

Share This Story

FREE Daily News Alerts

Advertisement

For all the hand wringing about the perceived decline of American scientific research, the U.S. is still the envy of much of the rest of the world -- notably Europe, which has been beating itself up about its "innovation gap" compared with its cross-Atlantic competitor, especially when it comes to "frontier," or path breaking, research.

But as leaders and university officials in numerous European countries and across the continent debate whether and how to alter research programs and policies to make them more like their U.S. counterparts, several American and European economists offer a cautionary note in a paper issued by the National Bureau of Economic Research.

Examining the interplay of university research output, the governance of research institutions, and how they are funded in the U.S. and Europe, the researchers conclude that when presented with an increase in outside funding, public universities use that money more productively if they have more autonomy and more frequently compete with private universities for research dollars.

While the researchers frame their study primarily to inform the discussion about how Europe might alter its system of funding scholarly science, their conclusion has implications for state and federal officials deciding how to allocate their own grant money. That's especially true on the hotly contested terrain of peer reviewed, competitive studies vs. those earmarked, or mandated, by lawmakers.

"The most natural overall interpretation of our results is that frontier research is a complex thing that a university can only pursue effectively if it has the discretion to direct resources and researchers toward what it believes are the most promising paths," they write. "Universities will put more effort into directing resources well if they know that rewards are allocated based on competition, especially competition that is strictly merit-based."

The researchers, who include Stanford University's Caroline M. Hoxby, Harvard's Philipp Aghion, and three European scholars, build their case through a complex series of analyses that this "economics for dummies" article (a reference to this reporter, not his readers) cannot do justice. They begin by showing that in both Europe and the United States, the performance of universities -- gauged by their representation in international rankings of research output and -- correlates to their autonomy and competitive environment; in other words, universities in some European countries and certain states in the U.S. perform better on output measures, and those that thrive tend to be more autonomous and face more competition for funds with private institutions.

Those correlations are insufficient to prove categorically the researchers' theses that "university autonomy and competition cause higher output," they note. "Reverse causality is quite plausible: Perhaps governments allow very productive universities to be more autonomous and such universities campaign for resources to be allocated by competition, rather than rules."

So they turn to analyses designed to prove cause and effect, focused on the United States. They map changes in the membership of Congressional and state legislative appropriations committees -- which they characterize as creating "crucial, arbitrary shocks" that produce significant increases in the research funding levels for some universities -- against how successful various institutions were in translating the increased research grants into patents.

And they find that "exogenous increases in expenditures of U.S. universities generate more patents if the universities in question are more autonomous and face more local competition (for resources, faculty, and students) from private institutions."

The last piece of the puzzle for the researchers is an analysis showing that universities of all types become proportionally more productive (in terms of turning out patents) at "higher stakes" times -- times when competitive research funds rise.

Taken together, they write, "[t]hese results suggest that autonomy and market competition improve universities' research output more when those universities can see that research effort is richly rewarded through merit-based competitions. In other words, policy makers may have a role to play by focusing universities' competition on research, as opposed to politics or other activities. Universities are induced to use their autonomy productively when they operate in a high stakes, competitive research environment."

See all postings »
Advertisement
Advertisement

Matching Jobs

Comments on New Knock Against Earmarking

  • Sorry, But I'm Not Going There
  • Posted by Frizbane Manley on April 15, 2009 at 10:15am EDT
  • Two things …

    First, as a prefix to my comments – and admitting I wish there were a bit more transparency -- I am generally in favor of earmarked funding at the level it exists in the U.S. federal government today.

    Second, in two companion essays in which I claim the principal root cause of the current world-wide economic meltdown lies at the feet of American higher education, I have the following blurb …

    ”Consider the matter of a business decision that must be made. The analyst starts the process by ascertaining what important constructs might have an impact on the decision and what constructs will be affected by acting on that decision. Since these choices are invariably incomplete, this part of the process is subjective ... so we are already once removed from reality. Then we must operationalize the constructs and measure the variables ... so now we’re thrice removed from reality. Next, we collect data (with the myriad difficulties of doing that either correctly or well), choose our analytical tools, and then, up to some degree of probabilistic “certainty” and making seat-of-the-pants adjustments for all of the analytical assumptions which must be met (but never are), we draw conclusions about the analytic results. So now we have a statistical decision that is at least six times removed from reality. If we think all of this makes sense, we should then be prepared to make the gigantic leap from our model’s conclusions back into a real world in which the consequences of the decision will affect jobs, incomes, families, communities ... even lives. I encourage you to ask Robert McNamara how that works ... for a CEO of Ford Motor Company ... or for the President of the World Bank ... or for a Secretary of Defense managing a war, say, in Viet Nam.”

    At another point in the essays I wrote …

    “Variables are almost always poorly operationalized and measured. Both the conduct of comprehensive empirical research and obtaining the data thereof cost money, so it is convenient for faculty to patch together data from various already-completed studies that often have only a marginal bearing on the issue at hand. Analyses are often adjusted to fit the available data, and so-called meta analyses – combining studies originally conducted for disparate purposes into a ‘unified’ analysis -- abound.”

    After reading your article, Doug, I went to the Natural Bureau of Economic Research site to read “The Governance and Performance of Research Universities: Evidence from Europe and the U.S.” by Aghion, Dewatripont, Hoxby, Mas-Colell, and Sapir. There I found …

    “We investigate how university governance affects research output, measured by patenting and international university research rankings. For both European and U.S. universities, we generate several measures of autonomy, governance, and competition for research funding. We show that university autonomy and competition are positively correlated with university output, both among European countries and among U.S. public universities. We then identity a (political) source of exogenous shocks to funding of U.S. universities. We demonstrate that, when a state's universities receive a positive funding shock, they produce more patents if they are more autonomous and face more competition from private research universities. Finally, we show that during periods when merit-based competitions for federal research funding have been most prominent, universities produce more patents when they receive an exogenous funding shock, suggesting that routine participation in such competitions hones research skill.”

    So – and there are many more problems with this Harvard, Stanford, Bruxelles, Pompeu Fabra research than is suggested in my generalizations – if …

    1. you are willing to believe patents and someone’s ranking of universities’ research is equivalent to the effectiveness of competitive – as opposed to earmarked – funding,

    2. you have no problem with research scholars searching hither and yon for existent data that might – but might not -- be related to weakly operationalized variables that are vaguely related to their conjectures,

    3. you are prepared to make the leap from correlation to causality (which strikes me as being nothing less than bizarre in this context),

    then you are home free.

    But I can tell you it is one Hell of a stretch for me … and despite all of that statistical wizardry the authors pulled out of their collective hats.

    By the way, another quote from one of my essays is …

    “So why, in the face of this criticism, do mathematical modelers in business (and the social sciences) have so much influence and why do their mostly frivolous models have such lasting power? The answer is obvious. One of the central tenets of both student and professorial behavior and decision-making is ‘If I don’t understand it, it must be profound.’ How many times have you heard a student say, ‘S/he is a brilliant scholar, but s/he just couldn’t explain those concepts to us lowly students.’ How many faculty tolerate their most prestigious journals being clogged with mathematical gibberish because ‘Oh my, look at that incredibly complex, intellectually value-free mathematics. I don’t understand it myself, but it must be very important.’”

    Right!

  • What economists did for the economy...
  • Posted on April 15, 2009 at 12:00pm EDT
  • I have to admit to being persuaded by Manley's view that root assumptions and methods of reasoning may be flawed. 

    These same methods of reasoning were at the helm of an economy that has just imploded, and neither brilliant individuals within it nor their collective profession was able to prevent that implosion. After a dismal performance in their area of specialization, it's hard to be confident in any professional group who thinks they should next be in charge of influencing policy for higher education. What economists did for the economy, they can do for our educational institutions. 

  • The last comment, anonymously posted
  • Posted by DFS on April 17, 2009 at 3:45pm EDT
  • It wasn't the economists -- rather, it was the abusers of the system, you know, the breakers of the laws who screwed things up for all of us.
    Just like Mr. Tim -- the Tax Cheat who got away with it, with no penalty.
    Change we can (we have to) believe in, I guess.
    The next administration will be no better until we enforce our laws.

  • Sorry DFS … You’re Waaaay Off Base
  • Posted by Frizbane Manley on April 19, 2009 at 5:15am EDT
  • First DFS, read my first post.

    Here is the preface to my first essay …

    “When, in this and the companion essay, I use training, I intend it to be interpreted in contrast to education. Despite the claims of proponents of General Education, I believe a large majority of the graduates of American undergraduate professional schools are being trained, not educated. While I think that is unfortunate, I do not count it amongst the significant shortcomings of higher ‘education’ in the United States.

    In addition, by ‘intelligent’ I mean possessing a fairly high level of what some of us think is measured by IQ tests, by ‘stupid’ I mean knowing a ‘right’ action to take, but, for whatever reason, choosing not to take it, and by ‘ignorant’ I mean not having sufficient information, short of a great deal of studying and learning, to make an optimal decision and take an effective action, given an opportunity to do so.”

    You are wrong that “it was the abusers of the system, you know, the breakers of the laws who screwed things up for all of us.”

    Here is an excerpt from my second essay …

    “Conclusion

    I don’t want you to get the wrong impression here. I DO think a significant majority of those who “manage” large corporations in the United States – including those in the financial industry – are ignorant. I’m not saying they’re uneducated. They’re not. I’m not saying they’re stupid. The vast majority are not. What I am saying is that they know beans about corporate decision-making and management other than what they learned in their BBA and MBA programs … and then a bit more that they’ve picked up while flying by the seats of their pants and skirts on the job. Indeed, I believe the lessons they learned in their business school programs generally have a negative impact on the effectiveness of their decision-making and on their management of employees (whose formal educations are virtually identical to those of their bosses)….

    For the most part, there’s a substitution principle at work here. The heads of our corporations are ignorant, not because they learned what they learned -- for the most part at our premier universities -- they are ignorant because (1) only a tiny fraction of their professors have ever had real-world business experience (except as consultants … and isn’t that frightening) and (2) an overwhelming amount of what they learned is based upon hit-or-miss flavor-of-the- month procedures or on mathematically trivial models whose relevance to real-world decision-making is practically nil. Had their teachers known anything at all about business management and the real applications of economics and finance, these heads of corporate America might have been adequately prepared for the task at hand. Indeed, I would wager that had all of these Masters of the Universe skipped their BBAs and MBAs and gotten their undergraduate and masters degrees in electrical and mechanical engineering and operations research, we would not be lost in the economic wasteland we find ourselves in today.

    I can assure you that the golden age of American business schools has never existed outside the realm of hype. I am inclined to say to these b-schools, “If you cannot clean up your acts, get out of the business.” Unfortunately, there is no possibility our business schools can clean up their acts, and there is no possibility they will get out of such a lucrative business. That being the case, it is time for the rest of us to rethink the training – and don’t even delude yourselves about the education – of the ‘leaders’ of our business enterprises. In the absence of that, we can do nothing but reaffirm Edmund Burke’s old adage that ‘those who do not learn from history are doomed to repeat it.’”

    So DFS, you are not correct about the economists – or graduates of American business schools. It is neither greed nor dishonesty that is the root cause of the economic meltdown we are experiencing today … it is, for the most part, the ignorance of those trained in management, economics, and finance who are to blame. No one is talking about root causes these days … only symptoms of the problem. The principal root cause is the ignorance of those who have gotten BBAs and MBAs at American business schools.