U.S. research universities' global dominance will be threatened in coming years unless governments invest more and universities become more efficient and better educate under-represented groups, according to new National Research Council report.
The most recent case of scientific fraud by Dutch social psychologist Diederik Stapel recalls the 2010 case against Harvard University of Marc Hauser, a well-respected researcher in human and animal cognition. In both cases, the focus was on access to and irregularities in handling of data. Stapel retained full control of the raw data, never allowing his students or colleagues to have access to data files. In the case of Hauser, the scientific misconduct investigation found missing data files and unsupported scientific inference at the center of the accusations against him. Outright data fraud by Stapel and sloppy data management and inappropriate data use by Hauser underscore the critical role data transparency plays in preventing scientific misconduct.
Recent developments at the National Science Foundation (and earlier this decade at the National Institutes of Health) suggest a solution — data-sharing requirements for all grant-funded projects and by all scientific journals. Such a requirement could prevent this type of fraud by quickly opening up research data to scrutiny by a wider community of scientists.
Stapel’s case is an extreme example and more likely possible in disciplines with substantially limited imperatives for data sharing and secondary data use. The research traditions of psychology suggest that collecting your own data is the only sound scientific practice. This tradition, less widely shared in other social sciences, encourages researchers to protect data from outsiders. The potential for abuse is clear.
According to published reports about Hauser, there were three instances in which the original data used in published articles could not be found. While Hauser repeated two of those experiments and produced data that supported his papers, his poor handling of data cast a significant shadow of uncertainty and suspicion over his work.
Hauser’s behavior is rare, but not unheard of. In 2008, the latest year for which data are available, the Office of Research Integrity at the U.S. Department of Health and Human Services reported 17 closed institutional cases that included data falsification or fabrication. These cases involved research funded by the federal government, and included the manipulation or misinterpretation of research data rather than the violation of scientific ethics or institutional oversight.
In both Hauser and Stapel's cases, graduate students were the first to alert authorities to irregularities. Rather than relying on other members of a researcher’s lab to come forward (an action that requires a great deal of personal and professional courage,) the new data sharing requirements at NSF and NIH have the potential to introduce long-term cultural changes in the conduct of science that may reduce the likelihood of misconduct based on data fabrication or falsification. The requirements were given teeth at NSF by the inclusion of new data management plans in the scored portion of the grant application.
NIH has since 2003 required all projects requesting more than $500,000 per year to include a data-sharing plan, and the NSF announced in January 2011 that it would require all grant requests to include data management plans. The NSF has an opportunity to reshape scientists' behavior by ensuring that the data-management plans are part of the peer review process and are evaluated for scientific merit. Peer review is essential for data-management plans for two reasons. First and foremost, it creates an incentive for scientists to actually share data. The NIH initiatives have offered the carrot for data sharing — the NSF provides the stick. The second reason is that the plans will reflect the traditions, rules, and constraints of the relevant scientific fields.
Past attempts to force scientists to share data have met with substantial resistance because the legislation did not acknowledge the substantial differences in the structure, use, and nature of data across the social, behavioral and natural sciences, and the costs of preparing data. Data sharing legislation has often been code for, "We don’t like your results," or political cover for previously highly controversial issues such as global warming or the health effects of secondhand smoke. The peer review process, on the other hand, forces consistent standards for data sharing, which are now largely absent, and allow scientists to build and judge those standards. "Witch hunts" disguised as data sharing would disappear.
The intent of the data sharing initiatives at the NIH and currently at NSF has very little to do with controlling or policing scientific misconduct. These initiatives are meant to both advance science more rapidly and to make the funding of science more efficient. Nevertheless, there is a very real side benefit of explicit data sharing requirements: reducing the incidence of true fraud and the likelihood that data errors would be misinterpreted as fraud.
The requirement to make one’s data available in a timely and accessible manner will change incentives and behavior. First, of course, if the data sets are made available in a timely manner to researchers outside the immediate research team, other scientists can begin to scrutinize and replicate findings immediately. A community of scientists is the best police force one can possibly imagine. Secondly, those who contemplate fraud will be faced with the prospect of having to create and share fraudulent data as well as fraudulent findings.
As scientists, it is often easier for us to imagine where we want to go than how to get there. Proponents of data sharing are often viewed as naïve scientific idealists, yet it seems an efficient and elegant solution to the many ongoing struggles to maintain the scientific infrastructure and the public’s trust in federally funded research. Every case of scientific fraud, particularly on such controversial issues such as the biological source of morality (which is part of Hauser’s research) or the sources of racial prejudice (in the case of Stapel) allows those suspicious of science and governments’ commitment to funding science to build a case in the public arena. Advances in technology have allowed the scientific community the opportunity to share data in a broad and scientifically valid manner, and in a way that would effectively counter those critics.
NIH and NSF have led the way toward more open access to scientific data. It is now imperative that other grant funding agencies and scientific journals redouble their own efforts to force data, the raw materials of science, into the light of day well before problems arise.
Felicia B. LeClere is a principal research scientist in the Public Health Department of NORC at the University of Chicago, where she works as research coordinator on multiple projects, including the National Immunization Survey and the National Children's Study.
For decades, debates about gender and science have often assumed that women are more likely than men to “leak” from the science and engineering pipeline after entering college.
However, new research of which I am the coauthor shows this pervasive leaky pipeline metaphor is wrong for nearly all postsecondary pathways in science and engineering. It also devalues students who want to use their technical training to make important societal contributions elsewhere.
How could the metaphor be so wrong? Wouldn’t factors such as cultural beliefs and gender bias cause women to leave science at higher rates?
My research, published last month in Frontiers in Psychology, shows this metaphor was at least partially accurate in the past. The bachelor’s-to-Ph.D. pipeline in science and engineering leaked more women than men among college graduates in the 1970's and 80's, but not recently.
Men still outnumber women among Ph.D. earners in fields like physical science and engineering. However, this representation gap stems from college major choices, not persistence after college.
Other research finds remaining persistence gaps after the Ph.D. in life science, but surprisingly not in physical science or engineering -- fields in which women are more underrepresented. Persistence gaps in college are also exaggerated.
Consequently, this commonly used metaphor is now fatally flawed. As blogger Biochembelle discussed, it can also unfairly burden women with guilt about following paths they want. “It’s almost as if we want women to feel guilty about leaving the academic track,” she said.
Some depictions of the metaphor even show individuals funneling into a drain, never to make important contributions elsewhere.
In reality, many students who leave the traditional boundaries of science and engineering use their technical training creatively in other fields such as health, journalism and politics.
As one recent commentary noted, Margaret Thatcher and Angela Merkel were leaks in the science pipeline. I dare someone to claim that they funneled into a drain because they didn’t become tenured science professors. No takers? Didn’t think so.
Men also frequently leak from the traditional boundaries of science and engineering, as my research and other studies show. So why do we unfairly stigmatize women who make such transitions?
By some accounts, I’m a leak myself. I earned my bachelor’s degree in the “hard” science of physics before moving into psychology. Even though I’m male, I still encountered stigma when peers told me psychology was a “soft” science or not even science at all. I can only imagine the stigma that women might face when making similar transitions.
For this fellowship, I worked with two computer science graduate students and one bioengineering postdoc on a “big data” project for improving student success in high school. We partnered with Montgomery Public County Schools in Maryland to improve their early warning system. This system used warning signs such as declining grades to identify students who could benefit from additional supports.
This example shows why the leaky pipeline narrative is so absurd. Many leaks in the pipeline continue using their technical skills in important ways. For instance, my team’s data science skills helped improve our partner’s warning system, doubling performance in some cases.
Let’s abandon this inaccurate and pejorative metaphor. It unfairly stigmatizes women and perpetuates outdated assumptions.
Some have argued that my research indicates bad news because the gender gaps in persistence were closed by declines for men, not increases for women. However, others have noted how the findings could also be good news, given concerns about Ph.D. overproduction.
More importantly, this discussion of good news and bad news misses the point: the new data inform a new way forward.
By abandoning exclusive focus on the leaky pipeline metaphor, we can focus more effort on encouraging diverse students to join these fields in the first place. Helping lead the way forward, my alma mater -- Harvey Mudd College -- has had impressive success in encouraging women to pursue computer science.
Maria Klawe, Mudd’s first female president, led extensive efforts to make the introductory computer science courses more inviting to diverse students. For instance, course revisions emphasized how computational approaches can help solve pressing societal problems.
The results were impressive. Although women used to earn only 10 percent of Mudd’s computer science degrees, this number quadrupled over the years after Klawe became president. To help replicate these results more widely, we should abandon outdated assumptions and instead help students take diverse paths into science.
David Miller is an advanced doctoral student in psychology at Northwestern University. His current research aims to understand why some students move into and out of science and engineering fields.
His reputation will never recover from that unfortunate business in Salem, but Cotton Mather deserves some recognition for his place in American medical history. He was the anti-vaccination movement’s first target.
The scene was Boston in 1721. Beginning in April, a smallpox epidemic spread from a ship anchored in the harbor; over the course of a year, it killed more than 840 people. (Here I’m drawing on Kenneth Silverman’s excellent The Life and Times of Cotton Mather, winner of the Pulitzer Prize for biography in 1985.) In the course of his pastoral duties, Mather preached the necessary funeral sermons, but he was also a corresponding member of the Royal Society of London for Improving Natural Knowledge. The Puritan cleric had been keenly interested in medical issues for many years before the epidemic hit. He knew of a treatment, discussed in the Society’s journal, in which a little of the juice from an infected person’s pustule was scratched into the skin of someone healthy. It warded off the disease itself, somehow. The patient might fall ill for a short while, but would be spared the more virulent sort of infection.
Two months into the epidemic, Mather prepared a memorandum on the technique to circulate among area doctors, one of whom decided to go ahead with a trial run on three human guinea pigs. All survived the experiment, and in a remarkable show of confidence Mather had his son Samuel inoculated. (Mather himself had contracted smallpox in 1678, so was already immune.)
News of the procedure and its success became public just as the epidemic was going from worrying to critical, but not many Bostonians found the developments encouraging. The whole idea seemed absurd and dangerous. One newspaper mocked the few supporters of inoculation for giving in to something “like the Infatuation Thirty Years ago, after several had fallen Victims to the mistaken notions of Dr. M____r and other clerics concerning Witchcraft.”
Still more unkind was the person or persons responsible for trying to bomb Mather’s house. It failed to go off, but the accompanying note made the motive clear: “You dog, damn you, I’ll inoculate you with this….”
The colonial era falls outside the purview of Vaccine Nation: America’s Changing Relationship with Vaccination (University of Chicago Press) by Elena Conis, an assistant professor of history at Emory University, who focuses mainly on the 20th century, especially its last four decades. The scene changed drastically since Mather's day. Knowledge lagged behind technique: pioneering though early vaccination advocates were, they had no sound basis for understanding how inoculation worked. And the “natural philosophy” of Mather’s era was nowhere near as institutionalized or authoritative as its successor, the sciences, grew in the 19th century.
By the point at which Vaccine Nation picks up the story -- with John F. Kennedy announcing what would become the Vaccination Assistance Act of 1962 – both the nation-state and the field of biomedical research were enormous and powerful, and linked up in ways that Conis charts in detail. “If the stories herein reveal just one thing,” she writes, “it is that we have never vaccinated for strictly medical reasons. Vaccination was, and is, thoroughly infused with our politics, our social values, and our cultural norms.”
Be that as it may, the strictly medical reasons were compelling enough. The Act of 1962 was a push to make the Salk vaccine -- which between 1955 and 1961 had reduced the number of new polio cases from 30,000 to under 900 – available to all children. This seems like progress of a straightforward and verifiable sort, with the legislation being simply the next step toward eradicating the disease entirely. (As, indeed, it effectively did.)
But in Conis’s account, the fact that JFK announced his support for a vaccination program on the anniversary of Franklin Delano Roosevelt’s death was more than a savvy bit of framing. The reference to FDR, “the nation’s most famous polio victim and survivor,” also “invoked the kind of bold, progressive Democrat [JFK] intended to be.” It positioned his administration as sharing something with “the nation’s impressive biomedical enterprise and its recent victory against a disease that had gripped Americans with fear in the 1940s and 1950s.”
It was technocratic liberalism at its most confident -- a peak moment for the belief that scientific expertise might be combined with far-sighted government to generate change for the common good. And it’s all pretty much downhill from there: Vaccine Nation is, in large part, the story of an unraveling idea of progress. True, scientists developed new vaccines against measles, diphtheria, rubella, and other diseases. But at the same time, the role of federal power in generating “public awareness and acknowledgement of a set of health threats worth avoiding” came into question. So did public trust in the authority of medical science and practice.
The erosion was, in either case, a drawn-out process. A couple of instances from Conis’s narrative will have to suffice as examples. One was the campaign against mumps. The military lost billions of man-hours to the highly contagious disease in the course of the two world wars. But a vaccine against mumps developed in the 1940s was left on the shelf when peace came. Mumps went back to being treated as a childhood ailment, rather than a disease with an associated cost.
But the postwar baby boom created a new market of parents susceptible to warnings about the possible (if very rare) long-term side-effects of getting mumps in childhood. Messages about the responsibility to immunize the kids were targeted at mothers in particular, stressing that the possible danger from contracting mumps made prevention more urgent than statistics could ever measure.
The logic of that appeal – “Why risk a danger that you can actively avoid?" – applied in principle to any disease for which a vaccine could be manufactured, and by the 1970s, early childhood meant having a cocktail of them shot into the arm on a regular basis. Then came the great swine flu scare of ’76. The government warned of an impending crisis, stockpiled a vaccine for it, and began immunizing people – especially the elderly, who faced the greatest risk.
The epidemic never hit, but the vaccine itself proved fatal to a number of people and may have been the cause of serious medical problems for many more. All of this occurred during the last months of Gerald Ford’s administration, though it has somehow become associated with the Carter years. There is no historical basis for the link, but it has the ring of truthiness. The whole debacle seemed to refute JFK’s vision of science and the state leading the march to a safer and healthier future.
The largely unquestioned confidence in vaccination was perhaps a victim of its own success. Insofar as nearly everyone was immunized against several diseases, any number of people suffering from a medical problem could well believe that the shots had somehow caused it or made them susceptible. And in some cases there were grounds for the suspicion. There were also cases of inoculation inducing the disease it was supposed to prevent, as well as allergic reactions to substances in the vaccine.
But Colis sees the rise of an anti-vaccination mood less as direct response to specific problems than as a byproduct of countercultural movements. Feminists challenged the medical profession’s unilateral claim of authority, and some women took the injunction to protect children by immunizing them and turned it on its head. If they were responsible for avoiding the risk, however slight, of preventable childhood illnesses, then they were equally responsible for avoiding the dangers, however unlikely, posed by vaccines.
Another strain of anti-vaccinationist thinking was an offshoot of environmental awareness. While industrial society polluted the air and water, heedless of the effects, medicine was pumping chemicals and biological agents into the smaller ecosystem of the human body.
Similar concerns had been expressed by opponents of vaccination in the late 19th and early 20th centuries -- though without much long-term effect, particularly given the effectiveness of immunization in preventing (even obliterating) once-terrifying diseases. Conis depicts anti-vaccinationists of more recent times as more effective and better-established.
Besides the feminist and ecological critiques, there is the confluence of anti-government politics and new media. Supporters of vaccination once downplayed the issue of side effects, but it’s an area that demands – and is receiving – serious medical investigation.
In places, Vaccine Nation suggests that the critics and opponents have made points worthy of debate, or at least raised serious concerns. And that may be true. It would almost have to be, the real question being one of degree.
But even with that conceded, many of the arguments the author cites are … well, to be nice about it, unpersuasive. “DISEASE IS NOT SOMETHING TO BE CURED,” says one vintage anti-vaccinationist tract revived in the 1980s. “IT IS A CURE.” The cause for illness? “Excess poisons, waste matters, and incompatible food” – but not, most emphatically, germs.
“Did you know,” asks another figure Conis quotes, “that when immunity to disease is acquired naturally, the possibility of reinfection is only 3.2 percent? If the immunity comes from a vaccination, the chance of reinfection is 80 percent.” In a footnote, Conis indicates that the source of these fascinating statistics “is unclear.” That much, I bet, is true.
Poor old Cotton Mather’s thinking combined superstition and enlightened reason. They can and do mix. But not in a statement such as “DISEASE IS NOT SOMETHING TO BE CURED. IT IS A CURE." The good reverend would dismiss that as little more than ignorance and magical thinking -- and rightly so.
“The Top 10 Retractions of 2014” appeared on the website of the life-sciences magazine The Scientist a couple of weeks back, garnering a little attention (mostly of the social-media, “Hey, look at this!” variety) but without making much of an impact. Comments were few and far between.
That seems unfortunate, given the stakes. Physicians, it has been said, bury their mistakes -- a grim joke that very nearly applies to some of the researchers whose work made the Hall of Shame. But most of the inductees are charged with committing malfeasance rather than error. (A number of them were covered here at Inside Higher Ed over the past year.)
The most egregious case? That would have to be the paper that the journal Retrovirology retracted, by a researcher who "spiked rabbit blood samples with human blood to make it look as though his HIV vaccine was working.” The runner-up is probably the situation that forced the Journal of Vibration and Control to retract 60 articles, which had been accepted for publication after receiving fraudulent “peer review” by scientists who manipulated the online submission system using up to 130 fake email accounts.
The good news is that the paper reporting on HIV vaccine work that had been tampered with seems not to have made much of an impression: it hadn’t been cited by other researchers. As for the phony peer-review gang, its leader was the identical twin brother of Taiwan’s minister of education, whose name appeared as a coauthor of some of the papers. Not long after the scandal broke, the minister resigned, while insisting that he had no idea of what his evil twin had been up to. (And you thought your family gatherings were awkward,)
The annual list (first compiled in 2013) is the work of the good people at Retraction Watch, who monitor and investigate the embarrassed announcements that publishers would rather not have to issue. Most of the stories they cover are from the sciences (chiefly natural, some social) although there is the occasional case from the humanities, where the main ground for retraction seems to be plagiarism. Or rather, problems of involving "mistaken punctuation" and "misreferencing," since euphemism prevails. (One author charged with plagiarism admitted to "misconduct in text," which is my new favorite expression.)
Besides fraudulent labwork and efforts to game the peer-review system, RW covers breaches of ethical norms in research -- the notorious "Facebook mood experiment" made the list for 2014 -- while also keeping an eye on predators lurking in the shadows around scholarly publishing. While unscrupulous academic publishers deserve all the bad press they get, they are often so brazen that it's hard to think of them as a menace. Consider the most widely noticed example in recent months: the story of a couple of computer scientists who wrote a "paper" consisting of an obscene seven-word sentence, repeated a few hundred times and incorporated into graphs and flowcharts. They submitted it to one of the sketchier journals in their field, where it appeared once the authors paid a fee. After all, the anonymous reviewer considered the paper "excellent.”
Which, in its own way, it was, though the paper is not on the top 10 list. Using the carelessness and greed of worthless journals to embarrass them may be an entertaining way to blow a few hundred bucks, but much less amusing is the thought that there must be academic libraries paying for subscriptions to said journals.
One of the year's top 10 items involved a French computer scientist who, the Retraction Watch says, “catalogued computer-generated papers that made it into more than 30 published conference proceedings between 2008 and 2013. Sixteen appeared in publications by Springer, and more than 100 were published by the Institute of Electrical and Electronic Engineers (IEEE).” The fact that the papers were computer-generated does not mean they were gibberish, since there are programs that can perform a database search and "write" a credible literature review. Still, that seems like streamlining the production of knowledge just a little too far.
The Retraction Watch site is littered with the wreckage of numerous careers, but it serves an important purpose apart from the dubious pleasures of Schadenfreude. In a recent column I wrote about Ben Goldacre's book I Think You'll Find It's a Bit More Complicated Than That (Fourth Estate), which includes a shrewd assessment of the strengths and weaknesses of the peer-review system that seems germane:
"[Peer-review] is often represented as some kind of policing system for truth, but in reality some dreadful nonsense gets published, and mercifully so: shaky material of some small value can be published into the buyer-beware professional literature of academic science; then the academic readers, who are trained to appraise critically a scientific case, can make their own judgments. And it is this second stage of review by your peers -- after publication -- that is so important in science. If there are flaws in your case, responses can be written, as letters to the academic journal, or even whole new papers. If there is merit in your work, then new ideas and research will be triggered. That is the real process of science."