Citation And Referencing Quotes

The same group of researchers who studied the articles about COURAGE also analyzed the medical literature to discover just how long it takes the medical community to abandon a practice after a therapy is proven ineffective. They tracked citations to three major practices that were found not to work: beta-carotene to prevent cancer; estrogen to prevent Alzheimer’s disease; and vitamin E to lower cardiovascular risk. They found that 10 years passed before the research community stopped referencing the flawed practice. This estimate of a decade of inertia fits with our own experience. It takes that long for the train of medical practice to stop.

Another recent study, this one on academic research, provides real-world evidence of the way the tools we use to sift information online influence our mental habits and frame our thinking. James Evans, a sociologist at the University of Chicago, assembled an enormous database on 34 million scholarly articles published in academic journals from 1945 through 2005. He analyzed the citations included in the articles to see if patterns of citation, and hence of research, have changed as journals have shifted from being printed on paper to being published online. Considering how much easier it is to search digital text than printed text, the common assumption has been that making journals available on the Net would significantly broaden the scope of scholarly research, leading to a much more diverse set of citations. But that’s not at all what Evans discovered. As more journals moved online, scholars actually cited fewer articles than they had before. And as old issues of printed journals were digitized and uploaded to the Web, scholars cited more recent articles with increasing frequency. A broadening of available information led, as Evans described it, to a “narrowing of science and scholarship.”31 In explaining the counterintuitive findings in a 2008 Science article, Evans noted that automated information-filtering tools, such as search engines, tend to serve as amplifiers of popularity, quickly establishing and then continually reinforcing a consensus about what information is important and what isn’t. The ease of following hyperlinks, moreover, leads online researchers to “bypass many of the marginally related articles that print researchers” would routinely skim as they flipped through the pages of a journal or a book. The quicker that scholars are able to “find prevailing opinion,” wrote Evans, the more likely they are “to follow it, leading to more citations referencing fewer articles.” Though much less efficient than searching the Web, old-fashioned library research probably served to widen scholars’ horizons: “By drawing researchers through unrelated articles, print browsing and perusal may have facilitated broader comparisons and led researchers into the past.”32 The easy way may not always be the best way, but the easy way is the way our computers and search engines encourage us to take.

Let’s say someone writes an academic paper quoting fifty people who have worked on the subject and provided background materials for his study; assume, for the sake of simplicity, that all fifty are of equal merit. Another researcher working on the exact same subject will randomly cite three of those fifty in his bibliography. Merton showed that many academics cite references without having read the original work; rather, they’ll read a paper and draw their own citations from among its sources. So a third researcher reading the second article selects three of the previously referenced authors for his citations. These three authors will receive cumulatively more and more attention as their names become associated more tightly with the subject at hand. The difference between the winning three and the other members of the original cohort is mostly luck: they were initially chosen not for their greater skill, but simply for the way their names appeared in the prior bibliography. Thanks to their reputations, these successful academics will go on writing papers and their work will be easily accepted for publication. Academic success is partly (but significantly) a lottery.fn2

In the References section, I’ve included a website address and a QR code for the full list of the nearly five thousand citations referenced throughout this book.