Global warming consensus claim doesn’t stand up

cartoonNow almost two years old, John Cook’s 97 per cent consensus paper on anthropogenic global warming has been a runaway success. Downloaded more than 300,000 times, voted the best 2013 paper in Environmental Research Letters, frequently cited by peers and politicians from around the world, the paper seems to be the definitive proof that the science of climate change is settled. It isn’t.

Consensus has no place in science. Academics agree on lots of things, but that does not make them true. Even so, agreement climate change is real and human-caused does not tell us anything about how the risks of climate change weigh against the risks of climate policy. But in our age of pseudo-Enlightenment, having 97 per cent of researchers on your side is powerful rhetoric for marginalising political opponents. All politics ends in failure, however. Chances are the opposition will gain power well before the climate problem is solved. Polarisation works in the short run, but is counterproductive in the long run.

Cook and colleagues argue 97 per cent of the relevant academic literature endorses that humans have contributed to observed climate change. This is unremarkable. It follows immediately from the 19th century research by ­Fourier, Tyndall and Arrhenius. In popular discourse, however, Cook’s finding is often misrepresented. The 97 per cent refers to the number of papers, rather than the number of scientists. The alleged consensus is about any human role in climate change, rather than a dominant role, and it is about ­climate change rather than the dangers it might pose.

Although there are large areas of substantive agreement, climate science is far from settled. Witness the dozens of alternative explanations of the 18-year pause in warming of the surface atmosphere. The debate on the seriousness of ­climate change or what to do about it ranges even more widely.

The Cook paper is remarkable for its quality, though. Cook and colleagues studied 12,000 papers, but did not check whether their sample is representative for the scientific literature. It isn’t. Their conclusions are about the papers they happened to look at, rather than about the literature. Attempts to replicate their sample failed: a number of papers that should have been analysed were not, for no apparent reason.

The sample was padded with irrelevant papers. An article about TV coverage on global warming was taken as evidence for global warming. In fact, about three-quarters of the papers counted as endorsements had nothing to say about the subject matter.

Cook enlisted a small group of environmental activists to rate the claims made by the selected papers. Cook claims the ratings were done independently, but the raters freely discussed their work. There are systematic differences between the raters. Reading the same abstracts, the raters reached remarkably different conclusions — and some raters all too often erred in the same direction.

Cook’s hand-picked raters disagreed on what a paper was about 33 per cent of the time. In 63 per cent of cases, they disagreed about the message of a paper with the authors of that paper. The paper’s reviewers did not pick up on these things. The editor even praised the authors for the “excellent data quality” even though neither he nor the referees had had the opportunity to check the data. Then again, that same editor thinks ­climate change is like the rise of Nazi Germany. Two years after publication, Cook admitted that data quality is indeed low.

Requests for the data were met with evasion and foot-dragging, a clear breach of the publisher’s policy on validation and reproduction, yet defended by an editorial board member of the journal as “exemplary scientific conduct”. Cook hoped to hold back some data, but his internet security is on par with his statistical skills, and an alleged hacker was not intimidated by the University of Queensland’s legal threats. Cook’s employer argued that releasing rater identities would violate a confidentiality agreement. That agreement does not exist.

Cook first argued that releasing time stamps would serve no scientific purpose. This is odd. Cook’s raters essentially filled out a giant questionnaire. Survey researchers routinely collect time stamps, and so did Cook. Interviewees sometimes tire and rush through the last questions. Time stamps reveal that. Cook argued time stamps were never collected. They were. They show one of Cook’s raters inspected 675 abstracts within 72 hours, a superhuman ­effort.

The time stamps also reveal something far more serious. After collecting data for eight weeks, there were four weeks of data analysis, followed by three more weeks of data collection. The same people collected and analysed the data. After more analysis, the paper classification scheme was changed and yet more data ­collected.

Cook thus broke a key rule of scientific data collection: observations should never follow from the conclusions. Medical tests are double-blind for good reason.

You cannot change how to ­collect data, and how much, after having seen the results.

Cook’s team may, perhaps unwittingly, have worked towards a given conclusion. And indeed, the observations are different, significantly and materially, between the three phases of data collection. The entire study should therefore be dismissed.

This would have been an amusing how-not-to tale for our students. But Cook’s is one of the most influential papers of recent years. The paper was vigorously defended by the University of Queensland (Cook’s employer) and the editors of Environmental Research Letters, with the Institute of Physics (the publisher) looking on in silence. Incompetence was compounded by cover-up and complacency.

Climate change is one of the defining issues of our times. We have one uncontrolled, poorly observed experiment. We cannot observe the future. Climate change and policy are too complex for a single person to understand. Climate policy is about choosing one future over another. That choice can only be informed by the judgment of experts — and we must have confidence in their learning and trust their intentions.

Climate research lost its aura of impartiality with the unauthorised release of the email archives of the Climate Research Unit of the University of East Anglia. Its reputation of competence was shredded by the climate community’s celebration of the flawed works of Michael Mann. Innocence went with the allegations of sexual harassment by Rajendra Pachauri and Peter Gleick’s fake memo. Cook’s paper shows the climate community still has a long way to go in weeding out bad research and bad behaviour. If you want to believe climate researchers are incompetent, biased and secretive, Cook’s paper is an excellent case in point.

Richard Tol teaches economics at the University of Sussex and the Vrije University Amsterdam.


Trackback from your site.

Leave a comment (newest first):

Comments (5)

  • Avatar



    I don’t know why Cook didn’t go with 99.9% as his consensus figure. It would have been embraced just as enthusiastically by the AGW left and their willing accomplices in the media.

    The really crazy part of a figure like 97% is that even in non-scientific fields where consensus numbers [i]are[/i] potentially valid, true consensus rarely exists above 90% or so due to several statistical and societal factors. this was clearly a contrived figure propagated for media consumption.

    Of course all that aside, Michael Crichton made the most elegant rebuttal to the incompatibility of science and consensus that I have ever heard:

    [i]”I regard consensus science as an extremely pernicious development that ought to be stopped cold in its tracks. Historically, the claim of consensus has been the first refuge of scoundrels; it is a way to avoid debate by claiming that the matter is already settled. Whenever you hear the consensus of scientists agrees on something or other, reach for your wallet, because you’re being had.

    Let’s be clear: the work of science has nothing whatever to do with consensus. Consensus is the business of politics. Science, on the contrary, requires only one investigator who happens to be right, which means that he or she has results that are verifiable by reference to the real world. In science consensus is irrelevant. What is relevant is reproducible results. The greatest scientists in history are great precisely because they broke with the consensus.

    There is no such thing as consensus science. If it’s consensus, it isn’t science. If it’s science, it isn’t consensus. Period.”[/i]


  • Avatar



    The first test of whether someone is practicing actual science is that when a given hypothesis predicts a result, and that result does not occur under the conditions of the test, they discard the hypothesis.

    If that person is either (1) caught falsifying or distorting data or (2) continues to stick to their claims even in the face of a blown experiment there is in fact nothing scientific about their claims.

    What there may be, however, is tyranny, theft, fraud and suppression of those who they dislike.

    Where they should wind up is in prison, not on a stage.

    (Not my words, “borrowed” from Karl Denningers’s website since they seemed appropriate)


    • Avatar



      Not one AGW Model has made a skillful prediction. All of them have failed this test.
      [quote]In general, we look for a new law by the following process: First we guess it; then we compute the consequences of the guess to see what would be implied if this law that we guessed is right; then we compare the result of the computation to nature, with experiment or experience, compare it directly with observation, to see if it works. If it disagrees with experiment, it is wrong. In that simple statement is the key to science. It does not make any difference how beautiful your guess is, it does not make any difference how smart you are, who made the guess, or what his name is — if it disagrees with experiment, it is wrong.[/quote]


      • Avatar



        As an example of the understanding of science that some of those falling for this drivel have I was reading comments elsewhere when a skeptic mentioned one of the gas laws. The response from one of the alarmists arguing with him was “now I know you don’t know what you’re talking about, there are no laws in science.”

        Damn, so Newton’s Laws and the Ideal Gas Laws upon which so many things rely aren’t science according to this genius.

        Seriously, the reason this has the traction is does is the the majority of those supporting it don’t understand science and can’t be bothered to even learn the basics of it.

        For anyone who has been taught the scientific method there can be no question that the junk psuedo science the media and the “climate scientists” spew not only did not follow the scientific method, it ran the other way.


  • Avatar



    Robert ..Couldn’t agree more . Print media of the traditional newspaper variety are flailing around like a dying dinosaur. Scary stories have always sold newspapers and man made up global warming was pure gold when they needed it and they can’t let it go while they think it’s paying some bills .

    When your boat is sinking a lot of things go out the window . In this case balanced reporting and ethics .

    The green movement looks for sectors to bully ..newspapers were easy first targets ….deforestation bad boys and all .


Leave a comment

Loading Disqus Comments ...

No Trackbacks.