Early last week, former Obama Administration Undersecretary of Energy for Science, theoretical physicist and director of the Center for Urban Science and Progress Steven Koonin outlined a fantastic bipartisan framework for establishing, once and for all, a climate science consensus. The article is too good for me to attempt to expand on it; so what follows is simply a series of key quotes.
* * * * * * * * * * * *
“Red Team” Methodology
The national-security community pioneered the “Red Team” methodology to test assumptions and analyses, identify risks, and reduce—or at least understand—uncertainties. The process is now considered a best practice in high-consequence situations such as intelligence assessments, spacecraft design and major industrial operations. It is very different and more rigorous than traditional peer review, which is usually confidential and always adjudicated, rather than public and moderated.
Open Adversarial Process
Summaries of scientific assessments meant to inform decision makers, such as the United Nations’ Summary for Policymakers, largely fail to capture this vibrant and developing science. Consensus statements necessarily conceal judgment calls and debates and so feed the “settled,” “hoax” and “don’t know” memes that plague the political dialogue around climate change. We scientists must better portray not only our certainties but also our uncertainties, and even things we may never know. Not doing so is an advisory malpractice that usurps society’s right to make choices fully informed by risk, economics and values. Moving from oracular consensus statements to an open adversarial process would shine much-needed light on the scientific debates.
Red Team Exercise Example
Given the importance of climate projections to policy, it is remarkable that they have not been subject to a Red Team exercise. Here’s how it might work: The focus would be a published scientific report meant to inform policy such as the U.N.’s Summary for Policymakers or the U.S. Government’s National Climate Assessment. A Red Team of scientists would write a critique of that document and a Blue Team would rebut that critique. Further exchanges of documents would ensue to the point of diminishing returns. A commission would coordinate and moderate the process and then hold hearings to highlight points of agreement and disagreement, as well as steps that might resolve the latter. The process would unfold in full public view: the initial report, the exchanged documents and the hearings.
Science Front and Center
A Red/Blue exercise would have many benefits. It would produce a traceable public record that would allow the public and decision makers a better understanding of certainties and uncertainties. It would more firmly establish points of agreement and identify urgent research needs. Most important, it would put science front and center in policy discussions, while publicly demonstrating scientific reasoning and argument. The inherent tension of a professional adversarial process would enhance public interest, offering many opportunities to show laymen how science actually works. (In 2014 I conducted a workshop along these lines for the American Physical Society.)