Freedom of Information requests to the Climatic Research Unit

Last updated

Freedom of Information requests to the Climatic Research Unit featured in press discussions of disputes over access to data from instrumental temperature records, particularly during the Climatic Research Unit email controversy which began in November 2009.

Contents

The UK Freedom of Information Act (FOIA) came into effect in 2005, and FOI requests were made to the Climatic Research Unit (CRU) at the University of East Anglia (UEA) for the raw data from weather stations used in developing instrumental temperature record datasets, for copies of agreements under which the raw data was obtained from meteorology institutions, and also for email correspondence relating to the Intergovernmental Panel on Climate Change Fourth Assessment Report.

In many cases the raw data which CRU had obtained from National Meteorological Organisations was subject to restrictions on redistribution: on 12 August 2009 CRU announced that they were seeking permission to waive these restrictions, and on 24 November 2009 the university stated that over 95% of the CRU climate data set had already been available for several years, with the remainder to be released when permissions were obtained. In a decision announced on 27 July 2011 the Information Commissioner's Office (ICO) required release of raw data even though permissions had not been obtained or in one instance had been refused, and on 27 July 2011 CRU announced release of the raw instrumental data not already in the public domain, with the exception of Poland which was outside the area covered by the FOIA request.

A 2008 FOI request by David Holland for emails discussing work on the IPCC Fourth Assessment Report was refused by the university. In November 2009 he alleged that CRU emails posted online discussed deleting the emails he had requested: in January 2010 the Deputy Information Commissioner told a journalist that this indicated an offence under section 77 of the FOIA, but prosecution was time-barred by statute of limitations. Newspapers misrepresented this as a decision in relation to raw data, and the issue was discussed by the House of Commons Science and Technology Select Committee inquiry, which found there had been a lack of openness. The ICO decision published on 7 July 2010 stated that this potential offence had not been investigated as it was time-barred. As Holland was content not to proceed with his complaint against the university, no further action was needed, but the ICO would "consider whether further action is appropriate to secure future compliance."

In September 2011 the ICO issued new guidance to universities. This described exceptions and exemptions to protect research, including allowance for internal exchange of views between academics and researchers free from external scrutiny, as well as commending actively disclosing information when it is in the public interest.

FOIA requests for raw climate data

From 1978 onwards, the Climatic Research Unit developed its gridded CRUTEM data set of land air temperature anomalies back to 1850, based on instrumental temperature records held by National Meteorological Organisations around the world, often under formal or informal confidentiality agreements that restricted use of this raw data to academic purposes. Beginning in 1991, Phil Jones of CRU discussed data with Warwick Hughes (later of the New Zealand Climate Science Coalition). From 2002 onwards, Jones received requests from Stephen McIntyre for instrumental raw data (McIntyre became prominent in contrarian disputes over the methodology of paleoclimate hockey stick graphs shown in the IPCC Third Assessment Report of 2001). Jones says that at first he tried to meet McIntyre's requests, but he soon became inundated with requests that he could not fulfill due to time or confidentiality constraints, and began refusing requests. [1]

The new UK Freedom of Information Act came into effect in 2005, and in February of that year Jones discussed with fellow climate researchers the potential implications of the Act for McIntyre's requests. In 2007 he told colleagues that, having seen what McIntyre's Climate Audit blog was doing, UEA had been turning down FOIA requests associated with the blog. The scientists concerned saw such requests as disrupting the time available for their work, and those making them as nitpicking to suit an agenda rather than trying to advance scientific knowledge. Late in 2008, the university's FOI managers took advice from the Information Commissioner's Office (ICO) on exceptions allowing refusal of requests. [1]

McIntyre complained that data denied to him had been sent to Peter Webster at the Georgia Institute of Technology, who was working on a joint publication with Jones, and between 24 and 29 July 2009 the university received 58 FOI requests for raw data or details of the confidentiality agreements from McIntyre and his readers at the Climate Audit blog. [1] On 24 July Jonathan A. Jones of the University of Oxford made a FOIA request for the data that Jones had sent to Webster, the UEA refused this request on 14 August. Don Keiller of Anglia Ruskin University in Cambridge then made a similar FOIA request, UEA refused this on 11 September 2009. [2] [3]

On 12 August 2009, Nature News published a statement by Phil Jones that he was working to release the raw data in a systematic way, and was writing to all the National Meteorological Organisations requesting their agreement to waive confidentiality. [1] In mid October CRU issued a statement on data availability, describing how National Metereological Services (NMSs) and scientists had given or sold them data with written or verbal agreements that it must only be used for academic purposes, and not passed onto third parties. There were difficulties in separating out raw data, some of which was subject to charges made by NMSs, and "These data are not ours to provide without the full permission of the relevant NMSs, organizations and scientists." They hoped to obtain consents and to publish all the data jointly with the Met Office. [4]

On 24 November 2009, four days after the start of the Climatic Research Unit email controversy, the university stated that over 95% of the CRU climate data set had already been available for several years, and the remainder would be released when permissions were given. [5] The university worked closely with the Met Office, which sent requests to National Meteorological Organisations for agreement to waive confidentiality on raw instrumental data, [6] as CRU had announced on 12 August 2009. [1] Some gave full or conditional agreement, others failed to respond, and the request was explicitly refused by Trinidad and Tobago and Poland. [3]

In discussions with the ICO about the FOIA requests which Jonathan Jones and Don Keiller had made before the email controversy had begun, the university argued that the data was publicly available from the Met organisations, and the lack of agreement exempted the remaining data. In its decision released on 23 June 2011, the ICO stated that the data was not easily available and there was insufficient evidence that disclosure would have an adverse effect on international relations. The ICO required the university to release the data covered by the FOIA request within 35 calendar days. [3] On 27 July 2011 CRU announced release of the raw instrumental data not already in the public domain, with the exception of Poland which was outside the area covered by the FOIA request. The data are available for download from Met Office website and from CRU. The university remained concerned "that the forced release of material from a source which has explicitly refused to give permission for release could have some damaging consequences for the UK in international research collaborations." [2] [6]

FOIA requests for emails discussing IPCC Fourth Assessment Report

In May 2008 David Holland, an electrical engineer from Northampton, made a FOI request for all emails to and from Keith Briffa about the IPCC Fourth Assessment Report (AR4); formal review exchanges had already been published. The University of East Anglia (UEA) information policy and compliance manager (IPCM) refused the request.

Holland appealed to the Information Commissioner's Office (ICO) about the UEA's refusals of FOI requests he had made for emails to and from Briffa about the IPCC AR4 report. On 23 November 2009, after the start of the Climatic Research Unit email controversy, he wrote to the Commissioner explaining in detail the relevance of the alleged CRU emails to his case. [7] In one of these sent in May 2008, Jones asked others to delete emails discussing AR4 with Briffa. [8] ICO decisions are enforced under Section 50 by notices defining steps to be taken by the public authority within defined time limits, and failure to comply can be taken to court. In addition, Section 77 makes it an offence to intentionally destroy or conceal information which has been requested. [9] In response to a Sunday Times journalist who persistently asked why the ICO was not prosecuting under Section 77, [10] Deputy Information Commissioner Graham Smith replied on 22 January 2010 that "The FOI Act makes it an offence for public authorities to act so as to prevent intentionally the disclosure of requested information. Mr Holland's FOI requests were submitted in 2007/8, but it has only recently come to light that they were not dealt with in accordance with the Act. The legislation requires action within six months of the offence taking place, so by the time the action came to light the opportunity to consider a prosecution was long gone." The ICO was looking into other investigations time-barred by statute of limitations restrictions to see if a case could be made to change the relevant law. [11] The journalist's report as published in The Times on 28 January portrayed this as an ICO decision that the university "broke the law by refusing to hand over its raw data for public scrutiny" but the ICO "could not prosecute those involved because the complaint was made too late." [12] The university promptly wrote to the ICO objecting to the damaging statement having been made to a journalist without first consulting the university. It described the misrepresentation by the press and requested retraction or clarification of the alleged breaches. The ICO declined to retract, but clarified that its investigation under Section 50 had not been completed and no decision notice had been issued. It said that "The fact that the elements of a section 77 offence may have been found here, but cannot be acted on because of the elapsed time, is a very serious matter. The ICO is not resiling from its position on this", and that "Errors like this are frequently made in press reports and the ICO cannot be expected to correct them, particularly when the ICO has not itself referred to penalties or sanctions in its own statement." [11] [13]

In its submission to the Science and Technology Select Committee, the university denied allegations that it had refused to release raw data in breach of the FOI Act, [7] and said that the Deputy Information Commissioner's comments had been incorrectly reported as referring to such data. [14] In its inquiry report, the Science and Technology Select Committee criticised the ICO, which it said had made "a statement to the press that went beyond that which it could substantiate", and recommended that it should develop procedures to check its public comments, and "swiftly correct any mis-statements or misinterpretations of such statements". While there was prima facie evidence of a breach of Section 77 of the FOI Act, it would "be premature, without a thorough investigation affording each party the opportunity to make representations, to conclude that UEA was in breach of the Act." It called for a full investigation by the Muir Russell inquiry or by the Information Commissioner to resolve this issue, and accepted that the six month statute of limitations restriction was insufficient and should be reviewed. On the general issue of information requests, the committee said that information not covered by the exclusions provided by the FOIA should have been disclosed, and "in future information, including data and methodology, should be published proactively on the internet wherever possible." It blamed the university for mishandling Freedom of Information requests, and said it had “found ways to support the culture at CRU of resisting disclosure of information to climate change sceptics”. [11] [15] [16]

The ICO decision on Holland's requests published on 7 July 2010 concluded that the Environmental Information Regulations (EIR) applied rather than the equivalent FOIA, and the university had failed to provide responses within the correct time, but as Holland was content not to proceed with his complaint, no further action was needed. Regarding the question of whether there had been a breach of section 77 of the FOIA or its equivalent in the EIR, the ICO stated "Although the emails referred to above indicated prime facie evidence of an offence, the Commissioner was unable to investigate because six months had passed since the potential offence was committed, a constraint placed on the legislation by the Magistrates Court Act 1980." On the more general issue of emails suggesting that attempts to circumvent the legislation had been considered, and a lack of openness, the ICO would "now consider whether further action is appropriate to secure future compliance." [8] In an opinion piece, Edward Acton, Vice-Chancellor of the UEA, commended legislation in the US where "the FOI distinguishes between recorded factual material necessary to validate research findings, which must be disclosed, and ‘preliminary analyses, drafts of scientific papers, plans for future research, peer reviews [and] communications with colleagues’, which are exempted." [17]

New freedom of information guidance to universities

In September 2011 the ICO issued new guidance to universities, taking into account issues raised in relation to the CRU information requests. This describes exceptions and exemptions to protect research, including allowance for internal exchange of views between academics and researchers, leaving formulation of opinions on research free from external scrutiny. It notes the benefits of actively disclosing information when it is in the public interest [18]

Related Research Articles

University of East Anglia Public research university in Norwich, England

The University of East Anglia (UEA) is a public research university in Norwich, England. Established in 1963 on a 320-acre (130-hectare) campus west of the city centre, the university has four faculties and 26 schools of study. The annual income of the institution for 2016–17 was £273.7 million, of which £35.6 million was from research grants and contracts, with an expenditure of £262.6 million and has an acceptance rate of around 20%

Freedom of Information Act (United States) US statute regarding access to information held by the US government

The Freedom of Information Act (FOIA), 5 U.S.C. § 552, is a federal freedom of information law that requires the full or partial disclosure of previously unreleased information and documents controlled by the United States government upon request. The act defines agency records subject to disclosure, outlines mandatory disclosure procedures, and defines nine exemptions to the statute. The act was intended to make U.S. government agencies' functions more transparent so that the American public could more easily identify problems in government functioning and put pressure on Congress, agency officials, and the president to address them.

Data Protection Act 1998 United Kingdom legislation

The Data Protection Act 1998 was a United Kingdom Act of Parliament designed to protect personal data stored on computers or in an organised paper filing system. It enacted the EU Data Protection Directive 1995's provisions on the protection, processing and movement of data.

Climatic Research Unit

The Climatic Research Unit (CRU) is a component of the University of East Anglia and is one of the leading institutions concerned with the study of natural and anthropogenic climate change.

Steven McIntyre is a Canadian mining exploration company director, a former minerals prospector and semi-retired mining consultant whose work has included statistical analysis. He is best known as the founder and editor of Climate Audit, a blog devoted to the analysis and discussion of climate data. He is most prominent as a critic of the temperature record of the past 1000 years and the data quality of NASA's Goddard Institute for Space Studies. He is known in particular for his statistical critique, with economist Ross McKitrick, of the hockey stick graph which shows that the increase in late 20th century global temperatures is unprecedented in the past 1,000 years.

Hans von Storch

Hans von Storch is a German climate scientist. He is a Professor at the Meteorological Institute of the University of Hamburg, and Director of the Institute for Coastal Research at the Helmholtz Research Centre in Geesthacht, Germany. He is a member of the advisory boards of the journals Journal of Climate and Annals of Geophysics.

Sir Alastair Muir Russell is a Scottish retired civil servant and former Principal and Vice-Chancellor of the University of Glasgow, and Chairman of the Judicial Appointments Board for Scotland.

Climate Audit is a blog founded in 2005 by Steve McIntyre.

Jonathan A. Jones British physicist

Jonathan A. Jones is a professor in atomic and laser physics at the University of Oxford, and a fellow and tutor in physics at Brasenose College, Oxford.

Philip Douglas Jones is a former director of the Climatic Research Unit (CRU) and a Professor in the School of Environmental Sciences at the University of East Anglia (UEA) from 1998, having begun his career at the unit in 1976. He retired from these positions at the end of 2016, and was replaced as CRU director by Tim Osborn. Jones then took up a position as a Professorial Fellow at the UEA from January 2017.

Hockey stick graph Graph showing a large spike in recent centuries temperatures resembling a hockey stick to demonstrate anthropogenic climate change

Hockey stick graphs present the global or hemispherical mean temperature record of the past 500 to 2000 years as shown by quantitative climate reconstructions based on climate proxy records. These reconstructions have consistently shown a slow long term cooling trend changing into relatively rapid warming in the 20th century, with the instrumental temperature record by 2000 exceeding earlier temperatures.

The Climatic Research Unit email controversy began in November 2009 with the hacking of a server at the Climatic Research Unit (CRU) at the University of East Anglia (UEA) by an external attacker, copying thousands of emails and computer files to various internet locations several weeks before the Copenhagen Summit on climate change.

Global Warming Policy Foundation

The Global Warming Policy Foundation (GWPF) is a lobby group in the United Kingdom whose stated aims are to challenge "extremely damaging and harmful policies" envisaged by governments to mitigate anthropogenic global warming. The GWPF as well as some of its prominent members have been characterized as promoting climate change denial.

HadCRUT is the dataset of monthly instrumental temperature records formed by combining the sea surface temperature records compiled by the Hadley Centre of the UK Met Office and the land surface air temperature records compiled by the Climatic Research Unit (CRU) of the University of East Anglia.

The Soon and Baliunas controversy involved the publication in 2003 of a review study written by aerospace engineer Willie Soon and astronomer Sallie Baliunas in the journal Climate Research, which was quickly taken up by the G.W. Bush administration as a basis for amending the first Environmental Protection Agency Report on the Environment.

Climatic Research Unit documents

Climatic Research Unit documents including thousands of e-mails and other computer files were stolen from a server at the Climatic Research Unit of the University of East Anglia in a hacking incident in November 2009. The documents were redistributed first through several blogs of global warming deniers, who alleged that the documents indicated misconduct by leading climate scientists. A series of investigations rejected these allegations, while concluding that CRU scientists should have been more open with distributing data and methods on request. Precisely six committees investigated the allegations and published reports, finding no evidence of fraud or scientific misconduct. The scientific consensus that global warming is occurring as a result of human activity remained unchanged by the end of the investigations.

Andrew William Montford is a British writer and editor who is the owner of the Bishop Hill blog. He is the author of The Hockey Stick Illusion (2010).

<i>The Hockey Stick Illusion</i>

The Hockey Stick Illusion: Climategate and the Corruption of Science is a book written by Andrew Montford and published by Stacey International in 2010, which promotes climate change denial.

Michael Hulme is Professor of Human Geography in the Department of Geography at the University of Cambridge. He was formerly professor of Climate and Culture at King's College London (2013-2017) and of Climate Change in the School of Environmental Sciences at the University of East Anglia (UEA).

Joseph D'Aleo is a certified consultant meteorologist and was the first Director of Meteorology at The Weather Channel. He was chairman of the American Meteorological Society's Committee on Weather Analysis and Forecasting. He was the founder of the "Icecap" blog. He has been a contributing meteorologist to the Old Farmer's Almanac, in which he predicted in 2008 that the earth had entered a period of global cooling. D'Aleo is currently a meteorologist at Weatherbell Analytics.

References

  1. 1 2 3 4 5 Heffernan, O. (2009). "Climate data spat intensifies". Nature. 460 (7257): 787–787. doi: 10.1038/460787a . PMID   19675615.
    Heffernan, Olive (12 August 2009). "McIntyre versus Jones: climate data row escalates". Climate Feedback. Nature Climate Change . Retrieved 2 August 2011.
    * Pearce, Fred (2010), The Climate Files: The Battle for the Truth About Global Warming, Random House UK, pp. 143–156, ISBN   0-85265-229-1
  2. 1 2 Black, Richard (27 July 2011). "Climate unit releases virtually all remaining data". BBC News. Retrieved 2 August 2011.
  3. 1 2 3 letter to Jonathan Jones, and "Freedom of Information Act 2000 (Section 50) Environmental Information Regulations 2004 Decision Notice". FER0282488. ICO. 23 June 2011. Archived from the original (PDF) on 3 July 2011. Retrieved 15 August 2011. FOI request made 24 July 2009, refused by UEA 14 August 2009.
    "Freedom of Information Act 2000 (Section 50) Environmental Information Regulations 2004 Decision Notice". FER0280033. ICO. 23 June 2011. Archived from the original (PDF) on 29 August 2011. Retrieved 15 August 2011. FOI request made 14 August 2009, refused by UEA 11 September 2009.
  4. "CRU Data Availability". Climatic Research Unit. Archived from the original on 2009-10-16. Retrieved 2012-01-24. Data storage availability in the 1980s meant that we were not able to keep the multiple sources for some sites, only the station series after adjustment for homogeneity issues. We, therefore, do not hold the original raw data but only the value-added (i.e. quality controlled and homogenized) data.
  5. "CRU update 2". University of East Anglia (UEA). 24 November 2009. Retrieved 2 August 2011.
  6. 1 2 "Climate data released – University of East Anglia (UEA)". 27 July 2011. Retrieved 4 August 2011.
  7. 1 2 Press Association (25 February 2010). "University of East Anglia rejects lost climate data claims". The Guardian. UK. Retrieved 26 February 2010.
  8. 1 2 "Freedom of Information Act 2000 (Section 50) / Environmental Information Regulations 2004 Decision Notice, Reference: FER0238017" (PDF). Information Commissioner's Office. 7 July 2010. Archived from the original (PDF) on 25 July 2011. Retrieved 27 July 2010.
  9. "Freedom of Information Act 2000, Part IV Enforcement, Section 50". ICO. 30 November 2000. Retrieved 4 August 2011., 52: Enforcement notices,
    Part VIII Miscellaneous and supplemental, Section 77. Offence of altering etc. records with intent to prevent disclosure.
  10. Graham Smith, Deputy Commissioner, ICO (29 January 2010). "letter to Brian Summers, University of East Anglia". University of East Anglia. Retrieved 29 March 2010.CS1 maint: multiple names: authors list (link)
  11. 1 2 3 "The disclosure of climate data from the Climatic Research Unit at the University of East Anglia". House of Commons Science and Technology Committee. Parliament of the United Kingdom. 31 March 2010. pp. 28–31. We regret that the ICO made a statement to the press that went beyond that which it could substantiate and that it took over a month for the ICO properly to put the record straight. We recommend that the ICO develop procedures to ensure that its public comments are checked and that mechanisms exist to swiftly correct any mis-statements or misinterpretations of such statements.
  12. Webster, Ben; Leake, Jonathan (28 January 2010). "Scientists in stolen e-mail scandal hid climate data – Times Online". The Times. UK. Retrieved 4 August 2011.
  13. "Correspondence between University of East Anglia and the Information Commissioner's Office". University of East Anglia. 26 February 2010. Retrieved 29 March 2010.
  14. Kendall, Ben (26 February 2010). "UEA rejects 'Climategate' accusations". edp24.co.uk. Norfolk News . Retrieved 27 July 2010.
  15. Webster, Ben (31 March 2010). "Climate-row professor Phil Jones should return to work, say MPs". The Times. UK. Retrieved 26 July 2010.
  16. Timmer, John (March 2010). "UK Parliament clears climatologists, calls for more openness". Ars Technica. Retrieved 27 July 2010.
  17. Acton, Edward (31 August 2010). "Where next for Freedom of Information?". University of East Anglia (UEA). Retrieved 4 August 2011.
  18. "ICO issues FoI guidance for universities : Guardian Government Computing : Guardian Professional". The Guardian . 26 September 2011. Retrieved 23 December 2011.