A framework for benchmarking of homogenisation algorithm performance on the global scale
- Resource Type
- Authors
- Robert Lund; Lucie A. Vincent; David I. Berry; Steve Easterbrook; Giuseppina Lopardo; Claude N. Williams; Ian T. Jolliffe; Colin M. Gallagher; Thordis L. Thorarinsdottir; Lisa V. Alexander; Enric Aguilar; Peter Thorne; M. J. Menne; Zeke Hausfather; Victor Venema; Renate Auchmann; Rachel Warren; Stefan Brönnimann; Kate M. Willett
- Source
- Geoscientific Instrumentation Methodes and Data Systems
Geoscientific Instrumentation, Methods and Data Systems, Vol 3, Iss 2, Pp 187-200 (2014)
Willett, K.; Williams, C.; Jolliffe, I. T.; Lund, R.; Alexander, L. V.; Brönnimann, Stefan; Vincent, L. A.; Easterbrook, S.; Venema, V. K. C.; Berry, D.; Warren, R. E.; Lopardo, G.; Auchmann, Renate; Aguilar, E.; Menne, M. J.; Gallagher, C.; Hausfather, Z.; Thorarinsdottir, T.; Thorne, P. W. (2014). A framework for benchmarking of homogenisation algorithm performance on the global scale. Geoscientific Instrumentation, Methods and Data Systems, 3(2), pp. 187-200. Copernicus 10.5194/gi-3-187-2014
- Subject
- Value (ethics)
Atmospheric Science
Process (engineering)
Scale (chemistry)
lcsh:QC801-809
Geology
Benchmarking
Oceanography
computer.software_genre
Data science
lcsh:Geophysics. Cosmic physics
Geography
13. Climate action
Homogeneous
Key (cryptography)
Product (category theory)
Data mining
910 Geography & travel
computer
Strengths and weaknesses
- Language
- English
- ISSN
- 2193-0864
The International Surface Temperature Initiative (ISTI) is striving towards substantively improving our ability to robustly understand historical land surface air temperature change at all scales. A key recently completed first step has been collating all available records into a comprehensive open access, traceable and version-controlled databank. The crucial next step is to maximise the value of the collated data through a robust international framework of benchmarking and assessment for product intercomparison and uncertainty estimation. We focus on uncertainties arising from the presence of inhomogeneities in monthly mean land surface temperature data and the varied methodological choices made by various groups in building homogeneous temperature products. The central facet of the benchmarking process is the creation of global-scale synthetic analogues to the real-world database where both the "true" series and inhomogeneities are known (a luxury the real-world data do not afford us). Hence, algorithmic strengths and weaknesses can be meaningfully quantified and conditional inferences made about the real-world climate system. Here we discuss the necessary framework for developing an international homogenisation benchmarking system on the global scale for monthly mean temperatures. The value of this framework is critically dependent upon the number of groups taking part and so we strongly advocate involvement in the benchmarking exercise from as many data analyst groups as possible to make the best use of this substantial effort.