Workshop: Building reproducible workflows for earth sciences

The Climate Data Dissemination System is the software system developed in the Met Office Hadley Centre to post process simulation output into the format required for submission to the Coupled Model Intercomparison Project phase 6 (CMIP6). The system decouples the production of data and metadata in CMIP standard formats from the running of climates simulations. This provides the flexibility required by participation in a global community-led project, allowing simulation to run before all the specifications of the datasets have been finalised.

I will describe how we have developed a workflow based on standard python tools developed in the Met Office and the climate research community to build a system that enables traceability and reproducibility in the climate data post-processing workflow. I will discuss the advantages and disadvantages of the choices we have made for this system. I will then discuss plans for future climate data projects, including CMIP7.