ACCESS MOPPeR - A Model Output Post-Processor for the ACCESS climate model

ACCESS-MOPPeR processes the raw ACCESS climate model output to produce CMIP style post-processed output using CMOR3. MOPPeR is developed by the Centre of Excellence for Climate Extremes CMS team. ACCESS-MOPPeR is based on the APP4 tool  developed by CSIRO and used to produce ESGF-compliant formats, primarily for publication to CMIP6. Respect to the APP4 tool, the ACCESS-MOPPeR is:

• python3 based;
• uses latest CMOR version;
• has an integrated tool to help generating mapping for new model versions;
• has more customisable options.

Usage

The ACCESS-MOPPeR includes two distinct modules mopper and mopdb.

MOPPER

This is the module used to setup and run the files processing as a PBS job.

• setup - setup the working environment and the PBS job
• run - execute the processing

MOPDB

This module is used to manage the mapping of raw output to CMIP style variables.

• varlist - creates an initial list of variables and attributes based on actual files
• template - uses the above list to egenrate a template of mappings to use in the processing
• intake uses the mappings to create an intake catalogue of the raw model output
• cmor - populates the database cmor varaibles table
• map - populates the database mappings table
• check - checks a variable list against the cmor database table to individuate variables without a definition
• table - creates a CMOR style table based on a variable list
• del   -  selects and removes records based on constraints passed as input

MOPPeR was first developed as an upgrade and to extend the custom mode as much as it is allowed by the CMOR tool. It can be used to produce CMIP6 compliant data but other standards can also be defined.

CMOR uses Controlled Vocabularies as metadata constraints, with CMIP6_CV.json being the main one. This has an effect on how the data is written in the files, variables' names, directory structure, filenames, and global attributes. The APP4 also relied on mapping files to match the raw model output to CMOR defined variables. Mopdb helps the users create their own mapping and handling CMOR tables definitions.

Designed for use on ACCESS model output that has been archived using the ACCESS Archiver tool.

Main changes for this version (1.5.0)

• added MIP-CMOR tables and related mappings
• added and tested capability to produce CMIP6PLus compliant output
• updates to work with CMOR 3.13
• the repository has been moved to paolap/ACCESS-MOPPeR: Post-processor for ACCESS model data using CMOR

Main changes for version 1.2.0

• added calculation for zostoga
• fixed calculation for aeracello, siareas/n, siextentsn
• updated mappings

Main changes for 1.1.1

• included a missing data file

Main changes for version 1.1.0

• improved data range and files handling including tests
• added new AM3 version (still in development mode)
• added calculation for geopotential height from height above sea level
• added documentation for calculations to docs
• reviewed current mapping so pressure levels variables are defined in a consistent way
• improved handling of axes using mopper.db to store expected cmor axes
• mopdb varlist, template and intake don't need anymore the argument 'match'. The tool will try to work out patterns on its own.