E3SM-Project/e3sm-unified: v1.11.0

In this version

• Many packages have been updated, including:
  • cdo
  • cime_gen_domain 6.1.59
  • chemdyg 1.1.0
  • e3sm_diags 3.0.0
  • e3sm_to_cmip 1.11.3
  • e3sm-tools 3.0.2
  • geometric_features 1.6.1
  • ilamb 2.7.2
  • livvkit 3.1.0
  • mache 1.28.0
  • mosaic 1.1.0
  • mpas-analysis 1.13.0
  • mpas_tools 0.36.0
  • nco 5.3.2
  • pcmdi_metrics 3.8.2
  • squadgen 1.2.2
  • xcdat 0.8.0
  • zppy 3.0.0
  • zppy-interfaces 0.1.1
  • zstash 1.4.4

New and improved

• cime_gen_domain:

  • The gen_domain tool as part of the CIME v6.1.59 tag, now separate from e3sm-tools

• ChemDyg:

  • Updates to be compatible with zppy (v3.0.0)
  • Some minor fixes

• E3SM-Diags:

  • v3.0.0 marks a major milestone after nearly two years of work by the core development team. This release introduces a completely new back-end, replacing CDAT with Xarray and xCDAT. The user-facing API for running E3SM Diagnostics remains backward-compatible between v2 and v3. The modernization improves performance, usability, and maintainability, unit tests coverage and regression testing framework.

  • User-facing Enhancements

    • Add support for most EAMxx variables.
    • Replaced SciPy cwt module with PyWavelets cwt for the added wavelet analysis in QBO set.
    • The viewer is now at the top level of results directory
    • Revamped logger module for additional features and bug fixes.
    • View the full changelog [TBA] for more information.

• e3sm_to_cmip:

  • Bug Fixes to fix table/freq ambiguity for multi-frequency variables; Remove positive from hfsifrazil; Fix masking of 3D MPAS-Ocean variables.
  • Additional refactoring of cmor setup for specific variables (areacella, clisccp, orog, sftlf).
  • Consolidate cmor setup code to simplify implementation.

• e3sm-tools

  • Updates to cube_to_target, interpinic, mksurfdata_map as part of the E3SM v3.0.2 tag

• livvkit:

  • Handles missing performance files more gracefully
  • Improves file diff section header titles

• mosaic:

  • Enables visualization of unstructured MPAS data on the native mesh with matplotlib, through drop in replacements for pcolormesh / pcolor.
  • Visualization of fields at all mesh locations (i.e. Cells, Edges, and Vertices) is supported.
  • Supports map projected figures through cartopy for both planar and spherical meshes.
    • Currently only a subset of map projections are supported for spherical meshes, but we are currently working on expanding support to all cartopy projections.

• MPAS-Analysis:

  • Maps of surface mass and heat fluxes
  • Maps of velocity
  • Maps of numerous new sea-ice fields
  • Major bug fix to the horizontal streamfunction

• NCO:

  • Vertical interpolation works on latest ERA5, MERRA2 formats
  • ncclimo timeseries will output regional statistics (scaled sums or means)
  • ELM restart file gridification allows selecting output landunit/column type, re-orders snow layers
  • ncks --chk_map diagnoses grid resolution
  • ncremap regridder improvements, MPAS-A support

• pcmdi_metrics:

• squadgen:

• xcdat:

  • Improve performance of the Regrid2 API.
  • Significantly improved the performance of temporal group averaging by addressing an Xarray bug discovered during debugging. The bug was subsequently fixed by the Xarray team.
  • Enhanced support for temporal averaging with custom seasons
  • Many bug fixes and documentation updates.
  • View the full changelog for more information.

• zppy:

  • zppy 3.0.0 is a major release; there are non-backwards-compatible ("breaking") changes. It is therefore highly recommended to read the release notes (INSERT LINK HERE), in particular for users of e3sm_to_cmip, tc_analysis, global_time_series, and ilamb functionalities.
  • The e3sm_to_cmip functionality is now accessed via its own task rather than via the ts task with ts_fmt = cmip.
  • The global_time_series task is now implemented with a new package, zppy-interfaces, which is meant for Python scripts that extend external packages for easy use by E3SM users, whereas zppy itself is meant for workflow automation (i.e., calling code written outside zppy).
  • global_time_series has also been extended to work for Land variables and to generate viewers similar to those in e3sm_diags.
  • Parameter inference and validation have been improved and formalized. Users now have the ability to specify if they don't want zppy to infer parameters (for a file path or for the section name of a task dependency).
  • CDAT is no longer a dependency for zppy. xCDAT is now user for handling global_time_series and e3sm_diags.
  • The tc_analysis task underwent a number of improvements to be more robust.

• zppy-interfaces:

  • As noted in the zppy section above, this is a new package meant for Python scripts that extend external packages for easy use by E3SM users. It is currently home to the global_time_series plotting functionality. Future additions include the PCMDI metrics plotting.

• zstash:

  • Important changes were made to the zstash code base to make it more robust:
    • --follow-symlinks will now only create a symlink in the destination directory, not also the source directory.
    • --non-blocking functionality (i.e., tars are created while a Globus transfer is ongoing) now occurs if and only if this option is used, as opposed to always occurring.

What's Changed

• Bump evv version for cime-env by @mkstratos in https://github.com/E3SM-Project/e3sm-unified/pull/120
• Set CIME_MODEL to nonsense to prevent building E3SM by @xylar in https://github.com/E3SM-Project/e3sm-unified/pull/119
• Add LICENSE by @xylar in https://github.com/E3SM-Project/e3sm-unified/pull/122
• Drop unsupported python versions in conda build recipe by @altheaden in https://github.com/E3SM-Project/e3sm-unified/pull/123
• Increment EVV4ESM version to latest release by @mkstratos in https://github.com/E3SM-Project/e3sm-unified/pull/124
• Update to v1.11.0 by @xylar in https://github.com/E3SM-Project/e3sm-unified/pull/125

New Contributors

• @altheaden made their first contribution in https://github.com/E3SM-Project/e3sm-unified/pull/123

Full Changelog: https://github.com/E3SM-Project/e3sm-unified/compare/1.10.0...1.11.0