Published August 2, 2024 | Version v1.0.0

Radiative-transfer dataset for "Distilling machine learning's added value: Pareto fronts in atmospheric applications"

  • 1. ROR icon Colorado State University
  • 2. ROR icon National Oceanic and Atmospheric Administration

Description

This dataset goes with the journal paper "Distilling machine learning's added value: Pareto fronts in atmospheric applications" by T. Beucler, A. Grundner, S. Shamekh, P. Ukkonen, M. Chantry, and R. Lagerquist.

Subdirectory "training" contains unnormalized (in physical units) training data.  Subdirectories "validation" and "testing" contain unnormalized validation and testing data.  Subdirectory "training/for_pareto_paper_2024/simple" contains training data from the simple (clear-sky) dataset discussed in the paper; subdirectory "training/for_pareto_paper_2024/complex" contains training data from the complex (multi-cloud) dataset discussed in the paper.  Subdirectories "validation/for_pareto_paper_2024/simple" and "validation/for_pareto_paper_2024/complex" are analogous but for the validation data; subdirectories "testing/for_pareto_paper_2024/simple" and "testing/for_pareto_paper_2024/complex" are analogous but for the testing data.

Subdirectories beginning with "normalized_predictors" -- "normalized_predictors/training", "normalized_predictors/validation", "normalized_predictors/testing", "normalized_predictors/training/for_pareto_paper_2024/simple", "normalized_predictors/training/for_pareto_paper_2024/complex", etc. -- are analogous to the above but containing normalized predictors (in z-scores rather than physical units).

Every file -- after unzipping, so that the extension is ".nc" rather than ".nc.gz" -- can be read by `example_io.read_file` in the ml4rt library (https://github.com/thunderhoser/ml4rt).

Files

Files (36.4 GB)

Name Size
md5:35710bd3fd96504245c207920ca4b9cd
36.4 GB Download

Additional details

Dates

Submitted
2024-08-02