Published August 7, 2024 | Version v1
Software Open

Deep learning-based detection of mesoscale convective systems

  • 1. ROR icon University of Maryland, College Park
  • 2. ROR icon National Center for Atmospheric Research
  • 3. ROR icon University of Connecticut

Description

This ongoing research project focuses on using deep learning for feature detection of mesoscale convective systems (MCSs). These script versions were used to detect MCSs and contribute to the following manuscript:

Feng, Z., et al. (in prep). Mesoscale Convective Systems tracking Method Intercomparison (MCSMIP): Application to DYAMOND Global km-scale Simulations. Journal of Geophysical Research: Atmospheres.

Machine learning training uses PNNL provided labels of MCS objects derived from ERA5 (Contact: Zhe Feng, PNNL).

The trained model was subsequently used with DYAMOND model data.

More broadly, this project entails a collaboration between the National Center for Atmospheric Research, the Department of Atmospheric and Oceanic Science at the University of Maryland-College Park, and the Department of Earth Sciences at the University of Connecticut, to detect MCSs across a range of datasets and models.

To detect MCSs, follow the next steps:

  1. Train a U-Net to detect MCSs using preprocessed ERA5 data and DYAMOND_unet_ttr.ipynb.
  2. Apply the trained U-Net to detect MCSs in the DYAMOND model output using DYAMOND_inferenceNB.ipynb.
  3. Assemble the files into an organized file that contains various supplemental variables using DYAMOND_inferenceNB_part2file.ipynb.
  4. Visualize new MCS objects using DYAMOND_inferenceNB_part3viz.ipynb.

Then, to create MCS tracks, follow the next steps:

  1. Split MCS tracks with split_tracks.py if needed for manual parallelization.
  2. Filter MCSs with write_scripts.csh, which calls mcs_filtering.py, based on common MCS criteria outlined by MCSMIP protocols.
  3. Combine filtering into one file with post-process.py.

For more updated versions of these scripts, go to the corresponding GitHub repositories: 

Files

DYAMOND_inferenceNB.ipynb

Files (4.3 MB)

Name Size Download all
md5:1b9524f451e29496d70568fb5142a1d7
8.2 kB Download
md5:7b8f0b14c9c6f8ced5b1ede7e7d4fee4
1.6 kB Download
md5:b9527c6fcc0b16ba38fe0c1bf9b26faa
440.3 kB Preview Download
md5:0cd982a530a9cc626b84441fb68b64f1
7.4 kB Preview Download
md5:0df1557f60248be01464ea750c0a70d0
3.3 MB Preview Download
md5:872f59f0cb19049983155dd6eb2d92f4
430.1 kB Preview Download
md5:30a067acc85a0bbfc748ff262ae47ed0
6.1 kB Download
md5:c53124cc6af5f5a969db93ed2486993d
3.8 kB Download
md5:e336dee512a623273d53ca3828c33997
934 Bytes Download
md5:930e6995c99ae9532d1964a53096fffd
961 Bytes Download
md5:3e3a0a39f68eb8c5f9ae5bbf2d2ef587
4.8 kB Download
md5:ef0c70e4e9aab2b03629af359002d60f
903 Bytes Download

Additional details

Funding

The Cooperative Agreement To Analyze variabiLity, change and predictabilitY in the earth SysTem (CATALYST) DE-SC0022070; NSF IA 1947282
United States Department of Energy

Software

Repository URL
https://github.com/mariajmolina/ML-extremes-mcs/
Programming language
Python
Development Status
Wip