Deep learning-based detection of mesoscale convective systems
Description
This ongoing research project focuses on using deep learning for feature detection of mesoscale convective systems (MCSs). These script versions were used to detect MCSs and contribute to the following manuscript:
Feng, Z., et al. (in prep). Mesoscale Convective Systems tracking Method Intercomparison (MCSMIP): Application to DYAMOND Global km-scale Simulations. Journal of Geophysical Research: Atmospheres.
Machine learning training uses PNNL provided labels of MCS objects derived from ERA5 (Contact: Zhe Feng, PNNL).
The trained model was subsequently used with DYAMOND model data.
More broadly, this project entails a collaboration between the National Center for Atmospheric Research, the Department of Atmospheric and Oceanic Science at the University of Maryland-College Park, and the Department of Earth Sciences at the University of Connecticut, to detect MCSs across a range of datasets and models.
To detect MCSs, follow the next steps:
- Train a U-Net to detect MCSs using preprocessed ERA5 data and
DYAMOND_unet_ttr.ipynb
. - Apply the trained U-Net to detect MCSs in the DYAMOND model output using
DYAMOND_inferenceNB.ipynb
. - Assemble the files into an organized file that contains various supplemental variables using
DYAMOND_inferenceNB_part2file.ipynb
. - Visualize new MCS objects using
DYAMOND_inferenceNB_part3viz.ipynb
.
Then, to create MCS tracks, follow the next steps:
- Split MCS tracks with
split_tracks.py
if needed for manual parallelization. - Filter MCSs with
write_scripts.csh
, which callsmcs_filtering.py
, based on common MCS criteria outlined by MCSMIP protocols. - Combine filtering into one file with
post-process.py
.
For more updated versions of these scripts, go to the corresponding GitHub repositories:
Files
DYAMOND_inferenceNB.ipynb
Files
(4.3 MB)
Name | Size | Download all |
---|---|---|
md5:1b9524f451e29496d70568fb5142a1d7
|
8.2 kB | Download |
md5:7b8f0b14c9c6f8ced5b1ede7e7d4fee4
|
1.6 kB | Download |
md5:b9527c6fcc0b16ba38fe0c1bf9b26faa
|
440.3 kB | Preview Download |
md5:0cd982a530a9cc626b84441fb68b64f1
|
7.4 kB | Preview Download |
md5:0df1557f60248be01464ea750c0a70d0
|
3.3 MB | Preview Download |
md5:872f59f0cb19049983155dd6eb2d92f4
|
430.1 kB | Preview Download |
md5:30a067acc85a0bbfc748ff262ae47ed0
|
6.1 kB | Download |
md5:c53124cc6af5f5a969db93ed2486993d
|
3.8 kB | Download |
md5:e336dee512a623273d53ca3828c33997
|
934 Bytes | Download |
md5:930e6995c99ae9532d1964a53096fffd
|
961 Bytes | Download |
md5:3e3a0a39f68eb8c5f9ae5bbf2d2ef587
|
4.8 kB | Download |
md5:ef0c70e4e9aab2b03629af359002d60f
|
903 Bytes | Download |
Additional details
Funding
Software
- Repository URL
- https://github.com/mariajmolina/ML-extremes-mcs/
- Programming language
- Python
- Development Status
- Wip