Planned intervention: On Wednesday April 3rd 05:30 UTC Zenodo will be unavailable for up to 2-10 minutes to perform a storage cluster upgrade.
Published December 24, 2021 | Version 1.0.0
Software Open

Pollution Detection Algorithm (PDA)

Description

The Pollution Detection Algorithm (PDA) is an algorithm to identify and flag periods of primary polluted data in remote atmospheric time series in five steps. The first and most important step identifies polluted periods based on the gradient (time-derivative) of a concentration over time. If this gradient exceeds a given threshold, data are flagged as polluted. Further pollution identification steps are a simple concentration threshold filter, a neighboring points filter (optional), a median and a sparse data filter (optional). The PDA is written in python and runs from the command line. No GUI installation is needed. The script only relies on the target dataset file itself and is independent of ancillary datasets such as meteorological variables. All parameters of each step are adjustable so that the PDA can be “tuned” to be more or less stringent (e.g., flag more or less data points as polluted). The PDA was developed and tested with a particle number concentration dataset collected during the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition in the Central Arctic (https://doi.org/10.5194/amt-15-4195-2022).

Files

Manual_PDA_script.pdf

Files (1.3 MB)

Name Size Download all
md5:6284884548ef129b7eae7a3a32cdf877
1.3 MB Preview Download
md5:470de189f45aee72028ef336b3502093
44.2 kB Download

Additional details

Funding

Measurement-Based understanding of the aeRosol budget in the Arctic and its Climate Effects 200021_188478
Swiss National Science Foundation

References

  • Beck, I., Angot, H., Dada, L., Baccarini, A., Quéléver, L. L. J., Jokinen, T., Laurila, T., Lampimaki, M., Bukowiecki, N., Boyer, M., Gong, X., Gysel-Beer, M., Petäjä, T., and Schmale, J.: Automated identification of local contamination in remote atmospheric composition time series, Atmos. Meas. Tech., 2022