Published August 29, 2023 | Version 1.0
Dataset Open

Advancing crop disease early warning in South Asia by complementing expert surveys with internet media scraping - supporting data and analysis

Authors/Creators

  • 1. University of Cambridge

Description

Contains data from experiments and analysis that support the associated paper currently under review.

Also contains scripts to:

- Get the latest scraped media reports from the online dashboard (see doi: 10.5281/zenodo.8024493), and generate proxy surveys from them;

- Simulate wheat rust spore production based on available survey datasets.

- Analyse results of surveys, and models of spore production and spore dispersal, and reproduce the figures contained in the associated paper and its supplement.

Requirements: Docker installed and 6GB of available storage space.

Steps to use:

1) Download and unzip the contained file.

2) (Linux) Run setup.sh.

    (Windows/OSX/other) Look in setup.sh for instructions on where to unzip the files contained in supporting_data/ and build the Docker image and container.

3) Start and enter the Docker container, then run /home/code/sources-media-reports/run_all.sh.

Notes

This work was funded by a grant from the Bill & Melinda Gates Foundation to the Cambridge group, as well as the United Kingdom Foreign, Commonwealth and Development Office's programme Asia Regional Resilience in a Changing Climate (ARRCC). This work is also mapped to the One CGIAR Regional Integrated initiative Transforming Agrifood Systems in South Asia (TAFSSA). Accordingly, we would like to thank all funders who supported this research through their contributions to the CGIAR Trust Fund. Some of the software contained with this dataset are under an MIT license, see within.

Files

docker_media_scraper-20230821T1452.zip

Files (349.1 MB)

Name Size
md5:c0db22e18d41b41cabbd00e14cf6ee6d
349.1 MB Preview Download

Additional details

Related works

Is supplemented by
Software documentation: 10.5281/zenodo.8024493 (DOI)