M. De Felice
K. Kavvadias
2022-03-07
<p><strong># ERA-NUTS (1980-2021)</strong></p>
<p>This dataset contains a set of time-series of meteorological variables based on <a href="https://climate.copernicus.eu/climate-reanalysis">Copernicus Climate Change Service (C3S) ERA5 reanalysis</a>. The data files can be downloaded from here while notebooks and other files can be found on the <a href="https://github.com/energy-modelling-toolkit/era-nuts-code">associated Github repository</a>.</p>
<p>This data has been generated with the aim of providing hourly time-series of the <strong>meteorological variables</strong> commonly used for power system modelling and, more in general, studies on energy systems.</p>
<p>An example of the analysis that can be performed with ERA-NUTS is shown <a href="https://youtu.be/zVeF8Dv6jlE">in this video</a>.</p>
<p><strong>Important</strong>: <em>this dataset is still a work-in-progress, we will add more analysis and variables in the near-future. If you spot an error or something strange in the data please tell us <a href="mailto:matteo.de-felice@ec.europa.eu">sending an email</a> or opening an Issue in the <a href="https://github.com/energy-modelling-toolkit/era-nuts-code">associated Github repository</a>.</em></p>
<p><strong>## Data</strong><br>
The time-series have hourly/daily/monthly frequency and are aggregated following the <a href="https://ec.europa.eu/eurostat/web/nuts/background">NUTS 2016 classification</a>. NUTS (Nomenclature of Territorial Units for Statistics) is a European Union standard for referencing the subdivisions of countries (member states, candidate countries and EFTA countries).</p>
<p>This dataset contains NUTS0/1/2 time-series for the following variables obtained from the <strong>ERA5 reanalysis data</strong> (in brackets the name of the variable on the Copernicus Data Store and its unit measure):</p>
<p> - <strong>t2m</strong>: 2-meter temperature (`2m_temperature`, Celsius degrees)<br>
- <strong>ssrd</strong>: Surface solar radiation (`surface_solar_radiation_downwards`, Watt per square meter)<br>
- <strong>ssrdc</strong>: Surface solar radiation clear-sky (`surface_solar_radiation_downward_clear_sky`, Watt per square meter)<br>
- <strong>ro</strong>: Runoff (`runoff`, millimeters)<br>
- <strong>sd</strong>: Snow depth (`sd`, meters)<br>
<br>
There are also a set of derived variables:<br>
- <strong>ws10</strong>: Wind speed at 10 meters (derived by `10m_u_component_of_wind` and `10m_v_component_of_wind`, meters per second)<br>
- <strong>ws100</strong>: Wind speed at 100 meters (derived by `100m_u_component_of_wind` and `100m_v_component_of_wind`, meters per second)<br>
- <strong>CS</strong>: Clear-Sky index (the ratio between the solar radiation and the solar radiation clear-sky)<br>
- <strong>HDD</strong>/<strong>CDD</strong>: Heating/Cooling Degree days (derived by 2-meter temperature the <a href="https://ec.europa.eu/eurostat/cache/metadata/en/nrg_chdd_esms.htm">EUROSTAT definition</a>.</p>
<p>For each variable we have <strong>367 440 hourly samples</strong> (from 01-01-1980 00:00:00 to 31-12-2021 23:00:00) for <strong>34/115/309 regions</strong> (NUTS 0/1/2).<br>
<br>
The data is provided in two formats:</p>
<p> - NetCDF version 4 (all the variables hourly and CDD/HDD daily). NOTE: the variables are stored as `int16` type using a `scale_factor` to minimise the size of the files.<br>
- Comma Separated Value ("single index" format for all the variables and the time frequencies and "stacked" only for daily and monthly)<br>
<br>
All the CSV files are stored in a zipped file for each variable.</p>
<p><strong>## Methodology</strong></p>
<p>The time-series have been generated using the following workflow:</p>
<p> 1. The NetCDF files are downloaded from the Copernicus Data Store from the <a href="https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=form">ERA5 hourly data on single levels from 1979 to present</a> dataset<br>
2. The data is read in R with the <a href="http://www.meteo.unican.es/climate4R">climate4r</a> packages and aggregated using the function `/get_ts_from_shp` from <a href="https://github.com/matteodefelice/panas">panas</a>. All the variables are aggregated at the NUTS boundaries using the average except for the runoff, which consists of the sum of all the grid points within the regional/national borders.<br>
3. The derived variables (wind speed, CDD/HDD, clear-sky) are computed and all the CSV files are generated using R<br>
4. The NetCDF are created using `xarray` in Python 3.8.</p>
<p><strong>## Example notebooks</strong></p>
<p>In the folder `notebooks` on the <a href="https://github.com/energy-modelling-toolkit/era-nuts-code">associated Github repository</a> there are two Jupyter notebooks which shows how to deal effectively with the NetCDF data in `xarray` and how to visualise them in several ways by using matplotlib or the <a href="https://github.com/kavvkon/enlopy">enlopy</a> package.</p>
<p>There are currently two notebooks:</p>
<p> - <strong>exploring-ERA-NUTS</strong>: it shows how to open the NetCDF files (with Dask), how to manipulate and visualise them.<br>
- <strong>ERA-NUTS-explore-with-widget</strong>: explorer interactively the datasets with [<a href="https://jupyter.org/">jupyter</a>]() and <a href="https://ipywidgets.readthedocs.io/en/stable/">ipywidgets</a>.</p>
<p>The notebook `exploring-ERA-NUTS` is also available rendered as HTML.<br>
<br>
<strong>## Additional files</strong></p>
<p>In the folder `additional files`on the <a href="https://github.com/energy-modelling-toolkit/era-nuts-code">associated Github repository</a> there is a map showing the spatial resolution of the ERA5 reanalysis and a CSV file specifying the number of grid points with respect to each NUTS0/1/2 region.</p>
<p><strong>## License</strong></p>
<p>This dataset is released under <a href="https://creativecommons.org/licenses/by/4.0/">CC-BY-4.0 license</a>.</p>
<p><strong>## Changelog</strong></p>
<p><strong>2022-03-07 </strong>Added the missing month in CDD/HDD <br>
<strong>2022-02-08 </strong>Updated the wind speed and temperature data due to missing months. </p>
<p> </p>
https://doi.org/10.5281/zenodo.6333977
oai:zenodo.org:6333977
Zenodo
https://doi.org/10.5281/zenodo.2650190
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
era5
copernicus
time-series
meteorology
climate
energy modelling
power system modelling
renewable energy
ERA-NUTS: meteorological time-series based on C3S ERA5 for European regions (1980-2021)
info:eu-repo/semantics/other