Public Utility Data Liberation Project (PUDL) Data Release
Creators
- 1. Catalyst Cooperative
Description
PUDL v2024.10.0 Data Release
This is a special early release to publish the new VCE Resource Adequacy Renewable Energy (RARE) dataset. It also includes final releases of EIA 860 and 923 data for 2023 and the FERC Form 714 data for 2021-2023, which had previously been integrated from the XBRL data published by FERC. See the release notes for more narrative detail.
New Data
Vibrant Clean Energy Resource Adequacy Renewable Energy (RARE) Power Dataset
-
Integrate the VCE hourly capacity factor data for solar PV, onshore wind, and offshore wind from 2019 through 2023. The data in this table were produced by Vibrant Clean Energy, and are licensed to the public under the Creative Commons Attribution 4.0 International license (CC-BY-4.0). This data complements the WECC-wide GridPath RA Toolkit data currently incorporated into PUDL, providing capacity factor data nation-wide with a different set of modeling assumptions and a different granularity for the aggregation of outputs. See GridPath Resource Adequacy Toolkit Data and Vibrant Clean Energy Resource Adequacy Renewable Energy (RARE) Power Dataset for more information. See #3872.
New Data Coverage
EIA 860
EIA 923
FERC Form 714
-
Integrated 2021-2023 years of the FERC Form 714 data. FERC updated its reporting format for 2021 from a CSV files to XBRL files. This update integrates the two raw data sources and extends the data coverage through 2023. See #3809 and #3842.
Schema Changes
-
Added out_eia__yearly_assn_plant_parts_plant_gen table. This table associates records from the out_eia__yearly_plant_parts with
plant_gen
records from that same plant parts table. See issue #3773 and PR #3774.
Bug Fixes
-
Included more retiring generators in the net generation and fuel consumption allocation. Thanks to @grgmiller for this contirbution #3690.
-
Fixed a bug found in the rolling averages used to impute missing values in
fuel_cost_per_mmbtu
and to calculatecapex_annual_addition_rolling
. Thanks to RMI for identifying this bug! See issue #3889 and PR #3892.
Major Dependency Updates
-
Updated to use Numpy v2.0 and Splink v4.0. See issues #3736, #3735 and PRs #3547, #3834.
Quality of Life Improvements
-
We now use an asset factory to generate Dagster assets for near-identical FERC1 output tables. See #3147 and #3883. Thanks to @hfireborn and @denimalpaca for their work on this one!
Other PUDL v2024.10.0 Resources
- PUDL v2024.10.0 Data Dictionary
- PUDL v2024.10.0 Documentation
- PUDL in the AWS Open Data Registry
- PUDL v2024.10.0 in a free, public AWS S3 bucket: s3://pudl.catalyst.coop/v2024.10.0/
- PUDL v2024.10.0 in a requester-pays GCS bucket: gs://pudl.catalyst.coop/v2024.10.0/
- Zenodo archive of the PUDL GitHub repo for this release
- PUDL v2024.10.0 release on GitHub
- PUDL v2024.10.0 package in the Python Package Index (PyPI)
Contact Us
If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch:
- Follow us on GitHub
- Use the PUDL Github issue tracker to let us know about any bugs or data issues you encounter
- GitHub Discussions is where we provide user support.
- Watch our GitHub Project to see what we're working on.
- Email us at hello@catalyst.coop for private communications.
- On Mastodon: @CatalystCoop@mastodon.energy
- On BlueSky: @catalyst.coop
- On Twitter: @CatalystCoop
- Connect with us on LinkedIn
- Play with our data and notebooks on Kaggle
- Combine our data with ML models on HuggingFace
- Learn more about us on our website: https://catalyst.coop
- Subscribe to our announcements list for email updates.
Files
pudl_parquet.zip
Files
(12.9 GB)
Name | Size | Download all |
---|---|---|
md5:40512c4bd07aed10e9b88b50a6d50b82
|
6.9 MB | Download |
md5:8008b5aef4fb7c2f1ef8ca75a68943e2
|
506.7 MB | Preview Download |
md5:56b2ca44258d4a608f5daa4db6b8765e
|
275.5 MB | Preview Download |
md5:46f070d6b393b40500122afef5f2371b
|
142.9 MB | Preview Download |
md5:e20f379cceee26733236e04b4d38dc07
|
2.3 MB | Preview Download |
md5:e2ea5445b402a8c021ed9e4b806dd272
|
7.3 MB | Preview Download |
md5:dce4b25e2bee7bd6e5faeb84bbb076fe
|
74.5 MB | Preview Download |
md5:dba5d1fc88c385aa89268761709c7c2e
|
20.0 MB | Preview Download |
md5:683503e374b75fd423d37d70e7b09568
|
2.6 MB | Preview Download |
md5:e7de3eb187c894a7cfb1dc6506d7d6da
|
7.2 MB | Preview Download |
md5:ca227b89894aca63f7c3c1e8099c9093
|
2.9 MB | Preview Download |
md5:d889167b7f300c8ef25cd0b54c59752a
|
3.3 MB | Preview Download |
md5:b3e0f37c8a688be0f058543b33804399
|
964.8 kB | Preview Download |
md5:3761d6fc6a9e4901476793076d338ab4
|
1.9 MB | Preview Download |
md5:6653faa83d929c78e12302838f31792e
|
43.9 MB | Preview Download |
md5:3a5dfc004181506664c7fa19e0539c6c
|
16.1 MB | Preview Download |
md5:b31ac8e18ef9c2809d0f268b143235aa
|
1.4 MB | Preview Download |
md5:5dc4026532593b8f4dab3556345f2c1a
|
2.9 MB | Preview Download |
md5:2f83708448944029b1e9245b26253e94
|
157.6 MB | Preview Download |
md5:ef18834c7e2e516b443f22ec6ac37818
|
85.4 kB | Preview Download |
md5:9fef935f9a970839319ada082d6c9672
|
192.4 kB | Preview Download |
md5:bfc9961b5f079a6e1ffc5d7392be9820
|
2.8 GB | Preview Download |
md5:676f2c4ecf55b6e6ab484b58dce9c941
|
8.8 GB | Preview Download |