The Public Utility Data Liberation (PUDL) Project

What's Changed

For a mor narraitve account of changes, see our v2024.8.0 release notes.

New & Updated Data

• Merge EIA861 short-form transform by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3660
• Update expected row counts in service territory tables. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3673
• Add EIA AEO fuel cost projections by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3656
• Integrate 2023 EIA 860 Early Release by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/3681
• Integrate 2024 NREL ATB data by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3719
• Update xbrl extraction to use new version by @zschira in https://github.com/catalyst-cooperative/pudl/pull/3710
• Transform FERC-714 load forecast table by @seeess1 in https://github.com/catalyst-cooperative/pudl/pull/3670
• Integrate EIA 923 ER by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3721
• Eia923 er validation test fix by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3734
• Add title to quarterly updates issue template by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3765
• Add Q2 2024 CEMS data by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3769
• Update DOI for NREL ATB to get error corrections by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3778
• Integrate Eia923 Q2 2024 Data by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3768
• Update 2024 Q2 EIA bulk electricity data by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3785
• Integrate 2024 Half 2 data for EIA 930 by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3789
• Integrate Eia860M Q2 2024 Data by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3767
• Update all FERC dataset DOIs by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3790

Other Changes

• Add staging environment by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3666
• Add retry logic to datastore.get_zipfile_resource. by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3658
• SoD Docs Updates by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3672
• Add data-update github label to the release notes by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3683
• Update nightly build script to quietly publish public Parquet outputs. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3680
• Update conda lockfile by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3685
• Update docs to link to .zip not .gz S3 archives by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3686
• Take the most recently reported generator operating date when there's no 70%+ consistently reported date by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3697
• Add organization using PUDL section to readme by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3671
• Log datasette access IPs by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3669
• Make asset checks matter to integration tests by @jdangerx in https://github.com/catalyst-cooperative/pudl/pull/3687
• Fix EIA 860m Changelog bugs by @cmgosnell in https://github.com/catalyst-cooperative/pudl/pull/3694
• Move pudl_etl_job_factory back to pudl.etl.cli.py by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3711
• Automate issue creation for Quarterly Updates by @aesharpe in https://github.com/catalyst-cooperative/pudl/pull/3709
• Disable rolling avg to fill missing fuel prices in EIA923 FRC table by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3716
• Update allowable not water limited capacity ratio. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3723
• Remove bad respondent ID 2 by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3724
• If branch is a fork, skip the release.yml workflow by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3727
• Add direct_support keys in core_eia860__scd_generators_energy_storage as foreign keys to core_eia__entity_generators by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3699
• Update all documentation URLs to point at nightly not latest by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3740
• Remove additional generator from expected gens_eia860 row count by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3743
• Add generator_operating_date to 860M changelog table by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3751
• Add mozilla repo to wif pool by @zschira in https://github.com/catalyst-cooperative/pudl/pull/3753
• Update some dataset lists and date ranges. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3754
• Fix release.yml fork behaviors by @e-belfer in https://github.com/catalyst-cooperative/pudl/pull/3788
• repaired ferc broken links by @Nancy9ice in https://github.com/catalyst-cooperative/pudl/pull/3787
• Superset deployment by @bendnorman in https://github.com/catalyst-cooperative/pudl/pull/3715
• Close out v2024.8.0 release notes. by @zaneselvans in https://github.com/catalyst-cooperative/pudl/pull/3801

New Contributors

• @seeess1 made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/3670
• @Nancy9ice made their first contribution in https://github.com/catalyst-cooperative/pudl/pull/3787

Full Changelog: https://github.com/catalyst-cooperative/pudl/compare/v2024.5.0...v2024.8.0