Published October 29, 2026 | Version v2026.10.0

Public Utility Data Liberation Project (PUDL) Data Release

Description

v2026.10.0 (2026-10-14)

This is a regular monthly PUDL data release, primarily motivated by updating the EIA-860M monthly data through August 2026. It also brings in final release 2025 data for the EIA-860, EIA-861, and EIA-923, plus straggler FERC Form 1 filings from 2025.

We made several important improvements for reproducibility in this release. These changes make all outputs fully deterministic, which will make it possible to detect specific changes between builds. We've also added the new table core_epamats__hourly_emissions brings hourly mercury and hydrogen chloride emissions into PUDL. Thanks to @bsousa22 for this contribution! Finally, we fixed a longstanding bug in the net generation and fuel allocation that silently dropped legitimate data for generators transitioning between proposed/existing/retired status across a multi-year ETL run.

Enhancements

New Data

EPA MATS

Expanded Data Coverage

EIA-860

EIA-860M

EIA-861

EIA-923

  • Added final release data from 2025 for EIA-923, and monthly release from June 2026. See issue #5594 and PR #5599.

FERC Form 1

  • Integrated any updates or straggler filings from 2025 for FERC Form 1. See PR #5668.

Documentation

  • Fixed dbt macro argument documentation in dbt/macros/schema.yml and dbt/tests/data_tests/generic_tests/schema.yml to match dbt 1.12's stricter validation of macro arguments: blocks against their jinja signatures, clearing a long list of spurious dbt parse warnings. Also standardized on the long-form string type name (rather than str) throughout, since both are accepted by dbt but were used inconsistently. See PR #5593.

New Data Tests & Validations

  • Added unit tests for the ID assignment process that builds core_epa__assn_eia_epacamd_subplant_ids. Fixed several bugs that those tests exposed, including one that could split a physically connected group of generators into separate subplants. Simplified the underlying ID assignment logic to be entirely graph-based. See issue #5675 and PR #5543. Part of an effort to harmonize the Open Grid Emissions initiative and PUDL. See epic #5439 which is tracking that effort.

  • Added minimum and maximum constraints for plant and Census latitudes and longitudes, to catch impossible locations. EIA-860M coordinates are not cleaned up (about 0.04% of its records are obviously wrong), so core_eia860m__changelog_generators is exempt, and new dbt tests cap the number of known bad records in it instead. See PR #5697.

Bug Fixes & Data Cleaning

  • Made the EIA-930 and FERC-714 hourly demand imputation deterministic. The underlying tensor-completion algorithm previously relied on a unseeded random subsampling mechanism which meant demand_imputed_pudl_mwh values could shift slightly from one build to the next. For our hourly annual (8760) imputation blocks, the subsampling wasn't any faster than using all the data points, so we removed it. Added a guard against the algorithm stopping prematurely on a transient dip in its convergence metric. This was never observed happening, but seemed uncomfortably close to the set tolerance. Also stopped replacing values that were not flagged for imputation with the values estimated by the tensor completion. They should match the original reported value exactly now, rather than carrying tiny model reconstruction error. Tightened the corresponding dbt tolerance tests accordingly. See #5649 and #5656.

  • Fixed allocate_gen_fuel.py silently dropping legitimate generation and fuel data for generators transitioning between proposed/existing or existing/retired status across a multi-year ETL run. Unified the slightly different logics of these transitions into a single, shared, symmetric process. This simplification exposed a bug in which one generator's status transition could silently prevent data from another group of generators at the same plant from being allocated. Added extensive unit tests and new dbt data quality tests validating that >=99.7% of all reported generation and fuel survives allocation. Thanks to @grgmiller for surfacing the issue and initiating the fix. See #5440 and PRs #5419, #5511.

  • Fixed a bug where a skipped nightly/release build (i.e. one that found good build outputs for its commit and kicked off the deploy-pudl.yml workflow) uploaded its own small logfile to the build outputs bucket. This created newer object path with the same commit confusing deploy-pudl causing deployment to fail. See #5579 and #5580.

  • Fixed a broken metadata override in CashFlowsTableTransformer that left the starting_balance/ending_balance rows for cash_and_cash_equivalents in core_ferc1__yearly_cash_flows_sched120 without row_type_xbrl, is_within_table_calc, balance, or ferc_account metadata. See #5587 and #5588.

  • Made plant_id_ferc1 deterministic. The IDs assigned to FERC 1 steam plants used to be reshuffled by tiny changes in the input data, even when the plants themselves were unchanged. They now depend only on which records belong to each plant, so unrelated plants keep their IDs and differences between runs reflect real changes. IDs now start at 1 instead of 0, and are still not stable across data updates. We also corrected several hand-assigned plant_id_pudl values that split one plant across multiple IDs, which cut the number of plant_id_ferc1 values spanning more than one plant_id_pudl from 6 to 2. See issue #5609 and PR #5642.

  • Updated the record-linkage which assigns plant_id_ferc1 to make it insensitive to floating point noise. See issue #5609 and PR #5687.

  • Fixed tags for new 2025 XBRL factoids and rescued the ferc_account field in out_ferc1__yearly_rate_base. See #5520 and #5597.

  • Fixed valid_until_date in the _core_eia__forensics_entity_resolution_* and _core_rus*__forensics_entity_resolution_borrowers tables. Each record's end date was being drawn from an unrelated column of the same entity, and ties were sorted arbitrarily, so values were often wrong and changed between builds. It's now the next change in the same column, and the output is deterministic. See #5608 and #5641.

  • Made the FERC 1 to EIA plant-parts record linkage reproducible. The splink model sampled record pairs without a seed and broke ties between equally probable matches arbitrarily, so about 1% of the matches in out_pudl__yearly_assn_eia_ferc1_plant_parts changed on every run even with identical inputs. The sampling is now seeded and ties are broken by EIA record ID. See #5610 and #5643.

  • Made shared helpers in pudl.helpers behave identically under pandas 2 and 3. standardize_percentages_ratio() now accepts numeric strings (as some Excel-sourced columns arrive) and always returns float64; genuinely non-numeric values still raise. scale_by_ownership() now always returns float64 for the scaled columns, where the dtype previously depended on the data (Int64 if every value happened to be integral). String-cleaning, boolean and phone-number helpers were also hardened against pandas 3 dtype behavior changes. See #5613, #5614, #5615 and #5662.

  • Fixed the integer NERC region code 25470 reported by utility 55959 in 2013 and 2014 in the EIA-861 tables, which was becoming UNK instead of MRO. See PR #5685.

  • Fixed a bug introduced in PR #5506 which improperly aggregated generators with multiple owners after an ineffective drop duplicates, resulting in double counting in a small number of out_eia__yearly_plant_parts records. See issue #5651 and PR #5703.

  • Fixed a bug that gave plants with no reported state the state FIPS code 74 (U.S. Minor Outlying Islands). Those plants in core_eia__entity_plants, and the generators built from them, now have a null state_id_fips. See PR #5697.

Performance Improvements

  • Sped up the FERC EQR batch deployment to cloud object storage from ~3 hours to ~5 minutes. Uploads to and server-side copies within S3 now go through boto3 in the new pudl.deploy.s3_transfer module, while GCS and all other targets stay on fsspec/UPath and run in a thread pool. Deployment now stages each build under a per-build ._staging_{BUILD_ID} prefix, verifies the staged files by name and size, snapshots the previous outputs into ._ferceqr_previous for manual rollback, and then merges the staged files into the live prefix. Existing files that a build doesn't replace are left in place in anticipation of doing incremental per-file updates. The build VM was also bumped to c4d-standard-32 after an out-of-memory crash. See issue #5317 and PR #5561.

  • Sped up the FERC EQR batch ETL from ~45 minutes to ~25 minutes: a standalone Dagster gRPC code server, newest-quarter-first partitioning, and a bounded ferceqr_extract concurrency pool. Also fixed an intermittent out-of-memory kill that silently dropped a quarter from the build, by capping DuckDB's resource use per connection and streaming quarterly archive downloads instead of reading them into memory. See issue #5318 and PR #5595.

  • Switched all of PUDL's Parquet outputs from snappy to zstd compression, which makes the files substantially smaller. The codec and compression levels are now set in one place (pudl.PARQUET_COMPRESSION and related constants) and used by every Parquet writer. See #5603 and #5604.

Developer Experience

  • Replaced all remaining uses of importlib.resources with direct pathlib.Path access to files under src/pudl/package_data, since PUDL is only ever run from a git checkout and no longer needs to support being installed as a distributable package. Also removed the now-unneeded dummy __init__.py files that made package_data subdirectories importable, which incidentally stops Sphinx from generating documentation pages for these non-code directories. See PR #5592.

  • Upgraded to Pyrefly 1.3.0 and adopted its new concise baseline format. Fixed a handful of genuine typing gaps that the upgrade surfaced. Mostly this involved type narrowing in places where an object that might be None was subject to a regex match, dict lookup, or other operation that would fail on None. See PR #5583.

  • Switched to using quieter, more compact pytest output instead of logging 1000s of tests to the terminal. Fast ETL in pipeline tests will still log. Made pixi.lock drift checking in pre-commit hooks more robust. Fixed open SQLite database warnings coming from FERC SQLite IO Manager. See PR #5573.

Other PUDL v2026.10.0 Resources

Contact Us

If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch:

Files

censusdp1tract.sqlite.zip

Files (28.3 GB)

Name Size
md5:d5a3808367ec764c09151504ef297953
506.7 MB Preview Download
md5:9cb682a6282d9dd2ebf83d25c1fa879a
275.0 MB Preview Download
md5:804490fc637e407e31a76cfd59f098e4
131.6 MB Preview Download
md5:121b201eb96c94c251d236287802c27a
274.6 kB Preview Download
md5:0d828bf34b205f78f766813efe9fa410
235.9 MB Download
md5:5f383611cc804a576fbd020729759ac4
246.5 MB Preview Download
md5:bef029baf517bc21f0de554d0189969a
95.4 MB Preview Download
md5:d099f6f79c75d5f0e671a278e7f214e7
2.3 MB Preview Download
md5:ee5c7f18d569c58f3f008b96a16bedff
8.5 MB Preview Download
md5:eebf0f40a0c38b3a6400031fa0cb34b9
74.7 MB Preview Download
md5:b88bd77903b7e22c6d709b3e3529fd78
34.0 MB Preview Download
md5:da70eed4af9c3f7945dfdb492863f70e
221.2 kB Preview Download
md5:07d77edac05747bdbbfa1df2ff6cdcd3
99.1 MB Download
md5:92bf97d23b0d59e8bd83ab76db1c83d9
37.5 MB Preview Download
md5:430fedb4ff15b50dd56556440029d45a
14.8 MB Preview Download
md5:98cae7f4b6553f289b0d4f4217d1827a
2.3 MB Preview Download
md5:bd09d11e1a79a1623b3d9789bf336c9e
7.2 MB Preview Download
md5:b901dfc54b3fec761996599591310c45
2.9 MB Preview Download
md5:092fbf67223d5da16e9baeb8f9bc803d
2.0 MB Preview Download
md5:c95112534754314997f4165bbb15145a
72.2 kB Preview Download
md5:85555353f7295afb8685fd30a56c8e51
21.0 MB Download
md5:44d7bacd536ffc7b56c7a33cd0e8e998
5.6 MB Preview Download
md5:db47e66a3c75a95369ea538ec8e50021
3.9 MB Preview Download
md5:c730bd9c92bffd35c859ae552456f152
978.1 kB Preview Download
md5:ba679325b7ae96c87b6fa5584cfae491
2.0 MB Preview Download
md5:37480524abfd48fb6f4a5f8afbca79bd
44.0 MB Preview Download
md5:1336f6d0550e7f7d009960a9eda8c9a5
19.3 MB Preview Download
md5:4d4cb175c568c9387ea7111b04121d5e
127.9 kB Preview Download
md5:8f65718767cde8ccc25240df9a6f34d2
55.8 MB Download
md5:cb8a12ff00850917a69689688bae3cb2
30.0 MB Preview Download
md5:e502d451287bb6aae105f7463c0851d4
10.5 MB Preview Download
md5:2da977999acd3cd81f95c42f3ab56777
1.3 MB Preview Download
md5:240ab648e9b6fb13f2540b217638676e
3.0 MB Preview Download
md5:79dfca929ffa9b11e60fa6b3cae8ba42
60.6 MB Download
md5:e3794f83d722ad16275e51386dcf1e21
243.5 MB Preview Download
md5:d7ed547cb477f6a927ec5094b4dcb34b
30.5 MB Preview Download
md5:7c99a9ae93fa4ddfc5a4bc15f72820a4
65.7 kB Preview Download
md5:83bcf37029395440c6a0efb7ce49ee8e
192.9 kB Preview Download
md5:38383a8950e1cc66aab6af19c1af45e2
38 Bytes Download
md5:583f4688253f4dd032dfca0ad2ba4400
10.5 GB Download
md5:b14fbc61b279f45b3db8314d8dc29347
3.5 GB Preview Download
md5:09bf2597acfd38d53f9a60546662c1e3
12.0 GB Preview Download
md5:5defa9fe437560eba2096608af249a37
4.5 MB Preview Download

Additional details