Folder Structure

circle-exclamation

Data is organized in a five-level hierarchy: run → dataset → year → month → daily files.

s3://gs-snowflake-exports/run=2026-02-17/
├── aeso_daily_average_pool_price/
│   ├── year=2000/
│   │   ├── month=01/
│   │   │   ├── 2000-01-01.csv.gz
│   │   │   ├── 2000-01-02.csv.gz
│   │   │   └── ...
│   │   ├── month=02/
│   │   └── ...
│   ├── year=2001/
│   └── ...
├── caiso_lmp_day_ahead_hourly/
│   ├── year=2019/
│   └── ...
└── ... (hundreds of datasets)
  • run=YYYY-MM-DD is the date the export run started (the run may have finished after that date). During the beta, the only run is 2026-02-17.

  • Each dataset is a top-level folder.

  • Data is partitioned by year=YYYY/month=MM/.

  • Individual files are gzipped CSVs named by date: YYYY-MM-DD.csv.gz.

    • For datasets with a publish_time_column, the date in the filename is the publish date of the data.

    • For datasets without a publish_time_column, the date in the filename is the time_index_column date of the data.

  • File sizes vary by dataset — small datasets are ~150 bytes/file, while large LMP datasets can be up to 100 MB/file.

Last updated

Was this helpful?