Electricity Market Dataset across Regions

This dataset contains cleaned and harmonized electricity market data used for cross-regional analysis of electricity prices and consumption patterns. The processed files cover five regions: New York, California, Texas, Germany, and Italy.

The raw data were obtained from publicly available electricity market data sources, including NYISO Settlement archives for New York, the U.S. Energy Information Administration for California and Texas, the SMARD platform for Germany, and Terna Italian electricity market data portals for Italy. Region-specific raw data were processed to align timestamps, aggregate or standardize price and load series where necessary, convert numeric fields to a consistent format, and retain a compact tabular structure across markets.

The final processed datasets contain the following standardized columns:

• timestamps — time index of the observation. For Germany and Italy, timestamps are reported in local market time, i.e., CET/CEST, at hourly resolution. For New York, timestamps are reported in Eastern Time (ET), alternating between EST and EDT. For Texas/ERCOT, timestamps are reported in Central Time (CT), alternating between CST and CDT. For California/CAISO, timestamps are reported in Pacific Time (PT), alternating between PST and PDT. Users should account for daylight-saving-time transitions when converting timestamps to UTC.
  
  
• consumption — electricity demand or load value. The physical unit differs slightly across source systems. For Germany, consumption is reported as total actual electricity consumption in megawatt-hours (MWh) per hourly interval. For Italy and New York, consumption corresponds to electricity load measured in megawatts (MW). For Texas/ERCOT and California/CAISO, consumption is reported as total actual electricity demand in megawatt-hours (MWh) per hourly interval. Since all datasets are hourly, MW and MWh values may be numerically comparable over a one-hour interval, but their physical interpretation differs: MW is average power, while MWh is energy delivered over the interval.
  
  
• prices — electricity market price value. For Germany, prices correspond to EPEX SPOT day-ahead auction prices in euros per megawatt-hour (EUR/MWh). For Italy, prices correspond to Italian day-ahead electricity market prices, typically the MGP/PUN reference price, in EUR/MWh. For New York, prices correspond to NYISO locational marginal electricity prices in U.S. dollars per megawatt-hour (USD/MWh). For Texas/ERCOT and California/CAISO, prices correspond to wholesale electricity market prices in USD/MWh, based on the relevant settlement point, hub, or locational marginal price series available through the source data.

All price and consumption fields are converted to numeric floating-point format. Non-essential raw columns were removed to provide a compact dataset suitable for electricity market analysis, forecasting, battery arbitrage experiments, and cross-market comparison. Negative and near-zero electricity prices are retained as valid market observations, as they reflect real market conditions in high-renewable or scarcity-pricing settings.