Overview

This dataset contains simulated weak gravitational lensing convergence maps for benchmarking machine learning methods in cosmological inference. It underpins the FAIR Universe Weak Lensing ML Uncertainty Challenge, a community competition run on Codabench targeting cosmological parameter inference with uncertainty quantification (Phase 1, hosted as a NeurIPS 2025 competition:) and out-of-distribution detection (Phase 2). Comprehensive documentation of the dataset and challenge is provided in the white paper.

The dataset reflects realistic weak lensing observations of the Hyper Suprime-Cam (HSC) Year-3 dataset, including the survey footprint, redshift distribution, and galaxy density. It incorporates two of the most important sources of systematic uncertainty in weak lensing analyses — baryonic feedback and photometric redshift uncertainty — modeled as nuisance parameters that are sampled across the dataset and must be marginalized over during inference.

Relationship to the Phase-1 challenge dataset: This release is an upgraded version of the training set used in the Phase-1 challenge. In the Phase-1 release, the same set of random realizations was reused across all cosmologies; in this release, each cosmology uses an independent set of realizations, which substantially increases the effective number of independent samples and removes correlations across cosmologies. We therefore recommend this release for any use beyond reproducing the original Phase-1 leaderboard.

The held-out test set has been generated and consists of 14k convergence maps with corresponding labels, drawn from 82 cosmological models that are not present in the training set. This design enables evaluation of cosmological parameter inference under generalization to unseen cosmologies. The held-out test set will be released after the end of Phase 2 competition.

A small representative sample of the dataset (3 cosmologies × 30 realizations, ≈ 23 MB) is also included for users who want to quickly inspect the data format before downloading the full 6.4 GB file. See the Files section for details.

Files

The dataset consists of five files: two for the full training set, two for a small representative sample, and one shared survey footprint mask used by both.

WIDE12H_bin2_2arcmin_kappa_newrealization.npy

A 3-dimensional array of shape (N_cosmologies, N_realizations, N_observed_pixels) containing the simulated convergence values for each observed pixel. Each entry along the last axis corresponds to one pixel inside the HSC Y3 WIDE12H survey footprint; pixels outside the footprint are not stored. To reconstruct the full 2D map (1424 × 176 pixels at 2 arcmin resolution), use the survey mask (see WIDE12H_bin2_2arcmin_mask.npy below) to place each value at its corresponding location.

• Number of cosmologies: 101
• Number of independent realizations per cosmology: 256
• Number of observed pixels per map: 132019
• Map dimensions when reconstructed: 1424 × 176 pixels
• Pixel resolution: 2 arcmin
• Dtype: float16

The maps are released noiseless. Shape noise from intrinsic galaxy ellipticities can be added during training as on-the-fly Gaussian noise with zero mean and standard deviation σ = σ_ε / sqrt(2 · n_g · A_pixel), where σ_ε ≈ 0.4 is the typical galaxy intrinsic ellipticity, A_pixel = 4 arcmin², and n_g = 30 arcmin⁻² is the assumed source galaxy number density (representative of upcoming Stage-IV surveys such as Rubin/LSST and Euclid).

WIDE12H_bin2_2arcmin_mask.npy

A 2D boolean array of shape (1424, 176) representing the HSC Y3 WIDE12H survey footprint. Pixels with value 1 lie within the observed region; pixels with value 0 are outside the survey and should be excluded from analysis. The mask is identical across all maps in the dataset.

label_newrealization.npy

A 2D array of shape (N_cosmologies, N_realizations, 5) containing the ground-truth labels for each map, in the order: