Published December 27, 2024 | Version v2

Dataset for Large Language Models Classification of Astronomical Transient : Survey Images, Labels, and Zooniverse Results

Authors/Creators

  • 1. University of Oxford

Description

This dataset supports the study on the application of Large Language Models (LLMs) to astronomical transient classification. It contains data from three wide-field optical surveys: Pan-STARRS, MeerLICHT, and ATLAS, and includes the following components:

  1. Survey Image Files

    • Image triplets (New, Reference, and Difference images) for each transient candidate in the three datasets.
    • Images are organized by survey (Pan-STARRS, MeerLICHT, and ATLAS).
  2. Survey Label Files

    • Ground-truth classification labels for each candidate in the three surveys.
    • Labels include categories such as Real (e.g., transients and variable stars for MeerLICHT, and only explosive transients for Pan-STARRS and ATLAS) and Bogus (various types of artifacts), as determined by professional astronomers.
  3. Zooniverse Classification Results

    • Results from the Zooniverse campaign evaluating the quality of Gemini’s outputs.
    • Includes responses from professional astronomers who rated the coherence of Gemini's classifications and explanations on a 0–5 scale.

Purpose:

The dataset is intended for researchers interested in exploring:

  • The use of LLMs for transient classification.
  • Ground-truth labels and their application in astronomical classification tasks.
  • Human evaluation of AI-generated outputs in astronomy.

Use and Citation:

Please cite this dataset using the DOI provided by Zenodo if used in your research. For details on the methodology, refer to the associated publication: "Large Language Models Enable Textual Interpretation of Image-Based Astronomical Transient Classifications", Under Review, 2025

Files

ai-on-trial-how-well-do-llms-classify-astronomical-images-classifications.csv

Files (866.2 MB)

Name Size
md5:8b6de700c4895d8a8d97ea954f3bc8b1
343.9 kB Preview Download
md5:6519f4f41a2b3efc06ab9851a148fdae
239.8 MB Download
md5:5d601e00e99174ae807df2fa62382dc6
21.9 kB Preview Download
md5:bbf55c1cecbdea127497d6cd346e3455
386.3 MB Download
md5:cacf76a6aadd97ed18ab24b58e121bc2
35.9 kB Preview Download
md5:95f744bc84f75a5f54a89f651195df84
239.8 MB Download
md5:0391eff19b92bf3a4572a2e8e6037804
21.9 kB Preview Download