Info: Zenodo’s user support line is staffed on regular business days between Dec 23 and Jan 5. Response times may be slightly longer than normal.

ZTF Source Classification Project
Published April 2024 | Version 1.1.5
Dataset Open

The data for "The ZTF Source Classification Project: III. A Catalog of Variable Sources"

Creators

  • 1. University of Minnesota
  • 2. ROR icon California Institute of Technology
  • 3. ROR icon University of Amsterdam
  • 4. ROR icon University of Washington
  • 5. ROR icon Pacific Lutheran University
  • 6. ROR icon Indian Institute of Technology Gandhinagar
  • 7. ROR icon University of California, Berkeley
  • 8. ROR icon Lawrence Berkeley National Laboratory
  • 9. ROR icon Carnegie Mellon University
  • 10. ROR icon Jet Propulsion Laboratory

Description

The classification of variable objects provides insight into a wide variety of astrophysics ranging from stellar interiors to galactic nuclei. The Zwicky Transient Facility (ZTF) provides time series observations that record the variability of more than a billion sources. The scale of these data necessitates automated approaches to make a thorough analysis. Building on previous work, this paper reports the results of the ZTF Source Classification Project (SCoPe), which trains neural network and XGBoost machine learning (ML) algorithms to perform dichotomous classification of variable ZTF sources using a manually constructed training set containing 170,632 light curves. We find that several classifiers achieve high precision and recall scores, suggesting the reliability of their predictions for 373,819,334 light curves across 210 ZTF fields. We also identify the most important features for XGB classification and compare the performance of the two ML algorithms, finding a pattern of higher precision among XGB classifiers. The resulting classification catalog is available to the public, and the software developed for SCoPe is open-source and adaptable to future time-domain surveys.

Notes

Notes for 1.1.3

  1. In SCoPe_Sky_Coverage.png dark regions indicate parts of the sky that are included in the current catalog and light regions show the total coverage of ZTF.

---------------------------------------------------------------------------------

Notes for 0.1.1

  1. Fields are now seperated by hour in Right Ascension (RA). Fields  with centers between N-1 and N hours RA are located inN_N-1_prediction_xgb_dnn_fields.zip.  For example a field with a center of 3.7 hours RA would be located in 04_03_prediction_xgb_dnn_fields.zip
  2. The seperation is done by the location of the field center so there may be parts of fields that are not in the within the RA indicated. Field centers and corners can be found on this GitHub page.
  3. 01_00_prediction_xgb_dnn_fields.zip is fully completed

------------------------------------------------------------------------------------

Notes for 0.1.0

  1. Fields are now seperated by hour in Right Ascension (RA). Fields  with centers between N-1 and N hours RA are located in N_prediction_xgb_dnn_fields.zip.  For example a field with a center of 3.7 hours RA would be located in 4_prediction_xgb_dnn_fields.zip
  2. The seperation is done by the location of the field center so there may be parts of fields that are not in the within the RA indicated. Field centers and corners can be found on this GitHub page.
  3. fields.json now denotes which fields with classifications are contained in each folder.

 

------------------------------------------------------------------------------------

Notes for 0.0.4

  1. All fields are now contained (in CSV format) within a single predictions_dnn_xgb_92_fields.zip file.

------------------------------------------------------------------------------------

Notes for 0.0.3

  1. All fields are now contained (in CSV format) within a single predictions_dnn_xgb_77_fields.zip file.

 

------------------------------------------------------------------------------------

Notes for 0.0.2

  1.  From Version 0.0.1 to 0.0.2, classification predictions have been updated by the inclusion of the Gaia parallax error in the set of ontological features. Any fields downloaded from Version 0.0.1 should thus be replaced by those from Version 0.0.2.
  2. The structure of the catalog has been updated - all fields are now contained (in CSV format) within a single predictions_dnn_xgb_70_fields.zip file.
  3. A demo file containing 100 rows of predictions along with a Jupyter notebook to explain the columns are included in this release. See the scope-ml repository for details on setting up the environment needed to run this notebook.
  4. The new fields.json file contains a list of all fields having classification predictions.

Files

SCoPe_Sky_Coverage.png

Files (25.7 GB)

Name Size Download all
md5:5fd741ca2be2c809b04d9b973ce2a758
2.7 GB Preview Download
md5:01ea83ec64548bafe24a9117b754758a
2.5 GB Preview Download
md5:1fffa84d923298ae3e5a70fafa7f2bf8
2.6 GB Preview Download
md5:3243ffec953b7ee31c9089be0702137e
1.9 GB Preview Download
md5:2d7a51d58307535007a1888a18eed553
2.3 GB Preview Download
md5:09acc12d3a40b39798068487b103e13c
424.7 MB Preview Download
md5:27c8f8c72acb354c794703d3b11ffa9f
840.0 MB Preview Download
md5:4d1f21aa3cad227f06822cf5f7d4aa49
214 Bytes Preview Download
md5:9ed8a91f8999889618b28bfd001d79a6
125.8 MB Preview Download
md5:aaddbd292108bd42f5d4cf806d8b272c
36.3 MB Preview Download
md5:cce085606e27e4b61fdeeec478c6b7a3
206.7 MB Preview Download
md5:b58416b3aac74225ab7ea5c8662342c9
170.5 MB Preview Download
md5:ad280d3dd8aaafbe1bc8dcd4cab9631d
340.0 MB Preview Download
md5:19e32b3c5a0931f8b22ec9b404fbae28
817.9 MB Preview Download
md5:7fe7dd99c33b85f24063e8301a3424c8
221.3 MB Preview Download
md5:7dea879882d415078e0b5ec091f165d8
257.5 MB Preview Download
md5:13366a10ec4926cec11f79d0178729d5
739.0 MB Preview Download
md5:71584d939e0f7d479a0a117b8217f9a2
891.1 MB Preview Download
md5:1b914c74bf31ff10905852266ce83582
5.2 GB Preview Download
md5:c13e811a552dba82d94fb42c1d905924
1.5 GB Preview Download
md5:6377c9b7522b5f5ad32c18a39617e2fd
214 Bytes Preview Download
md5:912a989cbab1ddfe2b7b872e9bb480fe
179.3 MB Preview Download
md5:ea7287450b18dfbd6c59a844c71a6fbe
464.9 MB Preview Download
md5:0f74d77edf56362ae80943a922801d58
601.0 MB Preview Download
md5:9d72a8e3168d1822472540d483a0a34a
50.4 kB Preview Download
md5:c19e4a7c752719f5c4ee130ffc8968f9
1.9 kB Preview Download
md5:5cc82c40ae58ca2a41c5c269ed711492
91.7 kB Preview Download
md5:c6940ef7401313b67cd00afb255d4212
60.1 kB Preview Download
md5:7b7beedb23df5c215ab6ff1cd87d2efc
51.3 MB Preview Download
md5:ac58c38129d7e42ecafcf117f3c9c38d
41.9 MB Preview Download
md5:d310d280134cd3f09e4ceab9799bf3a9
436.2 MB Download

Additional details

Software

Repository URL
https://github.com/ZwickyTransientFacility/scope-ml