Published April 2020 | Version 1.1.8
Dataset Open

The data for "The ZTF Source Classification Project: III. A Catalog of Variable Sources"

  • 1. University of Minnesota
  • 2. ROR icon California Institute of Technology
  • 3. ROR icon University of Amsterdam
  • 4. ROR icon University of Washington
  • 5. ROR icon Pacific Lutheran University
  • 6. ROR icon Indian Institute of Technology Gandhinagar
  • 7. ROR icon University of California, Berkeley
  • 8. ROR icon Lawrence Berkeley National Laboratory
  • 9. ROR icon Carnegie Mellon University
  • 10. ROR icon Jet Propulsion Laboratory

Description

The classification of variable objects provides insight into a wide variety of astrophysics ranging from stellar interiors to galactic nuclei. The Zwicky Transient Facility (ZTF) provides time series observations that record the variability of more than a billion sources. The scale of these data necessitates automated approaches to make a thorough analysis. Building on previous work, this paper reports the results of the ZTF Source Classification Project (SCoPe), which trains neural network and XGBoost machine learning (ML) algorithms to perform dichotomous classification of variable ZTF sources using a manually constructed training set containing 170,632 light curves. We find that several classifiers achieve high precision and recall scores, suggesting the reliability of their predictions for 1,102,938,154 light curves across 461 ZTF fields. We also identify the most important features for XGB classification and compare the performance of the two ML algorithms, finding a pattern of higher precision among XGB classifiers. The resulting classification catalog is available to the public, and the software developed for SCoPe is open-source and adaptable to future time-domain surveys.

Notes

Notes for 1.1.8

  1. In SCoPe_Sky_Coverage.png The darkest blue regions indicate parts of the sky that are included in the original data release. The lightest blue region show the area added in this data release. The medium blue region show what was avalible in the previous version.

-----------------------------------------------------------------------------------

Notes for 1.1.3

  1. In SCoPe_Sky_Coverage.png dark regions indicate parts of the sky that are included in the current catalog and light regions show the total coverage of ZTF.

---------------------------------------------------------------------------------

Notes for 0.1.1

  1. Fields are now seperated by hour in Right Ascension (RA). Fields  with centers between N-1 and N hours RA are located inN_N-1_prediction_xgb_dnn_fields.zip.  For example a field with a center of 3.7 hours RA would be located in 04_03_prediction_xgb_dnn_fields.zip
  2. The seperation is done by the location of the field center so there may be parts of fields that are not in the within the RA indicated. Field centers and corners can be found on this GitHub page.
  3. 01_00_prediction_xgb_dnn_fields.zip is fully completed

------------------------------------------------------------------------------------

Notes for 0.1.0

  1. Fields are now seperated by hour in Right Ascension (RA). Fields  with centers between N-1 and N hours RA are located in N_prediction_xgb_dnn_fields.zip.  For example a field with a center of 3.7 hours RA would be located in 4_prediction_xgb_dnn_fields.zip
  2. The seperation is done by the location of the field center so there may be parts of fields that are not in the within the RA indicated. Field centers and corners can be found on this GitHub page.
  3. fields.json now denotes which fields with classifications are contained in each folder.

 

------------------------------------------------------------------------------------

Notes for 0.0.4

  1. All fields are now contained (in CSV format) within a single predictions_dnn_xgb_92_fields.zip file.

------------------------------------------------------------------------------------

Notes for 0.0.3

  1. All fields are now contained (in CSV format) within a single predictions_dnn_xgb_77_fields.zip file.

 

------------------------------------------------------------------------------------

Notes for 0.0.2

  1.  From Version 0.0.1 to 0.0.2, classification predictions have been updated by the inclusion of the Gaia parallax error in the set of ontological features. Any fields downloaded from Version 0.0.1 should thus be replaced by those from Version 0.0.2.
  2. The structure of the catalog has been updated - all fields are now contained (in CSV format) within a single predictions_dnn_xgb_70_fields.zip file.
  3. A demo file containing 100 rows of predictions along with a Jupyter notebook to explain the columns are included in this release. See the scope-ml repository for details on setting up the environment needed to run this notebook.
  4. The new fields.json file contains a list of all fields having classification predictions.

Files

SCoPe_Sky_Coverage.png

Files (61.0 GB)

Name Size Download all
md5:5fd741ca2be2c809b04d9b973ce2a758
2.7 GB Preview Download
md5:01ea83ec64548bafe24a9117b754758a
2.5 GB Preview Download
md5:1fffa84d923298ae3e5a70fafa7f2bf8
2.6 GB Preview Download
md5:3243ffec953b7ee31c9089be0702137e
1.9 GB Preview Download
md5:2d7a51d58307535007a1888a18eed553
2.3 GB Preview Download
md5:f914f8e527b762f55fb6c9fbf8236346
3.0 GB Preview Download
md5:61be44af4e6a0ea9845909f0bb9213fd
3.8 GB Preview Download
md5:7036d97075484237b8cc4206dc1993e9
4.2 GB Preview Download
md5:78432a0488b4758ac8dca8fabe116c63
2.2 GB Preview Download
md5:9d10620f234d593f17b1d309f1bcef62
1.4 GB Preview Download
md5:584e5ed12251ac30818c97f49351f335
1.1 GB Preview Download
md5:e26169208bc23f9737d357a78b3e4c91
1.3 GB Preview Download
md5:ad280d3dd8aaafbe1bc8dcd4cab9631d
340.0 MB Preview Download
md5:19e32b3c5a0931f8b22ec9b404fbae28
817.9 MB Preview Download
md5:7fe7dd99c33b85f24063e8301a3424c8
221.3 MB Preview Download
md5:b5ed5abd7377b05fe08f3dd0dcb9a344
2.1 GB Preview Download
md5:980a6a722b15f0be5672d8a3ce504e10
3.5 GB Preview Download
md5:5c4fdddaa4eb5e75a731f6c52a048935
8.2 GB Preview Download
md5:5b9f66809355ceeb4f5563f3a9863d49
13.5 GB Preview Download
md5:c13e811a552dba82d94fb42c1d905924
1.5 GB Preview Download
md5:6377c9b7522b5f5ad32c18a39617e2fd
214 Bytes Preview Download
md5:912a989cbab1ddfe2b7b872e9bb480fe
179.3 MB Preview Download
md5:ea7287450b18dfbd6c59a844c71a6fbe
464.9 MB Preview Download
md5:0f74d77edf56362ae80943a922801d58
601.0 MB Preview Download
md5:9d72a8e3168d1822472540d483a0a34a
50.4 kB Preview Download
md5:5845f0baa933202d9a8e13b8a8c1798d
3.2 kB Preview Download
md5:5cc82c40ae58ca2a41c5c269ed711492
91.7 kB Preview Download
md5:e264850e24090ecb04d9017589c6f4d1
61.6 kB Preview Download
md5:7b7beedb23df5c215ab6ff1cd87d2efc
51.3 MB Preview Download
md5:ac58c38129d7e42ecafcf117f3c9c38d
41.9 MB Preview Download
md5:d310d280134cd3f09e4ceab9799bf3a9
436.2 MB Download

Additional details