Published May 20, 2022 | Version v1
Presentation Open

Can AI help users find data? The experience with the ESO Science Archives

  • 1. ESO
  • 2. ESO, Czech Technical University
  • 1. Vera Rubin Observatory
  • 2. Lancaster University
  • 3. CDS
  • 4. Czech Technical University

Description

The ESO Science Archive offers millions of data files to its science community. It is, then, crucial to its success that it also provides advanced query capabilities to guide the researchers to identify which of those data are of interest for their specific use. The broad hypothesis behind the work presented here is that letting the abundant real astrophysical data speak for itself, with minimal supervision and no labels, can reveal interesting patterns and distil information in ways that may facilitate data discovery. The need for supervision to be minimal is a must, given the sheer size and diversity of the archive contents. To this end, we have applied Deep Learning techniques to large datasets in the ESO Science Archive, most notably the entire data history of the HARPS high-resolution spectrograph. In our first round of experiments, we have obtained promising results in two directions. On the one side, the networks have learned to infer physical parameters of the celestial sources, such as radial velocity and effective temperature, just by being exposed to a large number of stellar spectra, without being explicitly asked to do so. On the other side, networks with the same basic architecture have shown an inclination to separate stellar and telluric spectral components, again without being instructed to do so. The lessons learned from the exercise and prospects will be presented.

Files

SciOps22_ESOarchives.pdf

Files (17.8 MB)

Name Size Download all
md5:25a42e404851e6d6700bb62aba7602a5
17.8 MB Preview Download

Additional details

Funding

ESCAPE – European Science Cluster of Astronomy & Particle physics ESFRI research infrastructures 824064
European Commission