Published February 29, 2020 | Version v1

Machine Learning for Cultural Heritage: A Survey

  • 1. Center for Cultural Heritage Technology (CCHT), Istituto Italiano di Tecnologia (IIT), Italy
  • 2. Computational Statistics and Machine Learning, Istituto Italiano di Tecnologia (IIT), Italy
  • 3. Visual Geometry and Modelling (VGM) Lab, Istituto Italiano di Tecnologia (IIT), Italy
  • 4. Center for Cultural Heritage Technology (CCHT) & Visual Geometry and Modelling (VGM) Lab, Istituto Italiano di Tecnologia (IIT), Italy

Description

The application of Machine Learning (ML) to Cultural Heritage (CH) has evolved since basic statistical approaches such as Linear Regression to complex Deep Learning models. The question remains how much of this actively improves on the underlying algorithm versus using it within a ‘black box’ setting. We survey across ML and CH literature to identify the theoretical changes which contribute to the algorithm and in turn them suitable for CH applications. Alternatively, and most commonly, when there are no changes, we review the CH applications, features and pre/post-processing which make the algorithm suitable for its use. We analyse the dominant divides within ML, Supervised, Semi-supervised and Unsupervised, and reflect on a variety of algorithms that have been extensively used. From such an analysis, we give a critical look at the use of ML in CH and consider why CH has only limited adoption of ML.

Files

2019_CCHT_PRL_ML_for_CH_Marco.pdf

Files (153.2 kB)

Name Size Download all
md5:0065140ec6ba07151d684beccdbd6218
153.2 kB Preview Download

Additional details

Funding

European Commission
MEMEX - MEMEX: MEMories and EXperiences for inclusive digital storytelling 870743