Selection of pre-training datasets for sonar image classification

Deep learning based computer vision models like convolutional neural networks (CNN) are more and more applied for the automatic analysis of sonar images. Since sonar image datasets typically have a limited number of samples, transferlearning is used to train these models. However, commonly used pre-training datasets, like ImageNet, have a large domain gap to sonar images, i.e., images in these two datasets are fundamentally different. The selection of the pre-training dataset and the related domain gap have shown to have an impact on the final performance of the model. In this work, different datasets are analysed for applying transfer-learning to a CNN for the classification of sidescan sonar images. We quantify the domain gap using a variational autoencoder (VAE) and the t-distributed stochastic neighbor embedding (t-SNE) and link these values to the classification performance of the CNN after fine-tuning.