Published January 25, 2021 | Version v1
Conference paper Open

A multimodal tensor-based late fusion approach for satellite image search in Sentinel 2 images

  • 1. Centre for Research and Technology Hellas - Information Technologies Institute


Earth Observation (EO) Big Data Collections are acquired at large volumes and variety, due to their high heterogeneous nature. The
multimodal character of EO Big Data requires eective combination of multiple modalities for similarity search. We propose a late fusion mechanism of multiple rankings to combine the results from several uni-modal searches in Sentinel 2 image collections. We st create a K-order tensor from the results of separate searches by visual features, concepts, spatial and temporal information. Visual concepts and features are based on a vector representation from Deep Convolutional Neural Networks. 2D-surfaces of the K-order tensor initially provide candidate retrieved results per ranking position and are merged to obtain the nal list of retrieved results. Satellite image patches are used as queries in order to retrieve the most relevant image patches in Sentinel 2 images. Quantitative and qualitative results show that the proposed method outperforms search by a single modality and other late fusion methods.



Files (7.1 MB)

Additional details


EOPEN – EOPEN: opEn interOperable Platform for unified access and analysis of Earth observatioN data 776019
European Commission
aqua3S – Enhancing Standardisation strategies to integrate innovative technologies for Safety and Security in existing water networks 832876
European Commission