A multimodal approach in estimating road passability through a flooded area using social media and satellite images

This paper presents the algorithms that CERTH-ITI team deployed so as to deal with flood detection and road passability from social media and satellite data. Computer vision and deep learning techniques are combined so as to analyze social media and satellite images, while word2vec is used to analyze textual data. Multimodal fusion is also deployed in CERTH-ITI framework, both in early and late stage, by combining deep representation features in the former and semantic logic in the latter so as to provide a deeper and more meaningful understanding of the flood events.