Lars Martin Hodne
Eirik Leikvoll
Mauhing Yip
Andreas Langeland Teigen
Annette Stahl
Rudolf Mester
2022-04-08
<p>Conventional SLAM methods which work very well in typical above-water situations, are based on detecting keypoints that are tracked between images, from which ego-motion and the 3D structure of the scene is estimated.<br>
However, in underwater environments with marine snow — small particles of organic matter which are carried by ocean currents throughout the water column — keypoint detectors are prone to detect the marine snow particles. As the vast majority of SLAM front ends are sensitive against outliers, and the marine snow acts as severe “motion noise”, failure of the regular egomotion and 3D structure estimation is expected. For this reason, we investigate the structure and appearance of marine snow and developed two schemes which classify keypoints into ”marine snow” or ”clean” based on either the image patches obtained from usual keypoint detectors or the descriptors computed from these patches. This way the subsequent SLAM pipeline is protected against ’false’ keypoints. We quantitatively evaluate the performance of our marine snow classifier on both real underwater video scenes as well as on simulated underwater footage that contains marine snow. These simulated image sequences have been created by extracting real marine snow elements from real underwater footage, and subsequently overlaying these on “clean” underwater videos.<br>
Qualitative evaluation is also done on a night-time road sequence with snowfall to demonstrate applicability in other areas of autonomy. We furthermore evaluate the performance and the effect of marine snow detection & suppression by integrating the snow suppression module in a full SLAM pipeline based on the pySLAM system.</p>
CITATION: When using this dataset in your research, we will be happy if you cite us! --- Lars Martin Hodne, Eirik Leikvoll, Andreas Langeland Teigen, Mauhing Yip, Annette Stahl, and Rudolf Mester, "Detecting and Suppressing Marine Snow for Underwater Visual SLAM," 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2022, pp. 5097-5105, doi: 10.1109/CVPRW56347.2022.00558.
https://doi.org/10.1109/CVPRW56347.2022.00558
oai:zenodo.org:6424752
Zenodo
https://doi.org/10.1109/ICCVW54120.2021.00415
https://doi.org/10.5281/zenodo.5567209
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
CVPRW, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), New Orleans, Louisiana, June 19th – 23rd, 2022
Detecting and Suppressing Marine Snow for Underwater Visual SLAM
info:eu-repo/semantics/other