Machine Learning for UAV and Ground-Captured Imagery: Toward Standard Practices
Creators
- 1. Northern Arizona University
- 2. San Diego State University
- 3. Southern Illinois University, Carbondale
- 4. Pontifical Catholic University of Peru
Description
Our collaborative work began in 2019 with the intent to overcome obstacles that had arisen from the inability to access curated artifact collections from remote locations. It was our specific aim to not only create digital twins of excavated objects that could not be exported out of their country of origin, but also to emphasize the contextual associations of objects residing in hidden museum collections using a range of digital techniques. As part of a growing field project in 2022, machine learning (ML) with YOLOv5, a family of compound-scaled object detection models trained on the COCO dataset was used to classify visual data and advance our understanding of in situ archaeological phenomena prior to destructive fieldwork. While not the sole contribution, the use of object-based machine learning improved quality and range of information obtained in non-destructive site surveys and improved data sharing capacity. Despite challenges encountered while training the algorithm and classifying objects, combining ML with drone data collection will continue as part of our long-term spatial data recording procedure. Despite both success and failures reported here, this work contributes to greater standardization of ML techniques in archaeological practice.
Files
Files
(3.0 MB)
Name | Size | Download all |
---|---|---|
md5:22efc9fba4306d439fdd8ad846f939b1
|
3.0 MB | Download |
Additional details
Identifiers
Related works
- Is supplemented by
- Dataset: 10.5281/zenodo.11050465 (DOI)
Dates
- Accepted
-
2024-05-02revision
References
- Ahmed, Nisha Arya Mean Average Precision (mAP): A Complete Guide. Kili Technology. https://kili-technology.com/data-labeling/machine-learning/mean-average-precision-map-a-complete-guide, accessed March 26, 2024.
- Alexakis, D, Athos Agapiou, D Hadjimitsis, and Apostolos Sarris 2012 Remote sensing applications in archaeological research. Remote Sensing-Applications:435–462.
- Baheti, Pragati 2021 Convolutional Neural Networks: Architectures, Types & Examples. https://www.v7labs.com/blog/convolutional-neural-networks-guide, https://www.v7labs.com/blog/convolutional-neural-networks-guide, accessed March 26, 2024.
- Bonhage, Alexander, Mahmoud Eltaher, Thomas Raab, Michael Breuß, Alexandra Raab, and Anna Schneider 2021 A modified Mask region-based convolutional neural network approach for the automated detection of archaeological sites on high-resolution light detection and ranging-derived digital elevation models in the North German Lowland. Archaeological Prospection 28(2):177–186. DOI:https://doi.org/10.1002/arp.1806.
- Caspari, Gino, and Pablo Crespo 2019 Convolutional neural networks for archaeological site detection–Finding "princely" tombs. Journal of Archaeological Science 110:104998. https://doi.org/10.1016/j.jas.2019.104998
- Caster, Joshua, Joel B. Sankey, Helen Fairley, and Alan Kasprak 2022 Terrestrial lidar monitoring of the effects of Glen Canyon Dam operations on the geomorphic condition of archaeological sites in Grand Canyon National Park, 2010–2020. US Geological Survey. https://doi.org/10.3133/ofr20221097
- Davies, David. 2022 " YOLOv5 Object Detection on Windows (Step-By-Step Tutorial)." https://wandb.ai/onlineinference/YOLO/reports/YOLOv5-Object-Detection-on-Windows-Step-By-Step-Tutorial---VmlldzoxMDQwNzk4.
- Deepchecks AI 2024 What is YOLO (object detection algorithm). Deepchecks. https://deepchecks.com/glossary/yolo-object-detection-algorithm/, accessed March 26, 2024.
- DeepLearning. 2020 "YOLOv5 training with custom data." YouTube. https://www.youtube.com/watch?v=GRtgLlwxpc4&t=780s
- Girshick, Ross, Jeff Donahue, Trevor Darrell, and Jitendra Malik 2014 Rich feature hierarchies for accurate object detection and semantic segmentation. arXiv. https://doi.org/10.48550/arXiv.1311.2524
- Jocher, Glenn 2020 YOLOv5 by Ultralytics. https://docs.ultralytics.com/yolov5/
- Kundu, Rohit 2023 YOLO Algorithm for Object Detection Explained [+Examples]. https://www.v7labs.com/blog/yolo-object-detection, https://www.v7labs.com/blog/yolo-object-detection, accessed March 26, 2024.
- Lambers, Karsten 2018 Airborne and spaceborne remote sensing and digital image analysis in archaeology. Digital Geoarchaeology: New Techniques for Interdisciplinary Human-Environmental Research:109–122. https://doi.org/10.1007/978-3-319-25316-9_7
- Li, Yilan, Hossein Eslamiat, Ningshan Wang, Ziyi Zhao, Amit K Sanyal, and Qinru Qiu 2019 Autonomous waypoints planning and trajectory generation for multi-rotor UAVs. DESTION '19: Proceedings of the Workshop on Design Automation for CPS and IoT: 31–40. https://doi.org/10.1145/3313151.3313163
- Mittal, Payal, Raman Singh, and Akashdeep Sharma 2020 Deep learning -based object detection in low-altitude UAV datasets: A survey. Image and Vision computing 104:104046. https://doi.org/10.1016/j.imavis.2020.104046
- Nepal, Upesh, and Hossein Eslamiat 2022 Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs. Sensors 22(2):464. DOI:10.3390/s22020464.
- Orengo, Hector A., Arnau Garcia‐Molsosa, Iban Berganzo‐Besga, Juergen Landauer, Paloma Aliende, and Sergi Tres‐Martínez 2021 New developments in drone‐based automated surface survey: Towards a functional and effective survey system. Archaeological Prospection 28(4):519–526. https://doi.org/10.1002/arp.1822
- PyTorch 2023 https://www.pytorch.org, accessed August 31, 2023.
- Redmon, Joseph, Santosh Divvala, Ross Girshick, and Ali Farhadi 2016 You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779-788
- Sakai, Masato, Yiru Lai, Jorge Olano Canales, Masao Hayashi, and Kohhei Nomura 2023 Accelerating the discovery of new Nasca geoglyphs using machine learning . Journal of Archaeological Science 155:105777. DOI:https://doi.org/10.1016/j.jas.2023.105777.
- Sharp, Kayeleigh 2019 Rethinking the Gallinazo: A Northern Perspective from the Mid-Zaña Valley, Peru. Southern Illinois University at Carbondale.
- Verschoof-van der Vaart, W.B. Learning to look at LiDAR | Scholarly Publications. https://scholarlypublications.universiteitleiden.nl/handle/1887/3256824, accessed March 26, 2024.
- Verschoof-Van der Vaart, Wouter Baernd, and Karsten Lambers 2019 Learning to look at LiDAR: The use of R-CNN in the automated detection of archaeological objects in LiDAR data from the Netherlands. Journal of Computer Applications in Archaeology 2(1). DOI: 10.5334/jcaa.32
- Zeman, Benjamin 2023 What is Google Colab? Android Police. https://www.androidpolice.com/google-colab-explainer/, accessed March 26, 2024.