There is a newer version of the record available.

Published September 1, 2023 | Version v1
Conference paper Open

Machine Learning for UAV and Ground-Captured Imagery: Toward Standard Practices

  • 1. Northern Arizona University
  • 2. San Diego State University
  • 3. Southern Illinois University, Carbondale
  • 4. Pontifical Catholic University of Peru

Description

Our collaborative work began in 2019 with the intent to overcome obstacles that had arisen from the inability to access curated artifact collections from remote locations. It was our specific aim to not only create digital twins of excavated objects that could not be exported out of their country of origin, but also to emphasize the contextual associations of objects residing in hidden museum collections using a range of digital techniques. As part of a growing field project in 2022, machine learning (ML) with YOLOv5, a family of compound-scaled object detection models trained on the COCO dataset was used to classify visual data and advance our understanding of in situ archaeological phenomena prior to destructive fieldwork. While not the sole contribution, the use of object-based machine learning improved quality and range of information obtained in non-destructive site surveys and improved data sharing capacity. Despite challenges encountered while training the algorithm and classifying objects, combining ML with drone data collection will continue as part of our long-term spatial data recording procedure. Despite both success and failures reported here, this work contributes to greater standardization of ML techniques in archaeological practice.

Files

Files (2.2 MB)

Name Size Download all
md5:68ec4de2f075e0eaf86538b9145b9fce
2.2 MB Download

Additional details

References

  • Bonhage, Alexander, Mahmoud Eltaher, Thomas Raab, Michael Breuß, Alexandra Raab, and Anna Schneider 2021 A modified Mask region-based convolutional neural network approach for the automated detection of archaeological sites on high-resolution light detection and ranging-derived digital elevation models in the North German Lowland. Archaeological Prospection 28(2):177–186. DOI:https://doi.org/10.1002/arp.1806.
  • Caspari, Gino, and Pablo Crespo 2019 Convolutional neural networks for archaeological site detection–Finding "princely" tombs. Journal of Archaeological Science 110:104998
  • Caster, Joshua, Joel B. Sankey, Helen Fairley, and Alan Kasprak 2022 Terrestrial lidar monitoring of the effects of Glen Canyon Dam operations on the geomorphic condition of archaeological sites in Grand Canyon National Park, 2010–2020. US Geological Survey.
  • Davies, David. 2022 " YOLOv5 Object Detection on Windows (Step-By-Step Tutorial)." https://wandb.ai/onlineinference/YOLO/reports/YOLOv5-Object-Detection-on-Windows-Step-By-Step-Tutorial---VmlldzoxMDQwNzk4
  • DeepLearning. 2020 "YOLOv5 training with custom data." YouTube. https://www.youtube.com/watch?v=GRtgLlwxpc4&t=780s
  • Gómez, Francisco Díaz, Josué Jiménez Peiró, Amparo Barreda Benavent, Bárbara Asensi Recuenco, and Juan Hervás Juan 2015 Modelado 3D para la generación de patrimonio virtual. Virtual Archaeology Review 6(12):29–37.
  • Mittal, Payal, Raman Singh, and Akashdeep Sharma 2020 Deep learning-based object detection in low-altitude UAV datasets: A survey. Image and Vision computing 104:104046.
  • Nepal, Upesh, and Hossein Eslamiat 2022 Comparing YOLOv3, YOLOv4 and YOLOv5 for Autonomous Landing Spot Detection in Faulty UAVs. Sensors 22(2):464. DOI:10.3390/s22020464.
  • Orengo, Hector A., Arnau Garcia‐Molsosa, Iban Berganzo‐Besga, Juergen Landauer, Paloma Aliende, and Sergi Tres‐Martínez 2021 New developments in drone‐based automated surface survey: Towards a functional and effective survey system. Archaeological Prospection 28(4):519–526.
  • PyTorch 2023 https://www.pytorch.org, accessed August 31, 2023.
  • Sakai, Masato, Yiru Lai, Jorge Olano Canales, Masao Hayashi, and Kohhei Nomura 2023 Accelerating the discovery of new Nasca geoglyphs using deep learning. Journal of Archaeological Science 155:105777. DOI:https://doi.org/10.1016/j.jas.2023.105777.