Hostname: page-component-8448b6f56d-m8qmq Total loading time: 0 Render date: 2024-04-19T19:24:00.652Z Has data issue: false hasContentIssue false

A Methodological Framework for Free and Open-Source UAV-Based Archaeological Research

Published online by Cambridge University Press:  29 October 2021

Kelsey M. Reese*
Affiliation:
Department of Anthropology, University of Notre Dame, Notre Dame, IN, USA
Sean Field
Affiliation:
Department of Anthropology, University of Notre Dame, Notre Dame, IN, USA
*
(kreese1@nd.edu, corresponding author)
Rights & Permissions [Opens in a new window]

Abstract

Full-coverage pedestrian survey to record cultural features on unexplored archaeological landscapes is costly in terms of time, money, and personnel. Over the past two decades, researchers have implemented remote sensing and landscape data collection techniques using unmanned aerial vehicles (UAVs) to combat some of these burdens, but the initial cost of equipment, software, and processing power has hindered the ubiquitous implementation of UAV technology as an accessible companion tool to traditional archaeological survey. This article presents a free and open-source, technology-independent analytical framework for the collection and processing of UAV images to produce high-resolution digital terrain models limited only by the equipment available to the researcher. Results from the free and open-source protocol are directly compared to those produced using proprietary software to illustrate the capabilities of freely available data processing tools for UAV-collected images. By replicating the methods outlined here, researchers should be able to identify and target areas of interest to increase fieldwork efficiency, decrease costs of implementing this technology, and produce high-resolution digital terrain models to conduct spatial analyses that pursue a deeper understanding of cultural landscapes.

El estudio peatonal de cobertura completa para registrar características culturales en paisajes arqueológicos inexplorados es costoso en términos de tiempo, dinero y personal. A lo largo de las dos últimas décadas, los investigadores han aplicado técnicas de teledetección y recopilación de datos sobre el paisaje mediante vehículos aéreos no tripulados (UAV) para combatir algunas de estas cargas, pero el costo inicial de los equipos, el software y la capacidad de procesamiento ha dificultado la implantación generalizada de la tecnología de los UAV como herramienta complementaria accesible a la prospección arqueológica tradicional. Este ensayo presenta un marco analítico gratuito y de código abierto, independiente de la tecnología, para la recopilación y el procesamiento de imágenes de vehículos aéreos no tripulados con el fin de producir modelos digitales del terreno de alta resolución, limitados únicamente por el equipo disponible para el investigador. Los resultados del protocolo libre y de código abierto se comparan directamente con los producidos mediante software propietario para ilustrar las capacidades de las herramientas de procesamiento de datos de libre acceso para las imágenes recopiladas por los UAV. Reproduciendo los métodos aquí expuestos, los investigadores deberían ser capaces de identificar y orientar las áreas de interés para aumentar la eficacia del trabajo de campo, disminuir los costos de aplicación de esta tecnología y producir modelos del terreno de alta resolución para realizar análisis espaciales que persigan una comprensión más profunda de los paisajes culturales.

Type
How to Series
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Open Practices
Open materials
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of Society for American Archaeology

Technology currently available in consumer-level unmanned aerial vehicles (UAVs; units costing ≤US$2,000) is capable of capturing archaeological features that leave some type of topographic signature in most landcover contexts using aerial photogrammetry. UAV technology, therefore, can be usefully applied by archaeologists in most study areas to develop high-resolution digital terrain models of archaeological features of interest. To democratize (Magnani et al. Reference Magnani, Douglass, Schroder, Reeves and Braun2020) the use of UAVs in archaeological research—regardless of a researcher's technological experience or equipment access—we present a free and open-source software protocol (FOSS Protocol) for producing high-resolution digital terrain models from UAV-based photogrammetry. The FOSS Protocol covers pre-, in-, and post-field processes by providing reproducible code to define a research area of interest, determine the landcover contexts within that area of interest that are most likely to produce the best results, systematically collect images within that area, and then process the collected images to produce a high-resolution digital terrain model. Resulting terrain models can then be used to identify the presence of sites for more efficient survey and utilized in targeted spatial analyses that benefit from high-resolution digital terrain models.

We present the FOSS Protocol as an accessible aggregated toolset for systematically collecting and processing UAV imagery that is reproducible and automatically creates the highest-resolution digital terrain model based on the equipment available to the researcher. The FOSS Protocol, therefore, provides a standardized methodological framework that aggregates the tools needed for researchers to move beyond the explicit production of data and encourage its implementation in the pursuit of knowledge production. We also present a direct comparison of digital terrain models produced using the FOSS Protocol with those created using proprietary software—through a controlled case study on the Mesa Verde North Escarpment in the northern US Southwest (Figure 1)—to highlight the power of this set of freely available computational tools.

FIGURE 1. The Mesa Verde North Escarpment. The Mesa Verde North Escarpment (outlined in black) and Mesa Verde National Park (shaded in green) are located in southwestern Colorado of the northern US Southwest (inset, top left).

A FREE AND OPEN-SOURCE SOFTWARE PROTOCOL

The protocol is split into three general steps: pre-, in-, and post-field analyses that can be repeated as needed, or whenever newer technology becomes available to the researcher. The pre-field steps focus on installing all necessary frameworks, programs, and dependencies for the analysis, defining an area of study, creating spatial polygons that can be flown by the UAV available to the researcher, and exporting those polygons to the UAV remote. The in-field section provides general instructions on collecting images while in the field, and although not explicitly reproducible, the pre-field step ensures that the same information can be repeatedly collected by the same—or other—researchers. The post-field section highlights how easily images can be processed after returning from the field to produce a high-resolution digital terrain model of the study area.

Each of the short pre-, in-, and post-field sections describe the steps to execute the FOSS Protocol, and directions on how to install and execute the FOSS Protocol are provided online. Please refer to the Github repository to use the most current version.

PRE-FIELD: INSTALLING SOFTWARE AND DEFINING AN AREA OF INTEREST

The pre-field process is the most involved, requiring the installation of several programs on the project computer to create the spatial polygons that will be used while in the field for data collection. The installation instructions provided in the reproducible code are tailored to MacOS platforms, and they utilize the Homebrew file manager, although the same programs are available for PC and Linux operating systems. The protocol automatically uses the most up-to-date versions of each free and open-source software when available, and freely available software when open-source options are not available. The required frameworks and programs to run the FOSS Protocol successfully are Docker, Git, Python, GDAL, OpenDroneMap, and R. The combination of these six free and open-source programs will provide all necessary tools to process UAV-collected imagery and make high-resolution digital terrain models—for free.

After all necessary software is installed, all required R packages outlined in the reproducible code should be installed and loaded so that the study area of interest can be defined and spatial polygons exported. The process requires a shapefile that outlines a specific area of study, which can be created using freely available QGIS software if a shapefile is not already available. The reproducible code shows how to import the shapefile, divide it based on the typical battery life of the accessible UAV for the given project, download landcover data for the study area, and quantify landcover into four categories of increasingly canopied contexts. It then provides several scenarios for saving a spatial polygon for the desired UAV flight(s). These scenarios include exporting all potential flight polygons, exporting a specific polygon from a spatial grid, providing specific coordinates of an area of interest, or exporting polygons based on their landcover context.

Once the desired flight polygons have been created and saved, they should be imported into the DroneDeploy application (available for both iOS and Android) on the UAV remote, and draft flight plans can be created with each polygon. Specific flight parameters can be set up on the application before going into the field, which helps ensure a systematic and complete collection of the desired areas of interest for the study area.

Although this method provides explicit directions for using a combination of R, DroneDeploy, and OpenDroneMap, it is important to note that DroneDeploy can be substituted for any other UAV photogrammetry collection application available to the researcher that is compatible with the UAV and remote, as long as raw images are available for download after they are collected in the field. Please refer to the Github repository for alternative applications to DroneDeploy.

IN-FIELD: COLLECTING IMAGES

The setup completed in the pre-field step makes the in-field process as reproducible and easy as possible. The researcher brings the UAV to the flight area with the remote, memory card, and charged batteries, and instructs the UAV to launch from the desired flight plan within the DroneDeploy application.

POST-FIELD: PRODUCING A DIGITAL TERRAIN MODEL

After all images have been collected for each flight, images are transferred from the memory card to the project computer. Images are separated by flight collection polygon within a project folder, and within each of the flight collection polygon folders, all respective images are placed in a subfolder called “images.” Docker is then started and the OpenDroneMap algorithm is executed for images in a specified flight folder. OpenDroneMap will then produce a digital terrain model with the best resolution possible based on the images it is given. Although we provide a very simple and straightforward version of the OpenDroneMap algorithm in the reproducible code, there are a multitude of available processing options that we have not explicitly included (to ensure broad applicability), including the ability to define ground control points.

Resulting digital terrain models should then be critically examined by the researcher, and subsequent field episodes can be used to investigate previously unrecorded archaeological features, or reexamine features within the area of interest from the perspective provided in the terrain models. By repeatedly returning to the field, the researcher can also better contextualize the study area within the cultural landscape and reassess previous interpretations of the archaeological site of interest (Ainsworth et al. Reference Ainsworth, Oswald, Went, Optiz and Cowley2013; Doneus and Kühteiber Reference Doneus, Kühteiber, Optiz and Cowley2013; Halliday Reference Halliday, Optiz and Cowley2013; Poller Reference Poller, Gillings, Hacigüzeller and Lock2019). By automating the collection and processing of UAV imagery with the above protocol, data collection can be systematically repeated on-demand during site revisitation in cases of site monitoring, looting, tracking erosional changes, or if newer equipment becomes available.

COMPARING THE FOSS PROTOCOL AND PROPRIETARY SOFTWARE RESULTS

To assess the capabilities of the FOSS Protocol in comparison to leading proprietary software, we designed a controlled study that systematically collected images from the Mesa Verde North Escarpment—located in the northern US Southwest (Figure 1)—at three different flight heights in four landcover contexts, and we then processed the same groups of images using both FOSS (OpenDroneMap) and proprietary software (Agisoft PhotoScan Professional Edition). We outline this process below:

  • (1) A spatial polygon of the study area was loaded into the R environment.

  • (2) The National Landcover Dataset from the US Geological Survey was downloaded, and all types of landcover within the study area were ranked from the most-barren to the most-canopied types of vegetation.

  • (3) A numeric value was assigned to the ranked types of vegetation to reflect landcover that was most likely to produce a digital terrain model showing topographic detail (most-barren), to those that were least likely to produce topographic detail (most-canopied).

  • (4) The spatial polygon of the study area was partitioned into a 3 ha grid—a subjective number that was chosen so that all flights for a single vegetation context could be collected with the total number of batteries (3) we were able to bring into the field on a daily basis.

  • (5) The 3 ha grid was overlaid across the ranked landcover values.

  • (6) All values within each 3 ha polygon were then summed to produce a landcover “score” for each 3 ha polygon across the study area.

  • (7) The total range of scores was computed, and the minimum, maximum, and the two intermediate quartile values were identified. These are the color-coded landcover tiles shown in Figure 2, with light (green/most-barren), medium (yellow), heavy (orange), and extreme (red/most-canopied) levels of landcover. Four of these tiles were selected to be flown for this study—one in each representative landcover context (Figure 2, color-coded tiles outlined in black).

The four spatial polygons outlining each representative landcover context were then exported to the UAV controller. Flights at 20 m, 35 m, and 50 m flight heights were defined within the freely available DroneDeploy application, but all other settings within DroneDeploy were left at their default. After completing all UAV flights of a representative landcover context, a traditional full-coverage pedestrian survey of the corresponding area was performed, and all archaeological features were recorded.

FIGURE 2. Landcover classifications on the Mesa Verde North Escarpment. Representative tiles across the North Escarpment for light (green/most-barren), medium (yellow), heavy (orange), and extreme (red/most-canopied) landcover contexts, and the four tiles presented in this analysis (outlined in black, in their respective colors).

Once the data collection was completed, we processed the same images in FOSS and proprietary software using two hardware configurations (3.6 GHz 8-Core Intel Core i9 with 128 GB RAM and 2.5 GHz 12-Core Intel(R) Xeon E5 Processor with 263.5 GB RAM, respectively), and we used the automated, default vegetation-removal algorithms in each program to create the resulting digital terrain models. A comparison of the resulting digital terrain models between the FOSS and proprietary software from the “heavy” landcover context at each flight height is shown in Figure 3, and the same comparisons for the three other landcover contexts are available as Supplemental Figures 1–3.

FIGURE 3. Results from the “heavy” landcover tile. A direct comparison of the digital terrain models, with vegetation removed, created from the “heavy” landcover tile. The left column shows the results from OpenDroneMap and the right from Agisoft PhotoScan (Professional Edition), each from 20 m, 35 m, and 50 m flight heights.

The results for each of the landcover contexts show that the FOSS Protocol is as effective as the proprietary software in revealing archaeological features that leave a topographic signature in “light,” “medium,” and “heavy” landcover contexts. Archaeological features are not visible in either the FOSS or proprietary digital terrain models from the “extreme” landcover context. This result may be due to the larger elevation range within this landcover tile compared to the other three, but we expect that even if the elevation were more uniform across the area, archaeological features underneath “extreme” landcover conditions would not be detected with passive remote sensing, such as UAV-based photogrammetry. Incomplete digital terrain models in the “medium” landcover context at the 20 m flight height (Supplemental Figure 2) are a result of neither the FOSS nor proprietary software being able to combine images from two different launch locations with different starting elevations—a consequence of underestimating the combined height of elevation change and tree height over the representative landcover tile while in the field. The proprietary software did process a portion of the collected images, whereas the FOSS software did not produce any results. The other two flight heights in the “medium” landcover context, however, are presented without issue. Each terrain model created using the FOSS Protocol at the 35 m flight height with the corresponding archaeological features recorded during pedestrian survey are shown in Figure 4.

FIGURE 4. Mapped archaeological features in each landcover tile. A direct comparison of the digital terrain models in “light,” “medium,” “heavy,” and “extreme” landcover tiles collected at a 35 m flight height (left column) with the corresponding archaeological features identified during pedestrian survey (outlined in right column).

Although terrain visibility is arguably better from the FOSS software—and was produced in a shorter amount of processing time—the proprietary software consistently produced higher resolution terrain models in all flight height and landcover contexts (Table 1). Table 1 shows the results of a controlled comparison for image processing between FOSS and proprietary software, and it is meant to highlight the capabilities of freely available software. It is important to note, however, that processing times and raster resolutions will vary depending on the flight parameters for initial image collection and the exact equipment being used for processing. In our specific case, the level of resolution available in all resulting FOSS terrain models is more than adequate for identifying Ancestral Pueblo residential architecture constructed sometime between AD 900 and 1300—because this type of architecture leaves a clearly defined topographic signature. Higher-resolution digital terrain models can be more desirable depending on the types of archaeological features or artifacts that the researcher is trying to identify remotely, but unless the researcher is trying to identify small artifacts or submeter cultural features on the ground (Field et al. Reference Field, Waite and Wandsnider2017; Orengo and Garcia-Molsosa Reference Orengo and Garcia-Molsosa2019), centimeter-scale differences in resolution do not necessarily provide a proportionate return for the level of computational investment.

TABLE 1. Controlled Comparison of Run-Time and Processing Results between FOSS (ODM) and Proprietary (APP) Software.

Additionally, and counterintuitively, increased resolution in terrain models does not always result in a similar increase in visualization or accuracy of spatial analyses. Barbarash (Reference Barbarash, Buhmann, Ervin and Pietsch2012) has shown that “visualizations exhibiting a medium level of realistic detail conveyed an impression that subjects found to be only marginally less complete than . . . images with a high degree of realism detail” (Kullmann Reference Kullmann2014:3). Furthermore, Lock and Pouncett (Reference Lock and Pouncett2017) discuss how the use of high-resolution terrain models in least cost analyses actually decrease the representation of reality in resulting cost pathways. Typical least cost algorithms make decisions on paths of least resistance by calculating the difference in slope between the current cell and all surrounding cells (Tobler Reference Tobler1993; White and Surface-Evans Reference White and Surface-Evans2012), but real people on the ground do not make pathway decisions based on centimeter-scale changes in terrain elevation directly in front of their feet. Instead, they make pathway decisions based on what is visually forthcoming approximately 10 m away (Lock and Pouncett Reference Lock and Pouncett2017).

Regardless of the exact resolution of each terrain model created in this study, we can see that both the FOSS and proprietary software provide terrain models that are more than sufficient for the identification of cultural features that leave a topographic signature (Figure 4).

CONCLUSIONS

Collecting UAV-based imagery to produce high-resolution digital terrain models of localized landscapes is becoming increasingly common in archaeological research. To guide the growth of this technology in archaeological research contexts, we present the FOSS Protocol as a standardized, reproducible, and freely available aggregated toolset for collecting and processing UAV-based imagery. This collection of free and open-source software is demonstrably effective in producing high-resolution digital terrain models that are equal to—or better than—leading proprietary software. We intend for the FOSS Protocol to democratize accessibility to UAV-based data collection, and we encourage the pursuit of anthropologically based research questions with the resulting high-resolution digital terrain models.

Acknowledgments

The authors would like to thank the Department of Anthropology at the University of Notre Dame for providing the equipment and software we used in this study. We would also like to thank Brian Yaquinto for coordinating and encouraging the data collection phase of this project. All images collected for this project were done under Research Permit #C-79006 with the Bureau of Land Management, and access to these areas was facilitated by the generosity of private landowner Ann Hindmarsh. The lead author would like to thank the Santa Fe Institute for providing institutional support during the writing phase of this project. We would also like to thank Mark Golitko, Devin A. White, Matthew Sisk, and Vania Smith-Oka for substantive comments and discussion on earlier drafts of this paper.

Data Availability Statement

Spatial data used in this analysis were collected by the authors under Research Permit #C-79006 and are available upon request with permission from Brian Yaquinto at the Bureau of Land Management - Tres Rios Field Office (). Installation instructions and a reproducible example are available on Github at kmreese-io/Reese_and_Field_2021-AAP.

Supplemental Material

For supplemental material accompanying this article, visit https://doi.org/10.1017/aap.2021.27.

Supplemental Figure 1. Results from the “light” landcover tile. A direct comparison of the digital terrain models, with vegetation removed, created from the “light” landcover tile. The left column shows the results from OpenDroneMap and the right from Agisoft PhotoScan (Professional Edition), each from 20 m, 35 m, and 50 m flight heights.

Supplemental Figure 2. Results from the “medium” landcover tile. A direct comparison of the digital terrain models, with vegetation removed, created from the “medium” landcover tile. The left column shows the results from OpenDroneMap and the right from Agisoft PhotoScan (Professional Edition), each from 20 m, 35 m, and 50 m flight heights.

Supplemental Figure 3. Results from the “extreme” landcover tile. A direct comparison of the digital terrain models, with vegetation removed, created from the “extreme” landcover tile. The left column shows the results from OpenDroneMap and the right from Agisoft PhotoScan (Professional Edition), each from 20 m, 35 m, and 50 m flight heights.

Footnotes

This article has earned badges for transparent research practices: Open Materials. For details see the Data Availability Statement.

References

REFERENCES CITED

Ainsworth, Stewart, Oswald, Al, and Went, Dave 2013 Remotely Acquired, Not Remotely Sensed: Using Lidar as a Field Survey Tool. In Interpreting Archaeological Topography: Airborne Laser Scanning, 3D Data and Ground Observation, edited by Optiz, Rachel S. and Cowley, David C., pp. 206222. Oxbow Books, Oxford.10.2307/j.ctvh1dqdz.22CrossRefGoogle Scholar
Barbarash, David 2012 The Communication Value of Graphic Visualizations Prepared with Differing Levels of Detail. In Peer Reviewed Proceedings of Digital Landscape Architecture 2012, edited by Buhmann, Erich, Ervin, Stephen, and Pietsch, Matthias, pp. 499506. University of Applied Sciences, Köthen, Germany.Google Scholar
Doneus, Michael, and Kühteiber, Thomas 2013 Airborne Laser Scanning and Archaeological Interpretation – Bringing Back the People. In Interpreting Archaeological Topography: Airborne Laser Scanning, 3D Data and Ground Observation, edited by Optiz, Rachel S. and Cowley, David C., pp. 3250. Oxbow Books, Oxford.10.2307/j.ctvh1dqdz.8CrossRefGoogle Scholar
Field, Sean, Waite, Matt, and Wandsnider, LuAnn 2017 The Utility of UAVs for Archaeological Surface Survey: A Comparative Study. Journal of Archaeological Science: Reports 13:577582.Google Scholar
Halliday, Stratford 2013 I Walked, I Saw, I Surveyed, but What Did I See? . . . and What Did I Survey? In Interpreting Archaeological Topography: Airborne Laser Scanning, 3D Data and Ground Observation, edited by Optiz, Rachel S. and Cowley, David C., pp. 6375. Oxbow Books, Oxford.10.2307/j.ctvh1dqdz.10CrossRefGoogle Scholar
Kullmann, Karl 2014 Hyper-Realism and Loose-Reality: The Limitations of Digital Realism and Alternative Principles in Landscape Design and Visualization. Journal of Landscape Architecture 9(3):2031.10.1080/18626033.2014.968412CrossRefGoogle Scholar
Lock, Gary, and Pouncett, John 2017 Spatial Thinking in Archaeology: Is GIS the Answer? Journal of Archaeological Science 84:129135.10.1016/j.jas.2017.06.002CrossRefGoogle Scholar
Magnani, Matthew, Douglass, Matthew, Schroder, Whittaker, Reeves, Jonathan, and Braun, David R. 2020 The Digital Revolution to Come: Photogrammetry in Archaeological Practice. American Antiquity 85:737760.10.1017/aaq.2020.59CrossRefGoogle Scholar
Orengo, H. A., and Garcia-Molsosa, A. 2019 A Brave New World for Archaeological Survey: Automated Machine Learning- Based Potsherd Detection Using High-Resolution Drone Imagery. Journal of Archaeological Science 112:112. DOI:10.1016/j.jas.2019.105013.10.1016/j.jas.2019.105013CrossRefGoogle Scholar
Poller, Tessa 2019 The Craft of Earthwork Survey. In Re-Mapping Archaeology: Critical Perspectives, Alternative Mappings, edited by Gillings, Mark, Hacigüzeller, Piraye, and Lock, Gary, pp. 117140. Routledge, Abingdon, UK.Google Scholar
Tobler, Waldo 1993 Three Presentations on Geographical Analysis and Modeling. National Center for Geographic Information Analysis, Santa Barbara, California.Google Scholar
White, Devin A., and Surface-Evans, Sarah L. (editors) 2012 Least Cost Analysis of Social Landscapes: Archaeological Case Studies. University of Utah Press, Salt Lake City.Google Scholar
Figure 0

FIGURE 1. The Mesa Verde North Escarpment. The Mesa Verde North Escarpment (outlined in black) and Mesa Verde National Park (shaded in green) are located in southwestern Colorado of the northern US Southwest (inset, top left).

Figure 1

FIGURE 2. Landcover classifications on the Mesa Verde North Escarpment. Representative tiles across the North Escarpment for light (green/most-barren), medium (yellow), heavy (orange), and extreme (red/most-canopied) landcover contexts, and the four tiles presented in this analysis (outlined in black, in their respective colors).

Figure 2

FIGURE 3. Results from the “heavy” landcover tile. A direct comparison of the digital terrain models, with vegetation removed, created from the “heavy” landcover tile. The left column shows the results from OpenDroneMap and the right from Agisoft PhotoScan (Professional Edition), each from 20 m, 35 m, and 50 m flight heights.

Figure 3

FIGURE 4. Mapped archaeological features in each landcover tile. A direct comparison of the digital terrain models in “light,” “medium,” “heavy,” and “extreme” landcover tiles collected at a 35 m flight height (left column) with the corresponding archaeological features identified during pedestrian survey (outlined in right column).

Figure 4

TABLE 1. Controlled Comparison of Run-Time and Processing Results between FOSS (ODM) and Proprietary (APP) Software.

Supplementary material: PDF

Reese and Field supplementary material

Reese and Field supplementary material 1

Download Reese and Field supplementary material(PDF)
PDF 4.3 MB
Supplementary material: PDF

Reese and Field supplementary material

Reese and Field supplementary material 2

Download Reese and Field supplementary material(PDF)
PDF 4.5 MB
Supplementary material: PDF

Reese and Field supplementary material

Reese and Field supplementary material 3

Download Reese and Field supplementary material(PDF)
PDF 3.2 MB