Published February 8, 2022 | Version v1
Software Open

Automated bird sound classifications of long-duration recordings produce occupancy model outputs similar to manually annotated data

  • 1. The Institute for Bird Populations
  • 2. National Audubon Society
  • 3. California Department of Parks and Recreation

Description

Occupancy modeling is used to evaluate avian distributions and habitat associations, yet it typically requires extensive survey effort because a minimum of three repeat samples are required for accurate parameter estimation. Autonomous recording units (ARUs) can reduce the need for surveyors on site, yet ARUs utility were limited by hardware costs and the time required to manually annotate recordings. Software that identifies bird vocalizations may reduce expert time needed, if classification is sufficiently accurate. We assessed the performance of BirdNET – an automated classifier capable of identifying vocalizations from >900 North American and European bird species – by comparing automated to manual annotations of recordings of 13 breeding bird species collected in northwestern California. We compared the parameter estimates of occupancy models evaluating habitat associations supplied with manually annotated data (9 min recording segments) to output from models supplied with BirdNET detections. We used three sets of BirdNET output to evaluate the duration of automatic annotation needed to approach manually annotated model parameter estimates: 9-min, 87-min, and 87-min of high-confidence detections. We incorporated 100 3-sec manually validated BirdNET detections per species to estimate true and false positive rates within an occupancy model. BirdNET correctly identified 90% and 65% of the bird species a human detected when data were restricted to detections exceeding a low or high confidence score threshold, respectively. Occupancy estimates, including habitat associations, were similar regardless of method. Precision (proportion of true positives to all detections) was >0.70 for 9 of 13 species, and a low of 0.29. However, processing of longer recordings was needed to rival manually annotated data. We conclude that BirdNET is suitable for annotating multispecies recordings for occupancy modeling when extended recording durations are used. Together, ARUs and BirdNET may benefit monitoring and, ultimately, conservation of bird populations by greatly increasing monitoring opportunities.   

Notes

The usage details for files are included in the comments of R code files included in this repository. Data files are supplied inside a zipped folder (Data.zip) that contains a subfolders with files needed for reproducing results in the text. All files included in the repository with the .R suffix are R scripts for running occupancy models and generating data summaries. See README file for more details.

Files

Files (121.8 kB)

Name Size Download all
md5:36506455c320db9ddec8687c7dbfcb25
9.9 kB Download
md5:cdc6512040e1afd1599a463d78191b3b
16.7 kB Download
md5:7f212511143e1414bf8899bf807affb2
14.9 kB Download
md5:fafe01640c306965319eeff9c47e620e
9.5 kB Download
md5:30769d2e682bff0a1ef1cf0096bdd62d
8.3 kB Download
md5:3d2be79076d5c45e73240f7a1c93ebe5
19.3 kB Download
md5:404115f07875c1d69410016692fe2814
17.9 kB Download
md5:f933c225e3c03b39d9d3cbe076b352a7
17.2 kB Download
md5:0ae3e430ccb9f680d8c2dc000f507ff6
8.1 kB Download

Additional details

Related works

Is source of
10.5061/dryad.x95x69pkr (DOI)