Published June 12, 2023 | Version v1
Software Open

Crowdsourced dataset of firefly trajectories obtained by automated stereo calibration of 360-degree cameras

  • 1. University of Colorado Boulder
  • 2. University of New Mexico
  • 3. Harvard University
  • 4. Tennessee Wildlife Resources Agency
  • 5. WildWork*
  • 6. Nature Conservancy
  • 7. ,
  • 8. Xerces Society
  • 9. Delaware Division of Fish and Wildlife*
  • 10. Pennsylvania Firefly Festival, Inc.*
  • 11. FireflyExperience.org*

Description

Advancements in animal tracking techniques, spanning from migrating mammals to swarming insects, have resulted in remarkable progress in the fields of behavioral ecology and conservation science. Recently, we have devised a method for tracking luminous fireflies in their natural habitat using stereoscopic pairs of 360-degree cameras. This method offers affordability, versatility, and ease of setup; however, the process of camera calibration has remained tedious and time-consuming. Now, we have introduced an enhanced algorithm that achieves spatial and temporal stereo calibration directly from the data, eliminating the need for manual procedures both in the field and during video processing. The algorithm relies on cross-correlation of flashing patterns and numerical estimation of camera pose. Utilizing this improved protocol and processing software, we have compiled an extensive dataset comprising over 100 reconstructed firefly swarms of various species. This data was gathered throughout the United States by numerous contributors following a straightforward protocol. The dataset holds significant potential for advancing our comprehension of firefly collective behavior, facilitating population monitoring, and expanding citizen science initiatives.

Notes

Table 1 provides a summary of the full dataset. Each swarm has been attributed a specific identification (ID) number for convenient referencing. ID numbers are constructed as such: they start with the letter 's' (short for "swarm") to avoid compatibility issues with file names starting with a number; four digits follow indicating the date of recording in YMDD format (first digit is year: 0 for 2020, 1 for 2021, 2 for 2022; second digit is month of the year; two last digits indicate day of the corresponding month); a two-letter code to indicate the (predominant) species recorded. 

Tables 1 and 2 provide primary information regarding each dataset, in particular the date, time and location of collection, along with the scaling parameter necessary to convert video units to meters. GPS coordinates of recording sites are provided whenever they seemed appropriate to share publicly, based on considerations of private property, site sensitivity, etc. Tables 3 and 4 provide secondary contextual information, such as predominant species recorded, sunset time (civil twilight), weather conditions, and other brief field notes.

Each swarm, with its specific ID, has a separate zip file, named by as 'ID.zip'. Within each zip file, the main file of interest is a .csv file containing the coordinates of reconstructed flashes. In addition, Matlab structures (ending in '.mat') are made available. They contain all the intermediate data used in the course of the processing, notably the input parameters for processing. Finally, a folder called 'info' contains the metadata for the video files (when available) and a picture of the background in each of the cameras' field of view (when available). See Usages Notes for a description of the different files.

Usage Notes

.csv files
The xyztkj.csv files contain the coordinates of reconstructed swarms. The first three columns are the xyz coordinates; x and y define the horizontal plane, and z defines the vertical axis oriented upwards. Units are meters. The fourth column represents the corresponding times, in seconds. The fifth column k indicates the streak identity of a flash. The sixth column j indicates the corresponding trajectory.

We emphasize that these coordinates are only partial renderings of the entire swarm. Due to the cameras' limited light 
sensitivity and visual occlusion from the vegetation, only flashes close enough (typically within 10–15 m) can be recorded corresponding to a fraction of swarms which can span several tens of meters

.html files
The .html files can be loaded in a web browser for quick 3D visualization of the reconstructed swarm. 

.mat files
The .mat Matlab structure files serve to provide additional processing parameters and intermediate results. All values under the .prm field are input parameters. Values in other fields are the outputs from the different processing steps. These files also allow to re-run the triangulate and trajectorize blocks with different parameters, if necessary (see below).

sphirefly3d software
The software can run from scratch as out = sphirefly3d([s,h]), where s and h are the only necessary inputs corresponding to the real-world spacing and height of the cameras. A window will then open where complementary movies, or folders containing sequences of movies, can be selected. All other parameters can be changed directly from the setprm.m function. Alternatively, an existing sff structure can be used as input, to re-run some parts of the processing: out = sphirefly3d(sff).

Funding provided by: National Geographic Society
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100006363
Award Number: NGS-84850T-21

Funding provided by: Research Cooperation for Science Advancement*
Crossref Funder Registry ID:
Award Number: 28219

Files

Files (49.5 kB)

Name Size Download all
md5:ac02969f25bd2eef9155791c2b8a9db3
540 Bytes Download
md5:016d1bdbccbe7cf45774f1fae288bead
1.5 kB Download
md5:f2cf12ac32881980235b870e8be6d681
2.3 kB Download
md5:002aa195b29a4b1eedeb35910f7fdb91
2.0 kB Download
md5:abdbe62e27890f3b923eb394bd5bb4b1
11.2 kB Download
md5:9adf90ebd4c8e6fe01ae296c06a26b73
1.9 kB Download
md5:ecc09145f9a32b4e734b4e9d013e3ee7
6.2 kB Download
md5:bace1dd2a1a1052bf4fe98be2b6f6f89
4.9 kB Download
md5:93989b1c322edbdccb33a6406275d789
2.5 kB Download
md5:8c2656f090ed55e20b375a43bb24ea39
2.2 kB Download
md5:077ee7f04c82411b79a31d9b93694b0d
2.7 kB Download
md5:9a1fe1683ee2239a6098454c8874d9b4
746 Bytes Download
md5:8d7c4ed448acca70114a06bd54eeacef
333 Bytes Download
md5:d808201270558b85df9788d77e317baa
985 Bytes Download
md5:92da0a0799b0b249f4a200661958fa6a
9.5 kB Download

Additional details

Related works

Is cited by
10.1101/2021.04.07.438867 (DOI)
Is source of
10.5061/dryad.gb5mkkwvd (DOI)