Published January 28, 2020 | Version v1
Dataset Open

Characterizing long-range search behavior in Diptera using complex 3D virtual environments

  • 1. Tata Institute of Fundamental Research
  • 2. Bielefeld University

Description

The exemplary search capabilities of flying insects have established them as one of the most diverse taxa on Earth. However, we still lack the fundamental ability to quantify, represent, and predict trajectories under natural contexts to understand search and its applications. For example, flying insects have evolved in complex multimodal 3D environments, but we do not yet understand which features of the natural world are used to locate distant objects. Here, we independently and dynamically manipulate 3D objects, airflow fields, and odor plumes in virtual reality over large spatial and temporal scales. We demonstrate that that flies make use of features such as foreground segmentation, perspective, motion parallax, and integration of multiple modalities to navigate to objects in a complex 3D landscape while in flight. We first show that tethered flying insects of multiple species navigate to virtual 3D objects. Using the apple fly, Rhagoletis pomonella, we then measure their reactive distance to objects and show that these flies use perspective and local parallax cues to distinguish and navigate to virtual objects of different sizes and distances. We also show that apple flies can orient in the absence of optic flow by using only directional airflow cues, and require simultaneous odor and directional airflow input for plume following to a host volatile blend. The elucidation of these features unlocks the opportunity to quantify parameters underlying insect behavior such as reactive space, optimal foraging, and dispersal, as well as develop strategies for pest management, pollination, robotics and search algorithms.

Notes

INCLUDED FILES:

ARENA FILES:

MultiMoVR Setup.zip:  Design files and software installation guide for MultiMoVR setup.

DATA FILES:

FILE NAME FILE DESCRIPTION
mos_vision.h5 Mosquito to tree
hover_vision.h5 Hover fly to flower
crane_vision.h5 Crane fly to tree
apple_wind.h5 Apple fly to wind 
apple_odor.h5 Apple fly to odor
apple_motionParallax.h5 Apple fly to motion parallax trees
apple_vision.h5 Apple fly to tree

DESCRIPTION OF COLUMNS FOR EACH DATA FILE:

COLUMN NAME COLUMN DESCRIPTION
trajectory__DCoffset The DC offset to adjust for side bias in tethering and alignment
trajectory__boutFrame Frame number of a given trial
trajectory__case The condition of the trial. No tree, tree of left, tree on right, tree on both sides
trajectory__gain The gain, in rad/deg/frame. Multiple by 2.89 to get it in conventional units (deg/deg/s)
trajectory__headingControl True when in closed loop for heading
trajectory__o1Pos_x Object1 pos x
trajectory__o1Pos_y Object1 pos y
trajectory__o1Pos_z Object1 pos z
trajectory__o2Pos_x Object2 pos x
trajectory__o2Pos_y Object2 pos y
trajectory__o2Pos_z Object2 pos z
trajectory__pOri_x Insect heading
trajectory__pOri_y Insect pitch
trajectory__pOri_z Insect roll
trajectory__pPos_x Insect pos x
trajectory__pPos_y Insect pos y
trajectory__pPos_z Insect pos z
trajectory__pfStimState State of odor valve
trajectory__reset True when change of trial
trajectory__runNum Run number for an entire set of all case trials
trajectory__speed Insect speed
trajectory__speedControl True when in closed loop for speed control
trajectory__valve1 Valve1 odor bottle
trajectory__valve2 Valve2 odor bottle
trajectory__valve3 Valve3 odor bottle
trajectory__wbad Wing Beat Amplitude Difference, L-R, in radians
trajectory__wbas Wing Beat Amplitude Sum, L+R, in radians

Funding provided by: Science and Engineering Research Board
Crossref Funder Registry ID: http://dx.doi.org/10.13039/501100001843
Award Number: Ramanujan Fellowship

Funding provided by: Microsoft Research
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100006112
Award Number: Shannon Olsson

Funding provided by: Tata Institute of Fundamental Research
Crossref Funder Registry ID: http://dx.doi.org/10.13039/501100001405
Award Number: Graduate Research Fellowship

Funding provided by: Hochschule Bremen
Crossref Funder Registry ID: http://dx.doi.org/10.13039/501100018744
Award Number: Internship Fellowship

Files

MultiMoVR_Setup.zip

Files (2.9 GB)

Name Size Download all
md5:5fc4f99970c37284e50d32e6c523ef6a
282.5 MB Download
md5:4a5dfbfa2e5febdc0ce916fe64add009
277.5 MB Download
md5:d783516fd58194a77f1c05ee143b56b3
1.4 GB Download
md5:5aeb262ce00d3295bd665ccae9ec84b6
780.7 MB Download
md5:1c61605328eb43846697f08bdd9e8f6b
66.7 MB Download
md5:1765a4691672555516bbb30d2a2dbbe8
66.1 MB Download
md5:b5641c39b7f1fbc2576578766af1ca09
29.2 MB Download
md5:1380024f0f0ade4797a5336b9ab4617c
272.6 kB Preview Download