Published February 27, 2021 | Version v1.1.0
Software Open

dannce (3-dimensional aligned neural network for computational ethology)

  • 1. Duke University
  • 2. Massachusetts Institute of Technology
  • 3. Harvard University
  • 4. The Rockefeller University
  • 5. Columbia University

Description

DANNCE (3-Dimensional Aligned Neural Network for Computational Ethology) is a convolutional neural network (CNN) that calculates the 3D positions of user-defined anatomical landmarks on behaving animals from videos taken at multiple angles. The key innovation of DANNCE compared to existing approaches for 2D keypoint detection in animals (e.g. DeepLabCut) is that the network is fully 3D, so that it can learn about 3D image features and how cameras and landmarks relate to one another in 3D space. We also pre-trained DANNCE using a large dataset of rat motion capture and synchronized video, so the standard network has extensive prior knowledge of rodent motions and poses. DANNCE's ability to track landmarks transfers well to mice and other mammals, and works across different camera views, camera types, and illumination conditions.

Files

dannce-1.1.0.zip

Files (624.2 MB)

Name Size Download all
md5:831f6edd5e11e82f253657df1cd89d30
624.2 MB Preview Download