DeepFly3D, a deep learning-based approach for 3D limb and appendage tracking in tethered, adult .

DeepFly3D, a deep learning-based approach for 3D limb and appendage tracking in tethered, adult .

Günel, Semih;Rhodin, Helge;Morales, Daniel;Campagnolo, João;Ramdya, Pavan;Fua, Pascal;
eLife 2019 Vol. 8
203
gunel2019deepfly3delife

Abstract

Studying how neural circuits orchestrate limbed behaviors requires the precise measurement of the positions of each appendage in three-dimensional (3D) space. Deep neural networks can estimate two-dimensional (2D) pose in freely behaving and tethered animals. However, the unique challenges associated with transforming these 2D measurements into reliable and precise 3D poses have not been addressed for small animals including the fly, . Here, we present DeepFly3D, a software that infers the 3D pose of tethered, adult using multiple camera images. DeepFly3D does not require manual calibration, uses pictorial structures to automatically detect and correct pose estimation errors, and uses active learning to iteratively improve performance. We demonstrate more accurate unsupervised behavioral embedding using 3D joint angles rather than commonly used 2D pose data. Thus, DeepFly3D enables the automated acquisition of behavioral measurements at an unprecedented level of detail for a variety of biological applications.

Citation

ID: 100053
Ref Key: gunel2019deepfly3delife
Use this key to autocite in SciMatic or Thesis Manager

References

Blockchain Verification

Account:
NFT Contract Address:
0x95644003c57E6F55A65596E3D9Eac6813e3566dA
Article ID:
100053
Unique Identifier:
10.7554/eLife.48571
Network:
Scimatic Chain (ID: 481)
Loading...
Blockchain Readiness Checklist
Authors
Abstract
Journal Name
Year
Title
5/5
Creates 1,000,000 NFT tokens for this article
Token Features:
  • ERC-1155 Standard NFT
  • 1 Million Supply per Article
  • Transferable via MetaMask
  • Permanent Blockchain Record
Blockchain QR Code
Scan with Saymatik Web3.0 Wallet

Saymatik Web3.0 Wallet