Behavioural Projects Overview
SWC/GCNU Neuroinformatics Unit
RSEs working on behaviour
Tracking fiddler crabs in the field
Common workflows
Markerless pose estimation
Supporting & teaching pose estimation tools at SWC
- We have deployed DeepLabCut & SLEAP as HPC modules.
- We provide regular hands-on training on using SLEAP.
What about other CV tasks?
Computer vision (CV) tasks other than pose estimation are less accessible.
- Mix-and-match computer vision tools for animal behaviour analysis.
- Still under early development (talk to Sofía!)
What happens after tracking?
movement overview
movement example applications
movement outlook
More advanced methods for outlier detection & smoothing
- ⏳ EKS >
movementdata loader (in progress, PR #670) - 🤔 Incorporate approaches from LightningPose & EKS
Modules for specialised applications
- 🤔 gait analysis, pupillometry, collective behaviour
What about behaviour segmentation?
We have explored some existing tools:
- keypoint-moseq (unsupervised)
- JABS-behavior-classifier (supervised)
Would love to hear your experiences with others!
No single go-to solution yet
🤔 Is there scope for collaborating on improving existing tools or developing a new robust, easy-to-use interface for behaviour segmentation?
Some remaining challenges
1. We are generating and storing vast amounts of video data.
Determine & share best practices for video compression.
2. Requirements for manual data annotation are honerous.
- Can we leverage self-supervised pre-training like beast?
- Sofía would be interested in making
beastmore plug-and-play for various CV tasks.
