Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- bioacoustics
|
| 5 |
+
- few-shot-learning
|
| 6 |
+
- prototypical-networks
|
| 7 |
+
- bird-identification
|
| 8 |
+
- individual-identification
|
| 9 |
+
- audio
|
| 10 |
+
- mel-spectrogram
|
| 11 |
+
datasets:
|
| 12 |
+
- custom
|
| 13 |
+
language:
|
| 14 |
+
- en
|
| 15 |
+
pipeline_tag: audio-classification
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
# MUNIN: Metric-learning Unit for Non-invasive Individual Naming
|
| 19 |
+
|
| 20 |
+
Lightweight few-shot learning for acoustic individual identification in birds. A ResNet18 encoder trained from scratch on mel spectrograms using episodic prototypical learning.
|
| 21 |
+
|
| 22 |
+
## Key Result
|
| 23 |
+
|
| 24 |
+
MUNIN (11M parameters, 512-d embeddings) achieves parity with BirdNET (pretrained on 6,000+ species, 1024-d) for individual bird identification:
|
| 25 |
+
|
| 26 |
+
| Setting | MUNIN | BirdNET | Perch |
|
| 27 |
+
|---------|-------|---------|-------|
|
| 28 |
+
| 1-shot | **85.0%** | 81.4% | 80.4% |
|
| 29 |
+
| 3-shot | 89.9% | **91.5%** | 90.8% |
|
| 30 |
+
| 5-shot | 93.9% | **94.1%** | 92.8% |
|
| 31 |
+
|
| 32 |
+
TOST equivalence at 5-shot within +/-2pp margin (p=0.0013). Evaluated on 9 held-out individuals across 3 species.
|
| 33 |
+
|
| 34 |
+
## Checkpoints
|
| 35 |
+
|
| 36 |
+
| File | Description |
|
| 37 |
+
|------|-------------|
|
| 38 |
+
| | **MUNIN flagship** -- best 5-shot model (93.9%) |
|
| 39 |
+
| | 3-shot variant (89.9%) |
|
| 40 |
+
| | 1-shot variant (85.0%, leads BirdNET) |
|
| 41 |
+
|
| 42 |
+
## Usage
|
| 43 |
+
|
| 44 |
+
|
| 45 |
+
|
| 46 |
+
## Input Format
|
| 47 |
+
|
| 48 |
+
- Mono audio at 22050 Hz
|
| 49 |
+
- Mel spectrogram: 128 bins, 1.5s clips (65 frames)
|
| 50 |
+
- Shape:
|
| 51 |
+
|
| 52 |
+
## Training
|
| 53 |
+
|
| 54 |
+
- Episodic prototypical learning (5-way 5-shot)
|
| 55 |
+
- 27 training individuals across 3 species (cockatoo, penguin, little owl)
|
| 56 |
+
- 50 epochs, 200 episodes/epoch, cosine annealing LR
|
| 57 |
+
- Trained on consumer GPU (RTX 4070, ~15 min)
|
| 58 |
+
|
| 59 |
+
## Paper
|
| 60 |
+
|
| 61 |
+
Preprint: [MUNIN: Lightweight few-shot learning achieves parity with large pretrained encoders for acoustic individual identification in birds](https://github.com/j8ckfi/MUNIN)
|
| 62 |
+
|
| 63 |
+
## Citation
|
| 64 |
+
|
| 65 |
+
|