Conference paper Open Access
Representation Learning for the Automatic Indexing of Sound Effects Libraries
Alison B Ma; Alexander Lerch
Labeling and maintaining a commercial sound effects library is a time-consuming task exacerbated by databases that continually grow in size and undergo taxonomy updates. Moreover, sound search and taxonomy creation are complicated by non-uniform metadata, an unrelenting problem even with the introduction of a new industry standard, the Universal Category System. To address these problems and overcome dataset-dependent limitations that inhibit the successful training of deep learning models, we pursue representation learning to train generalized embeddings that can be used for a wide variety of sound effects libraries and are a taxonomy-agnostic representation of sound. We show that a task-specific but dataset-independent representation can successfully address data issues such as class imbalance, inconsistent class labels, and insufficient dataset size, outperforming established representations such as OpenL3. Detailed experimental results show the impact of metric learning approaches and different cross-dataset training methods on representational effectiveness.
Files
(474.0 kB)
| Name | Size | |
|---|---|---|
|
000104.pdf
md5:74184accb96b48b09c6361a41d1a4591 |
474.0 kB | Download |
86
70
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 86 | 86 |
| Downloads | 70 | 70 |
| Data volume | 33.2 MB | 33.2 MB |
| Unique views | 76 | 76 |
| Unique downloads | 65 | 65 |
Indexed in
- Publication date:
- December 4, 2022
- DOI:
-
- Keyword(s):
- ismir ismir2022
- Published in:
- Proceedings of the 23rd International Society for Music Information Retrieval Conference, ISMIR, Bengaluru, India, pp. 866-875.
- Meeting:
- International Society for Music Information Retrieval Conference (ISMIR 2022), Bengaluru, India, December 4-8, 2022
- License (for files):
- Creative Commons Attribution 4.0 International