Conference paper Open Access

Representation Learning for the Automatic Indexing of Sound Effects Libraries

Alison B Ma; Alexander Lerch

Citation Style Language JSON Export

  "publisher": "ISMIR", 
  "DOI": "10.5281/zenodo.7316800", 
  "container_title": "Proceedings of the 23rd International Society for Music Information Retrieval Conference", 
  "title": "Representation Learning for the Automatic Indexing of Sound Effects Libraries", 
  "issued": {
    "date-parts": [
  "abstract": "Labeling and maintaining a commercial sound effects library is a time-consuming task exacerbated by databases that continually grow in size and undergo taxonomy updates. Moreover, sound search and taxonomy creation are complicated by non-uniform metadata, an unrelenting problem even with the introduction of a new industry standard, the Universal Category System. To address these problems and overcome dataset-dependent limitations that inhibit the successful training of deep learning models, we pursue representation learning to train generalized embeddings that can be used for a wide variety of sound effects libraries and are a taxonomy-agnostic representation of sound. We show that a task-specific but dataset-independent representation can successfully address data issues such as class imbalance, inconsistent class labels, and insufficient dataset size, outperforming established representations such as OpenL3. Detailed experimental results show the impact of metric learning approaches and different cross-dataset training methods on representational effectiveness.", 
  "author": [
      "family": "Alison B Ma"
      "family": "Alexander Lerch"
  "id": "7316800", 
  "event-place": "Bengaluru, India", 
  "publisher_place": "Bengaluru, India", 
  "type": "paper-conference", 
  "event": "International Society for Music Information Retrieval Conference (ISMIR 2022)", 
  "page": "866-875"
All versions This version
Views 110110
Downloads 9393
Data volume 44.1 MB44.1 MB
Unique views 100100
Unique downloads 8686


Cite as