Towards Training Music Taggers on Synthetic Data

July 02, 2024 ยท Entered Twilight ยท ๐Ÿ› International Conference on Content-Based Multimedia Indexing

๐Ÿ’ค TWILIGHT: Eternal Rest
Repo abandoned since publication

Repo contents: .gitignore, README.md, artist_filtered_splits, check_features.py, classify_gtzan.py, extract_features.py, generate_descriptions.py, generate_synth_GTZAN.py, music_tagger.py, plot_confusion_matrices.py, plot_embeddings.py, predict.py, predict_da.py, requirements.txt, train.py, with_da.png, without_da.png

Authors Nadine Kroher, Steven Manangu, Aggelos Pikrakis arXiv ID 2407.02156 Category cs.SD: Sound Cross-listed cs.AI, cs.IR, cs.LG, eess.AS Citations 1 Venue International Conference on Content-Based Multimedia Indexing Repository https://github.com/NadineKroher/music-tagging-synthetic-data-cbmi-2024 Last Checked 1 month ago
Abstract
Most contemporary music tagging systems rely on large volumes of annotated data. As an alternative, we investigate the extent to which synthetically generated music excerpts can improve tagging systems when only small annotated collections are available. To this end, we release GTZAN-synth, a synthetic dataset that follows the taxonomy of the well-known GTZAN dataset while being ten times larger in data volume. We first observe that simply adding this synthetic dataset to the training split of GTZAN does not result into performance improvements. We then proceed to investigating domain adaptation, transfer learning and fine-tuning strategies for the task at hand and draw the conclusion that the last two options yield an increase in accuracy. Overall, the proposed approach can be considered as a first guide in a promising field for future research.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Sound