MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models

February 09, 2024 Β· Declared Dead Β· πŸ› International Joint Conference on Artificial Intelligence

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco A. MartΓ­nez-RamΓ­rez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon arXiv ID 2402.06178 Category cs.SD: Sound Cross-listed cs.AI, cs.MM, eess.AS Citations 44 Venue International Joint Conference on Artificial Intelligence Last Checked 3 months ago
Abstract
Recent advances in text-to-music generation models have opened new avenues in musical creativity. However, music generation usually involves iterative refinements, and how to edit the generated music remains a significant challenge. This paper introduces a novel approach to the editing of music generated by such models, enabling the modification of specific attributes, such as genre, mood and instrument, while maintaining other aspects unchanged. Our method transforms text editing to \textit{latent space manipulation} while adding an extra constraint to enforce consistency. It seamlessly integrates with existing pretrained text-to-music diffusion models without requiring additional training. Experimental results demonstrate superior performance over both zero-shot and certain supervised baselines in style and timbre transfer evaluations. Additionally, we showcase the practical applicability of our approach in real-world music editing scenarios.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Sound

Died the same way β€” πŸ‘» Ghosted