From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview

Type: Preprint

Publication Date: 2024-11-30

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2412.00571

Abstract

As Artificial Intelligence (AI) technologies continue to evolve, their use in generating realistic, contextually appropriate content has expanded into various domains. Music, an art form and medium for entertainment, deeply rooted into human culture, is seeing an increased involvement of AI into its production. However, the unregulated use of AI music generation (AIGM) tools raises concerns about potential negative impacts on the music industry, copyright and artistic integrity, underscoring the importance of effective AIGM detection. This paper provides an overview of existing AIGM detection methods. To lay a foundation to the general workings and challenges of AIGM detection, we first review general principles of AIGM, including recent advancements in deepfake audios, as well as multimodal detection techniques. We further propose a potential pathway for leveraging foundation models from audio deepfake detection to AIGM detection. Additionally, we discuss implications of these tools and propose directions for future research to address ongoing challenges in the field.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat M6: Multi-generator, Multi-domain, Multi-lingual and cultural, Multi-genres, Multi-instrument Machine-Generated Music Detection Databases 2024 Yupei Li
Hui Li
Lucia Specia
Björn Schüller
+ PDF Chat Detecting Machine-Generated Music with Explainability -- A Challenge and Early Benchmarks 2024 Yupei Li
Qiyang Sun
Hui Li
Lucia Specia
Björn Schüller
+ PDF Chat Applications and Advances of Artificial Intelligence in Music Generation:A Review 2024 Yanxu Chen
Huang Lin-shu
Tian Gou
+ A Comprehensive Survey for Evaluation Methodologies of AI-Generated Music 2023 Zeyu Xiong
Weitao Wang
Jing Yu
Yue Lin
Ziyan Wang
+ A Survey of AI Music Generation Tools and Models 2023 Yueyue Zhu
Jared Baca
Banafsheh Rekabdar
Reza Rawassizadeh
+ PDF Chat AI-Generated Music Detection and its Challenges 2025 Darius Afchar
Gabriel Meseguer-Brocal
Romain Hennequin
+ PDF Chat A Survey of Music Generation in the Context of Interaction 2024 Ismael Agchar
Ilja Baumann
Franziska Braun
Paula Andrea Pérez-Toro
Korbinian Riedhammer
Sebastian Trump
Martin Ullrich
+ PDF Chat SONICS: Synthetic Or Not -- Identifying Counterfeit Songs 2024 Md Awsafur Rahman
Zaber Ibn Abdul Hakim
Najibul Haque Sarker
Bishmoy Paul
Shaikh Anowarul Fattah
+ JS Fake Chorales: a Synthetic Dataset of Polyphonic Music with Human Annotation 2021 Omar Peracha
+ PDF Chat Prevailing Research Areas for Music AI in the Era of Foundation Models 2024 Megan Wei
Mateusz Modrzejewski
Aswin Sivaraman
Dorien Herremans
+ PDF Chat Audio-Based Musical Version Identification: Elements and challenges 2021 Furkan Yesiler
Guillaume Doras
Rachel Bittner
Christopher J. Tralie
Joan Serrà
+ The "Horse'' Inside: Seeking Causes Behind the Behaviours of Music Content Analysis Systems 2016 Bob L. Sturm
+ MARBLE: Music Audio Representation Benchmark for Universal Evaluation 2023 Ruibin Yuan
Yinghao Ma
Yizhi Li
Ge Zhang
Xingran Chen
Hanzhi Yin
Le Zhuo
Yiqi Liu
Jiawen Huang
Zeyue Tian
+ PDF Chat A Functional Taxonomy of Music Generation Systems 2017 Dorien Herremans
Ching‐Hua Chuan
Elaine Chew
+ PDF Chat Did You Hear That? Introducing AADG: A Framework for Generating Benchmark Data in Audio Anomaly Detection 2024 Krishnan Raghavan
Samiran Gode
Ankit Shah
S. Raghavan
Wolfram Burgard
Bhiksha Raj
Rita Singh
+ PDF Chat Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South 2024 A Mehta
Shivam Chauhan
Monojit Choudhury
+ PDF Chat Machine Learning Techniques in Automatic Music Transcription: A Systematic Survey 2024 Fatemeh Jamshidi
Gary R. Pike
Amit Kumar Das
Richard Chapman
+ Generative AI for Music and Audio 2024 Hao‐Wen Dong
+ musicaiz: A Python Library for Symbolic Music Generation, Analysis and Visualization 2022 Carlos Hernandez-Olivan
José Ramón Beltrán
+ LooPy: A Research-Friendly Mix Framework for Music Information Retrieval on Electronic Dance Music 2023 Xinyu Li

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (0)

Action Title Year Authors