Modeling Nonlinear Audio Effects with End-to-end Deep Neural Networks

Type: Article

Publication Date: 2019-04-17

Citations: 30

DOI: https://doi.org/10.1109/icassp.2019.8683529

Abstract

In the context of music production, distortion effects are mainly used for aesthetic reasons and are usually applied to electric musical instruments. Most existing methods for nonlinear modeling are often either simplified or optimized to a very specific circuit. In this work, we investigate deep learning architectures for audio processing and we aim to find a general purpose end-to-end deep neural network to perform modeling of nonlinear audio effects. We show the network modeling various nonlinearities and we discuss the generalization capabilities among different instruments.

Locations

  • arXiv (Cornell University) - View - PDF
  • Queen Mary Research Online (Queen Mary University of London) - View - PDF
  • ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - View

Similar Works

Action Title Year Authors
+ Modeling of nonlinear audio effects with end-to-end deep neural networks 2018 Marco A. MartĂ­nez RamĂ­rez
Joshua D. Reiss
+ Modeling of nonlinear audio effects with end-to-end deep neural networks 2018 Marco A. MartĂ­nez RamĂ­rez
Joshua D. Reiss
+ Exploring Quality and Generalizability in Parameterized Neural Audio Effects 2020 William Mitchell
Scott H. Hawley
+ Exploring Quality and Generalizability in Parameterized Neural Audio Effects 2020 William Mitchell
Scott H. Hawley
+ Efficient Neural Networks for Real-time Analog Audio Effect Modeling. 2021 Christian J. Steinmetz
Joshua D. Reiss
+ PDF Chat Lightweight and Interpretable Neural Modeling of an Audio Distortion Effect Using Hyperconditioned Differentiable Biquads 2021 Shahan Nercessian
Andy M. Sarroff
Kurt James Werner
+ Lightweight and interpretable neural modeling of an audio distortion effect using hyperconditioned differentiable biquads 2021 Shahan Nercessian
Andy M. Sarroff
Kurt James Werner
+ Lightweight and interpretable neural modeling of an audio distortion effect using hyperconditioned differentiable biquads 2021 Shahan Nercessian
Andy M. Sarroff
Kurt James Werner
+ Modelling black-box audio effects with time-varying feature modulation 2022 Marco ComunitĂ 
Christian J. Steinmetz
Huy Phan
Joshua D. Reiss
+ Modelling Black-Box Audio Effects with Time-Varying Feature Modulation 2023 Marco ComunitĂ 
Christian J. Steinmetz
Huy Phan
Joshua D. Reiss
+ PDF Chat Differentiable Signal Processing With Black-Box Audio Effects 2021 Marco A. MartĂ­nez RamĂ­rez
Oliver Wang
Paris Smaragdis
Nicholas J. Bryan
+ Differentiable Signal Processing With Black-Box Audio Effects 2021 Marco A. MartĂ­nez RamĂ­rez
Oliver Wang
Paris Smaragdis
Nicholas J. Bryan
+ Differentiable Signal Processing With Black-Box Audio Effects 2021 Marco A. MartĂ­nez RamĂ­rez
Oliver Wang
Paris Smaragdis
Nicholas J. Bryan
+ A general-purpose deep learning approach to model time-varying audio effects 2019 M Martinez Ramirez
Emmanouil Benetos
Julia Reiss
+ PDF Chat PyNeuralFx: A Python Package for Neural Audio Effect Modeling 2024 Yen-Tung Yeh
Wen-Yi Hsiao
Yi‐Hsuan Yang
+ PDF Chat Modeling Plate and Spring Reverberation Using A DSP-Informed Deep Neural Network 2020 Marco A. MartĂ­nez RamĂ­rez
Emmanouil Benetos
Joshua D. Reiss
+ SignalTrain: Profiling Audio Compressors with Deep Neural Networks 2019 Scott H. Hawley
Benjamin Colburn
Stylianos Ioannis Mimilakis
+ PDF Chat Deep Learning-Based Approach for Identification and Compensation of Nonlinear Distortions in Parametric Array Loudspeakers 2024 Mengtong Li
Tao Zhuang
Chaoyu Chen
Jiaxin Zhong
Jing LĂź
+ PDF Chat Comparative Study of Recurrent Neural Networks for Virtual Analog Audio Effects Modeling 2024 Riccardo Simionato
Stefano Fasciani
+ Style Transfer for Non-differentiable Audio Effects 2023 K. D. Grant