A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech Recognition

Jiabin Xue, Jiqing Han, Tieran Zheng, Xiang Gao, Jiaxing Guo

Type: Preprint

Publication Date: 2019-01-01

Citations: 9

DOI: https://doi.org/10.48550/arxiv.1904.08039

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition	2023	Steven Vander Eeckt Hugo Van hamme
+	Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition	2022	Steven Vander Eeckt Hugo Van hamme
+	Using Adapters to Overcome Catastrophic Forgetting in End-to-End Automatic Speech Recognition	2022	Steven Vander Eeckt Hugo Van hamme
+	Using Adapters to Overcome Catastrophic Forgetting in End-to-End Automatic Speech Recognition	2023	Steven Vander Eeckt Hugo Van hamme
+	Towards Lifelong Learning of End-to-end ASR	2021	Heng-Jui Chang Hung-yi Lee Lin-Shan Lee
+	Towards Lifelong Learning of End-to-end ASR	2021	Heng-Jui Chang Hung-yi Lee Lin-Shan Lee
+ PDF Chat	Towards Lifelong Learning of End-to-End ASR	2021	Heng-Jui Chang Hung-yi Lee Lin-Shan Lee
+ PDF Chat	Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR Models	2022	Yuki Takashima Shota Horiguchi Shinji Watanabe Paola García Yohei Kawaguchi
+	Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR Models	2022	Yuki Takashima Shota Horiguchi Shinji Watanabe Paola Trindade Garcia Yohei Kawaguchi
+ PDF Chat	Incremental Learning for End-to-End Automatic Speech Recognition	2021	Li Fu Xiaoxiao Li Libo Zi Zhengchen Zhang Youzheng Wu Xiaodong He Bowen Zhou
+	Incremental Learning for End-to-End Automatic Speech Recognition	2020	Li Fu Xiaoxiao Li Libo Zi Zhengchen Zhang Youzheng Wu Xiaodong He Bowen Zhou
+ PDF Chat	Unsupervised Online Continual Learning for Automatic Speech Recognition	2024	Steven Vander Eeckt Hugo Van hamme
+ PDF Chat	Unsupervised Online Continual Learning for Automatic Speech Recognition	2024	Steven Vander Eeckt Hugo Van hamme
+ PDF Chat	Sequential Editing for Lifelong Training of Speech Recognition Models	2024	Devang Kulshreshtha Saket Dingliwal B. Houston Nikolaos Pappas Srikanth Ronanki
+ PDF Chat	Sequential Editing for Lifelong Training of Speech Recognition Models	2024	Devang Kulshreshtha Nikolaos Pappas B. Houston Saket Dingliwal Srikanth Ronanki
+	Continual Learning for Monolingual End-to-End Automatic Speech Recognition	2021	Steven Vander Eeckt Hugo Van hamme
+ PDF Chat	Continual Learning for Monolingual End-to-End Automatic Speech Recognition	2022	Steven Vander Eeckt Hugo Van hamme
+	Rehearsal-Free Online Continual Learning for Automatic Speech Recognition	2023	Steven Vander Eeckt Hugo Van hamme
+ PDF Chat	Continual Learning in Machine Speech Chain Using Gradient Episodic Memory	2024	Geoffrey Tyndall Kurniawati Azizah Dipta Tanaya Ayu Purwarianti Dessi Puji Lestari Sakriani Sakti
+ PDF Chat	A Parameter-efficient Language Extension Framework for Multilingual ASR	2024	Liu Wei Jingyong Hou Dong Yang Muyong Cao Tan Lee

Works That Cite This (7)

Action	Title	Year	Authors
+	Continual Learning for On-Device Speech Recognition Using Disentangled Conformers	2023	Anuj Diwan Ching-Feng Yeh Wei-Ning Hsu Paden Tomasello Eunsol Choi David Harwath Abdelrahman Mohamed
+ PDF Chat	Continual learning for recurrent neural networks: An empirical evaluation	2021	Andrea Cossu Antonio Carta Vincenzo Lomonaco Davide Bacciu
+ PDF Chat	Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting	2020	Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu
+ PDF Chat	Online Continual Learning of End-to-End Speech Recognition Models	2022	Muqiao Yang Ian Lane Shinji Watanabe
+	Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting	2020	Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu
+	Continual Speaker Adaptation for Text-to-Speech Synthesis.	2021	Hamed Hemati Damian Borth
+	Towards Lifelong Learning of End-to-end ASR	2021	Heng-Jui Chang Hung-yi Lee Lin-Shan Lee

Works Cited by This (6)

Action	Title	Year	Authors
+	Deep Speech 2: End-to-End Speech Recognition in English and Mandarin	2015	Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper Bryan Catanzaro Jingdong Chen Mike Chrzanowski Adam Coates Greg Diamos
+ PDF Chat	The microsoft 2016 conversational speech recognition system	2017	Wayne Xiong Jasha Droppo Xuedong Huang Frank Seide Michael L. Seltzer Andreas Stolcke Dong Yu Geoffrey Zweig
+	Overcoming catastrophic forgetting in neural networks	2017	James Kirkpatrick Razvan Pascanu Neil C. Rabinowitz Joel Veness Guillaume Desjardins Andrei A. Rusu Kieran Milan John Quan Tiago Ramalho Agnieszka Grabska‐Barwińska
+ PDF Chat	Building Competitive Direct Acoustics-to-Word Models for English Conversational Speech Recognition	2018	Kartik Audhkhasi Brian Kingsbury Bhuvana Ramabhadran George Saon Michael Picheny
+	Lifelong Learning with Dynamically Expandable Networks	2017	Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang
+	Adam: A Method for Stochastic Optimization	2014	Diederik P. Kingma Jimmy Ba