The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling

Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux

Type: Preprint

Publication Date: 2020-01-01

Citations: 49

DOI: https://doi.org/10.48550/arxiv.2011.11588

View Publication

Locations

arXiv (Cornell University) - View
HAL (Le Centre pour la Communication Scientifique Directe) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling	2020	Tu Anh Nguyen Maureen de Seyssel Patricia Rozé Morgane Rivière E. V. Kharitonov Alexei Baevski Ewan Dunbar Emmanuel Dupoux
+	The Zero Resource Speech Challenge 2021: Spoken language modelling	2021	Ewan Dunbar Mathieu Bernard Nicolas Hamilakis Tu Anh Nguyen Maureen de Seyssel Patricia Rozé Morgane Rivière Eugene Kharitonov Emmanuel Dupoux
+ PDF Chat	The Zero Resource Speech Challenge 2021: Spoken Language Modelling	2021	Ewan Dunbar Mathieu Bernard Nicolas Hamilakis Tu Anh Nguyen Maureen de Seyssel Patricia Rozé Morgane Rivière Eugene Kharitonov Emmanuel Dupoux
+	The Interspeech Zero Resource Speech Challenge 2021: Spoken language modelling.	2021	Ewan Dunbar Mathieu Bernard Nicolas Hamilakis Tu Anh Nguyen Maureen de Seyssel Patricia Rozé Morgane Rivière Eugene Kharitonov Emmanuel Dupoux
+ PDF Chat	Pretraining Approaches for Spoken Language Recognition: TalTech Submission to the OLR 2021 Challenge	2022	Tanel Alumäe Kunnar Kukk
+	Pretraining Approaches for Spoken Language Recognition: TalTech Submission to the OLR 2021 Challenge	2022	Tanel Alumäe Kunnar Kukk
+ PDF Chat	Self-Supervised Language Learning From Raw Audio: Lessons From the Zero Resource Speech Challenge	2022	Ewan Dunbar Nicolas Hamilakis Emmanuel Dupoux
+ PDF Chat	Are Discrete Units Necessary for Spoken Language Modeling?	2022	Tu Anh Nguyen Benoît Sagot Emmanuel Dupoux
+	Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021.	2021	Takashi Maekaku Xuankai Chang Yuya Fujita Liwei Chen Shinji Watanabe Alexander I. Rudnicky
+	Textually Pretrained Speech Language Models	2023	Michael Hassid Tal Remez Tu Anh Nguyen Itai Gat Alexis Conneau Felix Kreuk Jade Copet Alexandre Défossez Gabriel Synnaeve Emmanuel Dupoux
+ PDF Chat	Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021	2021	Takashi Maekaku Xuankai Chang Yuya Fujita Li-Wei Chen Shinji Watanabe Alexander I. Rudnicky
+	Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021	2021	Takashi Maekaku Xuankai Chang Yuya Fujita Liwei Chen Shinji Watanabe Alexander I. Rudnicky
+ PDF Chat	DC-Spin: A Speaker-invariant Speech Tokenizer for Spoken Language Models	2024	Heng-Jui Chang Hongyu Gong Changhan Wang James Glass Yu-An Chung
+	SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning	2022	Tzu-hsun Feng Annie Dong Ching-Feng Yeh Shuwen Yang Tzu-Quan Lin Jiatong Shi Kai-Wei Chang Zili Huang Haibin Wu Xuankai Chang
+ PDF Chat	Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning	2023	Tzu-hsun Feng Annie Dong Ching-Feng Yeh Shu-Wen Yang Tzu-Quan Lin Jiatong Shi Kai‐Wei Chang Zili Huang Haibin Wu Xuankai Chang
+	ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition	2021	Afra Alishahi Grzegorz Chrupała Alejandrina Cristià Emmanuel Dupoux Bertrand Higy Marvin Lavechin Okko Räsänen Yu Chen
+	Generative Spoken Language Modeling from Raw Audio	2021	Kushal Lakhotia E. V. Kharitonov Wei-Ning Hsu Yossi Adi Adam Polyak Benjamin Bolte Tu-Anh Hoang Nguyen Jade Copet Alexei Baevski Adelrahman Mohamed
+	Representation Learning With Hidden Unit Clustering For Low Resource Speech Applications	2023	Varun Krishna Tarun Sai Sriram Ganapathy
+ PDF Chat	tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models	2024	Francesco Paissan Elisabetta Farella
+ PDF Chat	The Zero Resource Speech Challenge 2020: Discovering Discrete Subword and Word Units	2020	Ewan Dunbar Julien Karadayi Mathieu Bernard Xuan-Nga Cao Robin Algayres Lucas Ondel Laurent Besacier Sakriani Sakti Emmanuel Dupoux

Works That Cite This (37)

Action	Title	Year	Authors
+ PDF Chat	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities	2022	Hsiang-Sheng Tsai Heng-Jui Chang Wen-Chin Huang Zi−Li Huang Kushal Lakhotia Shuwen Yang Shuyan Dong Andy Liu Cheng-I Lai Jiatong Shi
+ PDF Chat	Fast-Slow Transformer for Visually Grounding Speech	2022	Puyuan Peng David Harwath
+	Can statistical learning bootstrap early language acquisition? A modeling investigation	2022	Marvin Lavechin Maureen de Seyssel Hadrien Titeux Hervé Bredin Guillaume Wisniewski Alejandrina Cristià Emmanuel Dupoux
+	Reverse engineering language acquisition with child-centered long-form recordings	2021	Marvin Lavechin Maureen de Seyssel Lucas Gautheron Emmanuel Dupoux Alejandrina Cristià
+	DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon	2022	Robin Algayres Tristan Ricoul Julien Karadayi Hugo Laurençon Salah Zaiem Abdelrahman Mohamed Benoît Sagot Emmanuel Dupoux
+ PDF Chat	Non-Parallel Voice Conversion for ASR Augmentation	2022	Gary Wang Andrew E. Rosenberg Bhuvana Ramabhadran Fadi Biadsy Jesse Emond Yinghui Huang Pedro Moreno
+ PDF Chat	DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon	2022	Robin Algayres Tristan Ricoul Julien Karadayi Hugo Laurençon Salah Zaiem Abdelrahman Mohamed Benoît Sagot Emmanuel Dupoux
+	Paralinguistic Privacy Protection at the Edge	2022	Ranya Aloufi Hamed Haddadi David Boyle
+ PDF Chat	Configurable Privacy-Preserving Automatic Speech Recognition	2021	Ranya Aloufi Hamed Haddadi David Boyle
+	Speech self-supervised representations benchmarking: A case for larger probing heads	2024	Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli

Works Cited by This (0)

Action	Title	Year	Authors