Similarity Analysis of Self-Supervised Speech Representations

Yu-An Chung, Yonatan Belinkov, James Glass

Type: Preprint

Publication Date: 2020-01-01

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2010.11481

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Similarity Analysis of Self-Supervised Speech Representations	2021	Yu-An Chung Yonatan Belinkov James Glass
+ PDF Chat	Self-Supervised Speech Representation Learning: A Review	2022	Abdelrahman Mohamed Hung-yi Lee Lasse Borgholt Jakob D. Havtorn Joakim Edin Christian Igel Katrin Kirchhoff Shang-Wen Li Karen Livescu Lars Maaløe
+	Self-Supervised Speech Representation Learning: A Review	2022	Abdelrahman Mohamed Hung-yi Lee Lasse Borgholt Jakob D. Havtorn Joakim Edin Christian Igel Katrin Kirchhoff Shang-Wen Li Karen Livescu Lars Maaløe
+	Speech Self-Supervised Representation Benchmarking: Are We Doing it Right?	2023	Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli
+	Speech Self-Supervised Representation Benchmarking: Are We Doing it Right?	2023	Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli
+	Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective	2024	Alexander H. Liu Sung-Lin Yeh James Glass
+	Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective	2024	Alexander H. Liu Sung-Lin Yeh James Glass
+	Analyzing the factors affecting usefulness of Self-Supervised Pre-trained Representations for Speech Recognition	2022	Lodagala V S V Durga Prasad Ashish Seth Sreyan Ghosh S. Umesh
+	Conformer-Based Self-Supervised Learning for Non-Speech Audio Tasks	2021	Sangeeta Srivastava Yun Wang Andros Tjandra Anurag Kumar Chunxi Liu Kritika Singh Yatharth Saraf
+ PDF Chat	Conformer-Based Self-Supervised Learning For Non-Speech Audio Tasks	2022	Sangeeta Srivastava Yun Wang Andros Tjandra Anurag Kumar Chunxi Liu Kritika Singh Yatharth Saraf
+ PDF Chat	Understanding Self-Supervised Learning of Speech Representation via Invariance and Redundancy Reduction	2024	Yusuf Brima Ulf Krumnack Simone Pika Gunther Heidemann
+	Learning Problem-agnostic Speech Representations from Multiple Self-supervised Tasks	2019	Santiago Pascual Mirco Ravanelli Joan Serrà Antonio Bonafonte Yoshua Bengio
+	Speech Self-Supervised Representations Benchmarking: A Case for Larger Probing Heads	2024	Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli
+ PDF Chat	MASR: Multi-Label Aware Speech Representation	2023	Anjali Raj Shikhar Bharadwaj Sriram Ganapathy Ma Min Shikhar Vashishth
+	MASR: Multi-label Aware Speech Representation	2023	Anjali Raj Shikhar Bharadwaj Sriram Ganapathy Min Ma Shikhar Vashishth
+	A Brief Overview of Unsupervised Neural Speech Representation Learning	2022	Lasse Borgholt Jakob D. Havtorn Joakim Edin Lars Maaløe Christian Igel
+ PDF Chat	Layer-Wise Analysis of a Self-Supervised Speech Representation Model	2021	Ankita Pasad Ju-Chieh Chou Karen Livescu
+	Layer-wise Analysis of a Self-supervised Speech Representation Model	2021	Ankita Pasad Ju-Chieh Chou Karen Livescu
+	Layer-wise Analysis of a Self-supervised Speech Representation Model.	2021	Ankita Pasad Ju-Chieh Chou Karen Livescu
+ PDF Chat	Speech Representation Analysis based on Inter- and Intra-Model Similarities	2024	Yassine El Kheir Ahmed Ali Shammur Absar Chowdhury

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (27)

Action	Title	Year	Authors
+	Representation Learning with Contrastive Predictive Coding	2018	Aäron van den Oord Yazhe Li Oriol Vinyals
+ PDF Chat	SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition	2019	Daniel Park William Chan Yu Zhang Chung‐Cheng Chiu Barret Zoph Ekin D. Cubuk Quoc V. Le
+	Similarity of Neural Network Representations Revisited	2019	Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton
+	Deep Contextualized Word Representations	2018	Matthew E. Peters Mark E Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer
+	Identifying and Controlling Important Neurons in Neural Machine Translation	2018	Anthony Bau Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James Glass
+ PDF Chat	An Unsupervised Autoregressive Model for Speech Representation Learning	2019	Yu-An Chung Wei-Ning Hsu Hao Tang James Glass
+ PDF Chat	wav2vec: Unsupervised Pre-Training for Speech Recognition	2019	Steffen Schneider Alexei Baevski Ronan Collobert Michael Auli
+ PDF Chat	Learning Problem-Agnostic Speech Representations from Multiple Self-Supervised Tasks	2019	Santiago Pascual Mirco Ravanelli Joan Serrà Antonio Bonafonte Yoshua Bengio
+	Improving Transformer-based Speech Recognition Using Unsupervised Pre-training	2019	Dongwei Jiang Xiaoning Lei Wubo Li Ne Luo Yuxuan Hu Wei Zou Xiangang Li
+ PDF Chat	Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders	2020	Andy T. Liu Shu-Wen Yang Po-Han Chi Po‐Chun Hsu Hung-yi Lee