Shang-Wen Li

Generating author description...

All published works

Action	Title	Year	Authors
+ PDF Chat	How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario	2024	Shi‐Heng Wang Zih-Ching Chen Jiatong Shi Ming-Yen Chuang Guan-Ting Lin Kuan-Po Huang David Harwath Shang-Wen Li Hung-yi Lee
+ PDF Chat	Altogether: Image Captioning via Re-aligning Alt-text	2024	Hu Xu Po-Yao Huang Xiaoqing Ellen Tan Ching-Feng Yeh Jacob Kahn Christine Jou Gargi Ghosh Omer Levy Luke Zettlemoyer Wen-tau Yih
+ PDF Chat	GSQA: An End-to-End Model for Generative Spoken Question Answering	2024	Min-Han Shih Ho-Lam Chung Yu-Chi Pai Ming-Hao Hsu Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+ PDF Chat	Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting	2024	Zhenyu Wang Li Wan Biqiao Zhang Yiteng Huang Shang-Wen Li Ming Sun Xin Lei Zhaojun Yang
+ PDF Chat	Text Quality-Based Pruning for Efficient Training of Language Models	2024	Vasu Sharma Karthik K. Padthe Newsha Ardalani Kushal Tirumala Russell Howes Xu Hu Po-Yao Huang Shang-Wen Li Armen Aghajanyan Gargi Ghosh
+ PDF Chat	MoDE: CLIP Data Experts via Clustering	2024	Jiawei Ma Po-Yao Huang Saining Xie Shang-Wen Li Luke Zettlemoyer Shih‐Fu Chang Wen-tau Yih Xu Hu
+ PDF Chat	A Large-Scale Evaluation of Speech Foundation Models	2024	Shu-Wen Yang Heng-Jui Chang Zi−Li Huang Andy T. Liu Cheng-I Lai Haibin Wu Jiatong Shi Xuankai Chang Hsiang-Sheng Tsai Wen-Chin Huang
+	SpeechDPR: End-To-End Spoken Passage Retrieval For Open-Domain Spoken Question Answering	2024	Chyi-Jiunn Lin Guan-Ting Lin Yung-Sung Chuang Wei-Lun Wu Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee Lin-Shan Lee
+	SD-HuBERT: Sentence-Level Self-Distillation Induces Syllabic Organization in Hubert	2024	Cheol Jun Cho Abdelrahman Mohamed Shang-Wen Li Alan W. Black Gopala K. Anumanchipalli
+	AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models	2024	Yuan Tseng Layne Berry Yi-Ting Chen I-Hsiang Chiu Hsuan-Hao Lin Max Liu Puyuan Peng Yi-Jen Shih Hung‐Yu Wang Haibin Wu
+	SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering	2024	Chyi-Jiunn Lin Guan-Ting Lin Yung-Sung Chuang Wei-Lun Wu Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee Lin-Shan Lee
+ PDF Chat	A Large-Scale Evaluation of Speech Foundation Models	2024	Shu-Wen Yang Heng-Jui Chang Zili Huang Andy T. Liu Cheng-I Lai Haibin Wu Jiatong Shi Xuankai Chang Hsiang-Sheng Tsai Wen-Chin Huang
+ PDF Chat	SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks	2024	Kai-Wei Chang Haibin Wu Yu-Kai Wang Yuan-Kuei Wu Hua Shen Wei‐Cheng Tseng Iu-thing Kang Shang-Wen Li Hung-yi Lee
+ PDF Chat	Prompting and Adapter Tuning For Self-Supervised Encoder-Decoder Speech Model	2023	Kai‐Wei Chang Ming-Hsin Chen Yun‐Ping Lin Jing Neng Hsu Paul Kuo-Ming Huang Chien‐Yu Huang Shang-Wen Li Hung-yi Lee
+ PDF Chat	Flap: Fast Language-Audio Pre-Training	2023	Ching-Feng Yeh Po-Yao Huang Vasu Sharma Shang-Wen Li Gargi Gosh
+ PDF Chat	Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond	2023	Jiatong Shi William Chen Dan Berrebbi Hsiu-Hsuan Wang Weiping Huang En-Pei Hu Ho-Lam Chuang Xuankai Chang Yuxun Tang Shang-Wen Li
+ PDF Chat	ML-SUPERB: Multilingual Speech Universal PERformance Benchmark	2023	Jiatong Shi Dan Berrebbi William Chen En-Pei Hu Wei‐Ping Huang Ho-Lam Chung Xuankai Chang Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee
+ PDF Chat	Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target	2023	Guan-Wei Wu Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+ PDF Chat	Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model	2023	Puyuan Peng Shang-Wen Li Okko Räsänen Abdelrahman Mohamed David Harwath
+	Disentangled Training with Adversarial Examples for Robust Small-Footprint Keyword Spotting	2023	Zhenyu Wang Li Wan Biqiao Zhang Yiteng Huang Shang-Wen Li Ming Sun Xin Lei Zhaojun Yang
+ PDF Chat	Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning	2023	Tzu-hsun Feng Annie Dong Ching-Feng Yeh Shu-Wen Yang Tzu-Quan Lin Jiatong Shi Kai‐Wei Chang Zili Huang Haibin Wu Xuankai Chang
+	SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks	2023	Kai-Wei Chang Yu–Kai Wang Hua Shen Iu-thing Kang Wei‐Cheng Tseng Shang-Wen Li Hung-yi Lee
+	DINOv2: Learning Robust Visual Features without Supervision	2023	Maxime Oquab Timothée Darcet Théo Moutakanni Huy Vo Marc Szafraniec Vasil Khalidov Pierre Fernandez Daniel Haziza Francisco Massa Alaaeldin El-Nouby
+	ML-SUPERB: Multilingual Speech Universal PERformance Benchmark	2023	Jiatong Shi Dan Berrebbi William Chen Ho-Lam Chung En-Pei Hu Wei Huang Xuankai Chang Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee
+	Syllable Discovery and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model	2023	Puyuan Peng Shang-Wen Li Okko Räsänen Abdelrahman Mohamed David Harwath
+	Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering	2023	Yung-Sung Chuang Wei Fang Shang-Wen Li Wen-tau Yih James Glass
+	Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target	2023	Guan-Wei Wu Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+ PDF Chat	Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering	2023	Yung-Sung Chuang Wei Fang Shang-Wen Li Wen-tau Yih James Glass
+	Introducing Semantics into Speech Encoders	2023	Derek Xu Shuyan Dong Changhan Wang Suyoun Kim Zhaojiang Lin Bing Liu Akshat Shrivastava Shang-Wen Li Liang-Hsuan Tseng Guan-Ting Lin
+	Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning	2023	Lili Yu Bowen Shi Ramakanth Pasunuru Benjamin Müller Olga Golovneva Tianlu Wang Arun Babu Binh Tang Brian Karrer Shelly Sheynin
+	AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models	2023	Yuan Tseng Layne Berry Yi‐Ting Chen I-Hsiang Chiu Hsuan-Hao Lin Max Liu Puyuan Peng Yi-Jen Shih Hung‐Yu Wang Haibin Wu
+	Demystifying CLIP Data	2023	Xu Hu Saining Xie Xiaoqing Ellen Tan Po-Yao Huang Russell Howes Vasu Sharma Shang-Wen Li Gargi Ghosh Luke Zettlemoyer Christoph Feichtenhofer
+	Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model	2023	Kai-Wei Chang Ming-Hsin Chen Yun‐Ping Lin Jing Neng Hsu Paul Kuo-Ming Huang Chien‐Yu Huang Shang-Wen Li Hung-yi Lee
+	Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond	2023	Jiatong Shi William Chen Dan Berrebbi Hsiu-Hsuan Wang Wei‐Ping Huang En-Pei Hu Ho-Lam Chuang Xuankai Chang Yuxun Tang Shang-Wen Li
+	SD-HuBERT: Self-Distillation Induces Syllabic Organization in HuBERT	2023	Cheol Jun Cho Abdelrahman Mohamed Shang-Wen Li Alan W. Black Gopala K. Anumanchipalli
+	An Exploration of In-Context Learning for Speech Language Model	2023	Ming-Hao Hsu Kai-Wei Chang Shang-Wen Li Hung-yi Lee
+	FLAP: Fast Language-Audio Pre-training	2023	Ching-Feng Yeh Po-Yao Huang Vasu Sharma Shang-Wen Li Gargi Gosh
+	GSQA: An End-to-End Model for Generative Spoken Question Answering	2023	Min-Han Shih Ho-Lam Chung Yu-Chi Pai Ming-Hao Hsu Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+ PDF Chat	DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question Answering	2022	Guan-Ting Lin Yung-Sung Chuang Ho-Lam Chung Shuwen Yang Hsuan-Jui Chen Shuyan Annie Dong Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee Lin-Shan Lee
+ PDF Chat	Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition	2022	Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+ PDF Chat	Self-Supervised Speech Representation Learning: A Review	2022	Abdelrahman Mohamed Hung-yi Lee Lasse Borgholt Jakob D. Havtorn Joakim Edin Christian Igel Katrin Kirchhoff Shang-Wen Li Karen Livescu Lars Maaløe
+	Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora	2022	Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew Arnold Xiang Ren
+	QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition	2022	Andy T. Liu Wei Xiao Henghui Zhu Dejiao Zhang Shang-Wen Li Andrew Arnold
+	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities	2022	Hsiang-Sheng Tsai Heng-Jui Chang Wen-Chin Huang Zi−Li Huang Kushal Lakhotia Shuwen Yang Shuyan Dong Andy T. Liu Cheng-I Lai Jiatong Shi
+ PDF Chat	DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings	2022	Yung-Sung Chuang Rumen Dangovski Hongyin Luo Yang Zhang Shiyu Chang Marin Soljačić Shang-Wen Li Scott Yih Yoon Kim James Glass
+	Meta Learning for Natural Language Processing: A Survey	2022	Hung-yi Lee Shang-Wen Li Ngoc Thang Vu
+	SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks	2022	Kai-Wei Chang Wei‐Cheng Tseng Shang-Wen Li Hung-yi Lee
+ PDF Chat	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities	2022	Hsiang-Sheng Tsai Heng-Jui Chang Wen-Chin Huang Zi−Li Huang Kushal Lakhotia Shuwen Yang Shuyan Dong Andy Liu Cheng-I Lai Jiatong Shi
+ PDF Chat	Cooperative Self-training of Machine Reading Comprehension	2022	Hongyin Luo Shang-Wen Li Mingye Gao Seunghak Yu James Glass
+ PDF Chat	Meta Learning for Natural Language Processing: A Survey	2022	Hung-yi Lee Shang-Wen Li Thang X. Vu
+ PDF Chat	Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora	2022	Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew Arnold Xiang Ren
+	DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings	2022	Yung-Sung Chuang Rumen Dangovski Hongyin Luo Yang Zhang Shiyu Chang Marin Soljačić Shang-Wen Li Wen-tau Yih Yoon Kim James Glass
+	Exploring Efficient-tuning Methods in Self-supervised Speech Models	2022	Zih-Ching Chen Chin-Lun Fu Chih-Ying Liu Shang-Wen Li Hung-yi Lee
+	SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning	2022	Tzu-hsun Feng Annie Dong Ching-Feng Yeh Shuwen Yang Tzu-Quan Lin Jiatong Shi Kai-Wei Chang Zili Huang Haibin Wu Xuankai Chang
+	Self-Supervised Speech Representation Learning: A Review	2022	Abdelrahman Mohamed Hung-yi Lee Lasse Borgholt Jakob D. Havtorn Joakim Edin Christian Igel Katrin Kirchhoff Shang-Wen Li Karen Livescu Lars Maaløe
+	Introducing Semantics into Speech Encoders	2022	Derek Xu Shuyan Dong Changhan Wang Suyoun Kim Zhaojiang Lin Akshat Shrivastava Shang-Wen Li Liang-Hsuan Tseng Alexei Baevski Guan-Ting Lin
+	DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question Answering	2022	Guan-Ting Lin Yung-Sung Chuang Ho-Lam Chung Shuwen Yang Hsuan-Jui Chen Shuyan Dong Shang-Wen Li Abdelrahman Mohamed Hung-yi Lee Lin-Shan Lee
+	Listen, Adapt, Better WER: Source-free Single-utterance Test-time Adaptation for Automatic Speech Recognition	2022	Guan-Ting Lin Shang-Wen Li Hung-yi Lee
+	MAViL: Masked Audio-Video Learners	2022	Po-Yao Huang Vasu Sharma Xu Hu Chaitanya K. Ryali Haoqi Fan Yanghao Li Shang-Wen Li Gargi Ghosh Jitendra Malik Christoph Feichtenhofer
+ PDF Chat	SUPERB: Speech Processing Universal PERformance Benchmark	2021	Shu-Wen Yang Po-Han Chi Yung-Sung Chuang Cheng-I Lai Kushal Lakhotia Yist Y. Lin Andy T. Liu Jiatong Shi Xuankai Chang Guan-Ting Lin
+ PDF Chat	Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining	2021	Cheng-I Lai Yung-Sung Chuang Hung-yi Lee Shang-Wen Li James Glass
+	Cooperative Learning of Zero-Shot Machine Reading Comprehension.	2021	Hongyin Luo Shang-Wen Li Seunghak Yu James Glass
+ PDF Chat	Meta Learning to Classify Intent and Slot Labels with Noisy Few Shot Examples	2021	Shang-Wen Li Jason Krone Shuyan Dong Yi Zhang Yaser Al-Onaizan
+ PDF Chat	Audio Albert: A Lite Bert for Self-Supervised Learning of Audio Representation	2021	Po-Han Chi Pei-Hung Chung Tsung-Han Wu Chun-Cheng Hsieh Yen‐Hao Chen Shang-Wen Li Hung-yi Lee
+ PDF Chat	TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech	2021	Andy T. Liu Shang-Wen Li Hung-yi Lee
+	Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks	2021	Hongyin Luo Shang-Wen Li James Glass
+	Zero-shot Generalization in Dialog State Tracking through Generative Question Answering	2021	S. X. Li Jin Cao Mukund Sridhar Henghui Zhu Shang-Wen Li Wael Hamza Julian McAuley
+	Zero-shot Generalization in Dialog State Tracking through Generative Question Answering	2021	S. X. Li Jin Cao Mukund Sridhar Henghui Zhu Shang-Wen Li Wael Hamza Julian McAuley
+	SUPERB: Speech processing Universal PERformance Benchmark	2021	Shu-Wen Yang Po-Han Chi Yung-Sung Chuang Cheng-I Lai Kushal Lakhotia Yist Y. Lin Andy T. Liu Jiatong Shi Xuankai Chang Guan-Ting Lin
+ PDF Chat	Supporting Clustering with Contrastive Learning	2021	Dejiao Zhang Nan Feng Xiaokai Wei Shang-Wen Li Henghui Zhu Kathleen McKeown Ramesh Nallapati Andrew O. Arnold Bing Xiang
+	Meta-learning for downstream aware and agnostic pretraining	2021	Hongyin Luo Shuyan Dong Yung-Sung Chuang Shang-Wen Li
+	Mitigating Biases in Toxic Language Detection through Invariant Rationalization	2021	Yung-Sung Chuang Mingye Gao Hongyin Luo James Glass Hung-yi Lee Yun-Nung Chen Shang-Wen Li
+ PDF Chat	Pairwise Supervised Contrastive Learning of Sentence Representations	2021	Dejiao Zhang Shang-Wen Li Xiao Wei Henghui Zhu Ramesh Nallapati Andrew O. Arnold Bing Xiang
+	Pairwise Supervised Contrastive Learning of Sentence Representations	2021	Dejiao Zhang Shang-Wen Li Xiao Wei Henghui Zhu Ramesh Nallapati Andrew O. Arnold Bing Xiang
+	Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora	2021	Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew Arnold Xiang Ren
+	Cooperative Self-training of Machine Reading Comprehension	2021	Hongyin Luo Shang-Wen Li Mingye Gao Seunghak Yu James Glass
+	Improving Learning Experience in MOOCs with Educational Content Linking.	2020	Shang-Wen Li
+ PDF Chat	Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption	2020	Hongyin Luo Shang-Wen Li James Glass
+ PDF Chat	Style Attuned Pre-Training and Parameter Efficient Fine-Tuning for Spoken Language Understanding	2020	Jin Cao Jun Wang Wael Hamza Kelly Vanee Shang-Wen Li
+	Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation	2020	Po-Han Chi Pei-Hung Chung Tsung-Han Wu Chun-Cheng Hsieh Yen‐Hao Chen Shang-Wen Li Hung-yi Lee
+	Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption	2020	Hongyin Luo Shang-Wen Li James Glass
+	Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding	2020	Jin Cao Jun Wang Wael Hamza Kelly Vanee Shang-Wen Li
+	Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining	2020	Cheng-I Lai Yung-Sung Chuang Hung-yi Lee Shang-Wen Li James Glass
+	Towards Semi-Supervised Semantics Understanding from Speech	2020	Cheng-I Lai Jin Cao Sravan Bodapati Shang-Wen Li
+	Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks	2020	Hongyin Luo Shang-Wen Li James Glass
+	Meta learning to classify intent and slot labels with noisy few shot examples	2020	Shang-Wen Li Jason Krone Shuyan Dong Yi Zhang Yaser Al-Onaizan
+	Educational Content Linking for Enhancing Learning Need Remediation in MOOCs	2020	Shang-Wen Li
+	Learning Robust Dialog Policies in Noisy Environments	2017	Maryam Fazel-Zarandi Shang-Wen Li Jin Cao Jared Casale Peter Henderson David Whitney Alborz Geramifard
+	Learning Robust Dialog Policies in Noisy Environments	2017	Maryam Fazel-Zarandi Shang-Wen Li Jin Cao Jared Casale Peter Henderson David Whitney Alborz Geramifard

Common Coauthors

Coauthor	Papers Together
Hung-yi Lee	44
Yung-Sung Chuang	16
Shinji Watanabe	15
Abdelrahman Mohamed	15
Guan-Ting Lin	15
James Glass	14
Xuankai Chang	12
Hongyin Luo	11
Po-Yao Huang	10
Shuyan Dong	10
Cheng-I Lai	9
Henghui Zhu	9
Abdelrahman Mohamed	9
Dejiao Zhang	7
Andy T. Liu	7
Vasu Sharma	7
Haibin Wu	7
Jiatong Shi	7
Kushal Lakhotia	6
Jin Cao	6
Jiatong Shi	6
Ho-Lam Chung	6
Po-Han Chi	6
Kai-Wei Chang	5
Ching-Feng Yeh	5
Shuwen Yang	5
David Harwath	5
Gargi Ghosh	5
Shu-Wen Yang	5
Xu Hu	4
Tzu-Hsien Huang	4
Russell Howes	4
Heng-Jui Chang	4
Puyuan Peng	4
Wei-Cheng Tseng	4
En-Pei Hu	4
Lin-Shan Lee	4
Hsiang-Sheng Tsai	4
Wen-Chin Huang	4
Wen-tau Yih	4
Luke Zettlemoyer	4
Tzu-hsun Feng	4
William Chen	4
Wael Hamza	4
Dan Berrebbi	4
Yist Y. Lin	4
Andrew Arnold	4
Zili Huang	4
Wei‐Cheng Tseng	3
Xiaokai Wei	3

Commonly Cited References

Action	Title	Year	Authors	# of times referenced
+	RoBERTa: A Robustly Optimized BERT Pretraining Approach	2019	Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer Veselin Stoyanov	17
+	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding	2018	Jacob Devlin Ming‐Wei Chang Kenton Lee Kristina Toutanova	17
+	wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations	2020	Alexei Baevski Henry Zhou Abdelrahman Mohamed Michael Auli	14
+ PDF Chat	wav2vec: Unsupervised Pre-Training for Speech Recognition	2019	Steffen Schneider Alexei Baevski Ronan Collobert Michael Auli	13
+ PDF Chat	Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders	2020	Andy T. Liu Shu-Wen Yang Po-Han Chi Po‐Chun Hsu Hung-yi Lee	13
+	Representation Learning with Contrastive Predictive Coding	2018	Aäron van den Oord Yazhe Li Oriol Vinyals	12
+ PDF Chat	TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech	2021	Andy T. Liu Shang-Wen Li Hung-yi Lee	12
+	Deep Contextualized Word Representations	2018	Matthew E. Peters Mark E Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer	12
+ PDF Chat	SUPERB: Speech Processing Universal PERformance Benchmark	2021	Shu-Wen Yang Po-Han Chi Yung-Sung Chuang Cheng-I Lai Kushal Lakhotia Yist Y. Lin Andy T. Liu Jiatong Shi Xuankai Chang Guan-Ting Lin	11
+ PDF Chat	HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units	2021	Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdelrahman Mohamed	10
+ PDF Chat	An Unsupervised Autoregressive Model for Speech Representation Learning	2019	Yu-An Chung Wei-Ning Hsu Hao Tang James Glass	10
+	Representation Learning with Contrastive Predictive Coding	2018	Aäron van den Oord Yazhe Li Oriol Vinyals	10
+	A Simple Framework for Contrastive Learning of Visual Representations	2020	Ting Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton	9
+ PDF Chat	SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition	2019	Daniel Park William Chan Yu Zhang Chung‐Cheng Chiu Barret Zoph Ekin D. Cubuk Quoc V. Le	9
+ PDF Chat	Momentum Contrast for Unsupervised Visual Representation Learning	2020	Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross Girshick	8
+ PDF Chat	Speech Model Pre-Training for End-to-End Spoken Language Understanding	2019	Loren Lugosch Mirco Ravanelli Patrick Ignoto Vikrant Singh Tomar Yoshua Bengio	8
+	GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding	2018	Alex Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel Bowman	8
+ PDF Chat	Deep Contextualized Acoustic Representations for Semi-Supervised Speech Recognition	2020	Shaoshi Ling Yuzong Liu Julián Salazar Katrin Kirchhoff	8
+ PDF Chat	Vector-Quantized Autoregressive Predictive Coding	2020	Yu-An Chung Hao Tang James Glass	8
+ PDF Chat	Unsupervised Pretraining Transfers Well Across Languages	2020	Morgane Rivière Armand Joulin Pierre-Emmanuel Mazaré Emmanuel Dupoux	7
+	vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations	2019	Alexei Baevski Steffen Schneider Michael Auli	7
+	Attention Is All You Need	2017	Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Łukasz Kaiser Illia Polosukhin	7
+ PDF Chat	WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing	2022	Sanyuan Chen Chengyi Wang Zhengyang Chen Yu Wu Shujie Liu Zhuo Chen Jinyu Li Naoyuki Kanda Takuya Yoshioka Xiong Xiao	7
+	Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces	2018	Alice Coucke Alaa Saade Adrien Ball Théodore Bluche Alexandre Caulier David Leroy Clément Doumouro Thibault Gisselbrecht Francesco Caltagirone Thibaut Lavril	7
+ PDF Chat	Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies	2021	Alexander H. Liu Yu-An Chung James Glass	7
+	BERT for Joint Intent Classification and Slot Filling	2019	Chen Qian Zhuo Zhu Wen Wang	6
+	Decoupled Weight Decay Regularization	2017	Ilya Loshchilov Frank Hutter	6
+	Generative Spoken Language Modeling from Raw Audio	2021	Kushal Lakhotia E. V. Kharitonov Wei-Ning Hsu Yossi Adi Adam Polyak Benjamin Bolte Tu-Anh Hoang Nguyen Jade Copet Alexei Baevski Adelrahman Mohamed	6
+ PDF Chat	Multi-Task Self-Supervised Learning for Robust Speech Recognition	2020	Mirco Ravanelli Jianyuan Zhong Santiago Pascual Paweł Świętojański João Monteiro Jan Trmal Yoshua Bengio	6
+	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	2019	Colin Raffel Noam Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu	6
+	Language Models are Few-Shot Learners	2020	T. B. Brown Benjamin F. Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell	6
+	Attention is All you Need	2017	Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Łukasz Kaiser Illia Polosukhin	6
+ PDF Chat	Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining	2021	Cheng-I Lai Yung-Sung Chuang Hung-yi Lee Shang-Wen Li James Glass	6
+	Improving Transformer-based Speech Recognition Using Unsupervised Pre-training	2019	Dongwei Jiang Xiaoning Lei Wubo Li Ne Luo Yuxuan Hu Wei Zou Xiangang Li	6
+	BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	2020	Mike Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdelrahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer	6
+ PDF Chat	LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech	2021	Solène Evain Ha-Thanh Nguyen Hang Le Marcely Zanon Boito Salima Mdhaffar Sina Alisamir Ziyi Tong Natalia Tomashenko Marco Dinarelli Titouan Parcollet	6
+	Prototypical Networks for Few-shot Learning	2017	Jake Snell Kevin Swersky Richard S. Zemel	6
+ PDF Chat	SimCSE: Simple Contrastive Learning of Sentence Embeddings	2021	Tianyu Gao Xingcheng Yao Danqi Chen	6
+ PDF Chat	Learning Problem-Agnostic Speech Representations from Multiple Self-Supervised Tasks	2019	Santiago Pascual Mirco Ravanelli Joan Serrà Antonio Bonafonte Yoshua Bengio	5
+	DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter	2019	Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf	5
+	Parameter-Efficient Transfer Learning for NLP	2019	Neil Houlsby Andrei Giurgiu Stanisław Jastrzȩbski Bruna Morrone Quentin de Laroussilhe Andréa Gesmundo Mona Attariyan Sylvain Gelly	5
+ PDF Chat	Self-Supervised Speech Representation Learning: A Review	2022	Abdelrahman Mohamed Hung-yi Lee Lasse Borgholt Jakob D. Havtorn Joakim Edin Christian Igel Katrin Kirchhoff Shang-Wen Li Karen Livescu Lars Maaløe	5
+ PDF Chat	SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities	2022	Hsiang-Sheng Tsai Heng-Jui Chang Wen-Chin Huang Zi−Li Huang Kushal Lakhotia Shuwen Yang Shuyan Dong Andy Liu Cheng-I Lai Jiatong Shi	5
+ PDF Chat	Generative Pre-Training for Speech with Autoregressive Predictive Coding	2020	Yu-An Chung James Glass	5
+	Learning Robust Dialog Policies in Noisy Environments	2017	Maryam Fazel-Zarandi Shang-Wen Li Jin Cao Jared Casale Peter Henderson David Whitney Alborz Geramifard	5
+ PDF Chat	Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation	2019	Chia‐Hsuan Lee Yun-Nung Chen Hung-yi Lee	5
+	DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantization	2020	Shaoshi Ling Yuzong Liu	5
+ PDF Chat	Libri-Light: A Benchmark for ASR with Limited or No Supervision	2020	Jacob Kahn Maude Rivière Wenlong Zheng Eugene Kharitonov Qinmei Xu Pierre-Emmanuel Mazaré Julien Karadayi Vitaliy Liptchinsky Ronan Collobert Christian Fuegen	5
+	Distilling the Knowledge in a Neural Network	2015	Geoffrey E. Hinton Oriol Vinyals Jay B. Dean	4
+	Improved Speech Representations with Multi-Target Autoregressive Predictive Coding	2020	Yu-An Chung James Glass	4