Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer

Jakub Świątkowski, Duo Wang, Mikolaj Babianski, Giuseppe Coccia, Patrick Lumban Tobing, Ravichander Vipperla, Viacheslav Klimkov, Vincent Pollet

Type: Article

Publication Date: 2023-08-14

Citations: 1

DOI: https://doi.org/10.21437/interspeech.2023-441

View Publication

Download PDF

Locations

arXiv (Cornell University) - View - PDF
Interspeech 2022 - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Cross-lingual Prosody Transfer for Expressive Machine Dubbing	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Patrick Lumban Tobing Ravichander Vipperla Vincent Pollet
+	Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Giuseppe Coccia Patrick Lumban Tobing Ravichander Vipperla Viacheslav Klimkov Vincent Pollet
+ PDF Chat	Towards Cross-Language Prosody Transfer for Dialog	2023	Jonathan E. Avila Nigel Ward
+	Cross-lingual Prosody Transfer for Expressive Machine Dubbing	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Patrick Lumban Tobing Ravichander Vipperla Vincent Pollet
+ PDF Chat	Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosody	2022	Peter Makarov Syed Ammar Abbas Mateusz Łajszczak Arnaud Joly Sri Karlapati Alexis Moinet Thomas Drugman Penny Karanasou
+	Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model	2023	Hoyeon Lee Hyun-Wook Yoon Jong-Hwan Kim Jae-Min Kim
+ PDF Chat	Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model	2023	Hoyeon Lee Hyun-Wook Yoon Jong-Hwan Kim Jae-Min Kim
+	A Holistic Cascade System, Benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation	2023	Wen-Chin Huang Benjamin Peloquin Justine Kao Changhan Wang Hongyu Gong Elizabeth Salesky Yossi Adi Ann Lee Peng‐Jen Chen
+	A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation	2023	Wen-Chin Huang Benjamin Peloquin Justine Kao Changhan Wang Hongyu Gong Elizabeth Salesky Yossi Adi Ann Lee Peng‐Jen Chen
+	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+ PDF Chat	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+	CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfer	2022	Sri Karlapati Penny Karanasou Mateusz Łajszczak Ammar Abbas Alexis Moinet Peter Makarov Ray Li Arent van Korlaar Simon Slangen Thomas Drugman
+ PDF Chat	CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfer	2022	Sri Karlapati Penny Karanasou Mateusz Łajszczak Syed Ammar Abbas Alexis Moinet Peter Makarov Ray Li Arent van Korlaar Simon Slangen Thomas Drugman
+	Interactive Text-to-Speech via Semi-supervised Style Transfer Learning.	2020	Yang Gao Weiyi Zheng Zhaojun Yang Thilo Köhler Christian Fuegen Qing He
+ PDF Chat	Word-Level Style Control for Expressive, Non-attentive Speech Synthesis	2021	Konstantinos Klapsas Nikolaos Ellinas June Sig Sung Hyoung-Min Park Spyros Raptis
+ PDF Chat	Speech is More Than Words: Do Speech-to-Text Translation Systems Leverage Prosody?	2024	Ioannis Tsiamas Matthias Sperber Andrew Finch Sarthak Garg
+	Expressive TTS Training with Frame and Style Reconstruction Loss	2020	Rui Liu Berrak Şişman Guanglai Gao Haizhou Li
+	DiffProsody: Diffusion-Based Latent Prosody Generation for Expressive Speech Synthesis With Prosody Conditional Adversarial Training	2024	Hyung-Seok Oh Sang-Hoon Lee Seong‐Whan Lee
+	Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of SSWP	2023	Jinzuomu Zhong Yang Li Hui Huang Jie Liu Zhiba Su Jing Guo Benlai Tang Fengjie Zhu

Works That Cite This (1)

Action	Title	Year	Authors
+ PDF Chat	Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing	2023	Jingbei Li Sipan Li Ping Chen Luwen Zhang Meng Yi Zhiyong Wu Helen Meng Qiao Tian Yu‐Ping Wang Yuxuan Wang

Works Cited by This (0)

Action	Title	Year	Authors