Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer

Jakub Świątkowski, Duo Wang, Mikolaj Babianski, Giuseppe Coccia, Patrick Lumban Tobing, Ravichander Vipperla, Viacheslav Klimkov, Vincent Pollet

Type: Preprint

Publication Date: 2023-01-01

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2306.11662

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Giuseppe Coccia Patrick Lumban Tobing Ravichander Vipperla Viacheslav Klimkov Vincent Pollet
+ PDF Chat	Cross-lingual Prosody Transfer for Expressive Machine Dubbing	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Patrick Lumban Tobing Ravichander Vipperla Vincent Pollet
+	Cross-lingual Prosody Transfer for Expressive Machine Dubbing	2023	Jakub Świątkowski Duo Wang Mikolaj Babianski Patrick Lumban Tobing Ravichander Vipperla Vincent Pollet
+	Daft-Exprt: Cross-Speaker Prosody Transfer on Any Text for Expressive Speech Synthesis	2021	Julian Zaïdi Hugo Seuté Benjamin van Niekerk Marc-André Carbonneau
+ PDF Chat	Daft-Exprt: Cross-Speaker Prosody Transfer on Any Text for Expressive Speech Synthesis	2022	Julian Zaïdi Hugo Seuté Benjamin van Niekerk Marc-André Carbonneau
+ PDF Chat	Joint Multiscale Cross-Lingual Speaking Style Transfer With Bidirectional Attention Mechanism for Automatic Dubbing	2023	Jingbei Li Sipan Li Ping Chen Luwen Zhang Meng Yi Zhiyong Wu Helen Meng Qiao Tian Yu‐Ping Wang Yuxuan Wang
+	Joint Multi-scale Cross-lingual Speaking Style Transfer with Bidirectional Attention Mechanism for Automatic Dubbing	2023	Jingbei Li Sipan Li Ping Chen Luwen Zhang Meng Yi Zhiyong Wu Helen Meng Qiao Tian Yu‐Ping Wang Yuxuan Wang
+ PDF Chat	CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfer	2022	Sri Karlapati Penny Karanasou Mateusz Łajszczak Syed Ammar Abbas Alexis Moinet Peter Makarov Ray Li Arent van Korlaar Simon Slangen Thomas Drugman
+	CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfer	2022	Sri Karlapati Penny Karanasou Mateusz Łajszczak Ammar Abbas Alexis Moinet Peter Makarov Ray Li Arent van Korlaar Simon Slangen Thomas Drugman
+	Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis.	2021	Julian Zaïdi Hugo Seuté Benjamin van Niekerk Marc‐André Carbonneau
+	Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model	2023	Hoyeon Lee Hyun-Wook Yoon Jong-Hwan Kim Jae-Min Kim
+	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+ PDF Chat	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+	Prosodic Phrase Alignment for Machine Dubbing	2019	Alp Öktem Mireia Farrús Antonio Bonafonte
+	eCat: An End-to-End Model for Multi-Speaker TTS & Many-to-Many Fine-Grained Prosody Transfer	2023	Ammar Abbas Sri Karlapati Bastian Schnell Penny Karanasou Marcel Granero Moya Amith Nagaraj Ayman Boustati Nicole Peinelt Alexis Moinet Thomas Drugman
+	A Holistic Cascade System, Benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation	2023	Wen-Chin Huang Benjamin Peloquin Justine Kao Changhan Wang Hongyu Gong Elizabeth Salesky Yossi Adi Ann Lee Peng‐Jen Chen
+	A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation	2023	Wen-Chin Huang Benjamin Peloquin Justine Kao Changhan Wang Hongyu Gong Elizabeth Salesky Yossi Adi Ann Lee Peng‐Jen Chen
+	From Speech-to-Speech Translation to Automatic Dubbing	2020	Marcello Federico Robert Enyedi Roberto Barra-Chicote Ritwik Giri Umut Isik Arvindh Krishnaswamy Hassan Sawaf
+	From Speech-to-Speech Translation to Automatic Dubbing	2020	Marcello Federico Robert Enyedi Roberto Barra-Chicote Ritwik Giri Umut Isik Arvindh Krishnaswamy Hassan Sawaf
+	Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis	2023	Chunyu Qiang Peng Yang Hao Che Ying Zhang Xiaorui Wang Zhongyuan Wang

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors