UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for
Low-Resource Languages
UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for
Low-Resource Languages
In this paper, we introduce UniBridge (Cross-Lingual Transfer Learning with Optimized Embeddings and Vocabulary), a comprehensive approach developed to improve the effectiveness of Cross-Lingual Transfer Learning, particularly in languages with limited resources. Our approach tackles two essential elements of a language model: the initialization of embeddings and the optimal vocabulary …