RVAE-LAMOL: Residual Variational Autoencoder to Enhance Lifelong Language Learning
RVAE-LAMOL: Residual Variational Autoencoder to Enhance Lifelong Language Learning
Lifelong Language Learning (LLL) aims to train a neural network to learn a stream of NLP tasks while retaining knowledge from previous tasks. However, previous works which followed data-free constraint still suffer from catastrophic forgetting issue, where the model forgets what it just learned from previous tasks. In order to …