Covid-twitter-bert: A natural language processing model to analyse covid-19 content on twitter
Covid-twitter-bert: A natural language processing model to analyse covid-19 content on twitter
In this work, we release COVID-Twitter-BERT (CT-BERT), a transformer-based model, pretrained on a large corpus of Twitter messages on the topic of COVID-19. Our model shows a 10-30% marginal improvement compared to its base model, BERT-Large, on five different classification datasets. The largest improvements are on the target domain. Pretrained …