FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism
for Language Models
FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism
for Language Models
Pre-trained Language Models (PLMs) have shown impressive results in various Natural Language Generation (NLG) tasks, such as powering chatbots and generating stories. However, an ethical concern arises due to their potential to produce verbatim copies of paragraphs from their training data. This is problematic as PLMs are trained on corpora …