Controllable Natural Language Generation with Contrastive Prefixes
Controllable Natural Language Generation with Contrastive Prefixes
To guide the generation of large pretrained language models (LM), previous work has focused on directly fine-tuning the language model or utilizing an attribute discriminator. In this work, we propose a novel lightweight framework for controllable GPT2 generation, which utilizes a set of small attribute-specific vectors, called prefixes (Li and …