A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition

Darcey Riley, David Chiang

Type: Article

Publication Date: 2022-01-01

Citations: 0

DOI: https://doi.org/10.18653/v1/2022.blackboxnlp-1.36

Locations

arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition	2022	Darcey Riley David Chiang
+	On Decoding Strategies for Neural Text Generators	2022	Gian Wiher Clara Meister Ryan Cotterell
+ PDF Chat	On Decoding Strategies for Neural Text Generators	2022	Gian Wiher Clara Meister Ryan Cotterell
+	Mixture Models for Diverse Machine Translation: Tricks of the Trade	2019	Tianxiao Shen Myle Ott Michael Auli Marc’Aurelio Ranzato
+	The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation	2023	Kushal Arora Timothy J. O’Donnell Doina Precup Jason Weston Jackie Chi Kit Cheung
+	Contrastive Decoding: Open-ended Text Generation as Optimization	2022	Xiang Lisa Li Ari Holtzman Daniel Fried Percy Liang Jason Eisner Tatsunori Hashimoto Luke Zettlemoyer Michael Lewis
+ PDF Chat	Decoding Decoded: Understanding Hyperparameter Effects in Open-Ended Text Generation	2024	Esteban Garces Arias Meimingwei Li Christian Heumann Matthias Aßenmacher
+	Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation	2022	Kushal Arora Layla El Asri Hareesh Bahuleyan Jackie Kit Cheung
+	Societal Biases in Language Generation: Progress and Challenges	2021	Emily Sheng Kai-Wei Chang Prem Natarajan Nanyun Peng
+	Controllable Text Generation for Open-Domain Creativity and Fairness	2022	Nanyun Peng
+ PDF Chat	Controllable Text Generation for Open-Domain Creativity and Fairness	2022	Nanyun Peng
+	Investigating Label Bias in Beam Search for Open-ended Text Generation	2020	Liang Wang Jinlong Liu Jingming Liu
+ PDF Chat	Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation	2022	Kushal Arora Layla El Asri Hareesh Bahuleyan Jackie Chi Kit Cheung
+	Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation	2023	Jian Guan Minlie Huang
+ PDF Chat	Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation	2023	Jian Guan Minlie Huang
+ PDF Chat	The Hyperfitting Phenomenon: Sharpening and Stabilizing LLMs for Open-Ended Text Generation	2024	Fredrik Carlsson Fangyu Liu D M Ward Murathan Kurfali Joakim Nivre
+	Quantifying Exposure Bias for Neural Language Generation	2019	Tianxing He Jingzhao Zhang Zhiming Zhou James Glass
+	On Long-Tailed Phenomena in Neural Machine Translation	2020	Vikas Raunak Siddharth Dalmia Vivek Gupta Florian Metze
+	On Long-Tailed Phenomena in Neural Machine Translation	2020	Vikas Raunak Siddharth Dalmia Vivek Gupta Florian Metze
+	On Long-Tailed Phenomena in Neural Machine Translation	2020	Vikas Raunak Siddharth Dalmia Vivek Gupta Florian Metze

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (26)

Action	Title	Year	Authors
+ PDF Chat	Rethinking the Inception Architecture for Computer Vision	2016	Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jon Shlens Zbigniew Wojna
+	Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation	2016	Yonghui Wu Mike Schuster Zhifeng Chen Quoc V. Le Mohammad Norouzi Wolfgang Macherey Maxim Krikun Yuan Cao Qin Gao Klaus Macherey
+	The Curious Case of Neural Text Degeneration	2019	Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi
+	When Does Label Smoothing Help?	2019	Rafael Müller Simon Kornblith Geoffrey E. Hinton
+ PDF Chat	Neural Machine Translation of Rare Words with Subword Units	2016	Rico Sennrich Barry Haddow Alexandra Birch
+ PDF Chat	Hierarchical Neural Story Generation	2018	Angela Fan Mike Lewis Yann Dauphin
+ PDF Chat	Modeling Coverage for Neural Machine Translation	2016	Zhaopeng Tu Zhengdong Lu Yang Liu Xiaohua Liu Hang Li
+	Correcting Length Bias in Neural Machine Translation	2018	Kenton Murray David Chiang
+	Six Challenges for Neural Machine Translation	2017	Philipp Koehn Rebecca Knowles
+ PDF Chat	Coverage Embedding Models for Neural Machine Translation	2016	Haitao Mi Baskaran Sankaran Zhiguo Wang Abe Ittycheriah