On the probability-quality paradox in language generation

Clara Meister, Gian Wiher, Tiago Pimentel, Ryan Cotterell

Type: Preprint

Publication Date: 2022-01-01

Citations: 2

DOI: https://doi.org/10.48550/arxiv.2203.17217

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	On the probability–quality paradox in language generation	2022	Clara Meister Gian Wiher Tiago Pimentel Ryan Cotterell
+	On Decoding Strategies for Neural Text Generators	2022	Gian Wiher Clara Meister Ryan Cotterell
+	The Curious Case of Neural Text Degeneration	2019	Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi
+	The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation	2023	Kushal Arora Timothy J. O’Donnell Doina Precup Jason Weston Jackie Chi Kit Cheung
+ PDF Chat	On Decoding Strategies for Neural Text Generators	2022	Gian Wiher Clara Meister Ryan Cotterell
+ PDF Chat	Locally Typical Sampling	2023	Clara Meister Tiago Pimentel Gian Wiher Ryan Cotterell
+	Locally Typical Sampling	2022	Clara Meister Tiago Pimentel Gian Wiher Ryan Cotterell
+	The Curious Case of Neural Text Degeneration	2020	Ari Holtzman Jan Buys Leo Du Maxwell Forbes Yejin Choi
+	Contrastive Decoding: Open-ended Text Generation as Optimization	2022	Xiang Lisa Li Ari Holtzman Daniel Fried Percy Liang Jason Eisner Tatsunori Hashimoto Luke Zettlemoyer Michael Lewis
+	An Information Divergence Measure Between Neural Text and Human Text	2021	Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui
+	What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability	2023	Mario Giulianelli Joris Baan Wilker Aziz Raquel Fernández Barbara Plank
+ PDF Chat	What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability	2023	Mario Giulianelli Joris Baan Wilker Aziz Raquel Fernández Barbara Plank
+ PDF Chat	Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding	2023	Mirac Süzgün Luke Melas-Kyriazi Dan Jurafsky
+ PDF Chat	Trading Off Diversity and Quality in Natural Language Generation	2020	Hugh Zhang Daniel Duckworth Daphne Ippolito Arvind Neelakantan
+	Trading Off Diversity and Quality in Natural Language Generation	2020	Hugh Zhang Daniel Duckworth Daphne Ippolito Arvind Neelakantan
+ PDF Chat	Rethinking Uncertainty Estimation in Natural Language Generation	2024	Lukas Aichberger Kajetan Schweighofer Sepp Hochreiter
+	Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity	2020	Sourya Basu Govardana Sachitanandam Ramachandran Nitish Shirish Keskar Lav R. Varshney
+ PDF Chat	Decoding Decoded: Understanding Hyperparameter Effects in Open-Ended Text Generation	2024	Esteban Garces Arias Meimingwei Li Christian Heumann Matthias Aßenmacher
+	MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers.	2021	Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui
+	Unifying Human and Statistical Evaluation for Natural Language Generation	2019	Tatsunori Hashimoto Hugh Zhang Percy Liang

Works That Cite This (2)

Action	Title	Year	Authors
+	Language Model Decoding as Likelihood–Utility Alignment	2023	Martin Josifoski Maxime Peyrard Frano Rajič Jiheng Wei Debjit Paul Valentin N. Hartmann Barun Patra Vishrav Chaudhary Emre Kıcıman Boi Faltings
+	Studying psychosis using Natural Language Generation: A review of emerging opportunities	2023	Lena Palaniyappan David Benrimoh Alban Voppel Roberta Rocca

Works Cited by This (0)

Action	Title	Year	Authors