REAL Sampling: Boosting Factuality and Diversity of Open-Ended
Generation via Asymptotic Entropy
REAL Sampling: Boosting Factuality and Diversity of Open-Ended
Generation via Asymptotic Entropy
Decoding methods for large language models (LLMs) usually struggle with the tradeoff between ensuring factuality and maintaining diversity. For example, a higher p threshold in the nucleus (top-p) sampling increases the diversity but decreases the factuality, and vice versa. In this paper, we propose REAL (Residual Entropy from Asymptotic Line) …