Ask a Question

Prefer a chat interface with context about you and your work?

Locally Typical Sampling

Locally Typical Sampling

Abstract Today’s probabilistic language generators fall short when it comes to producing coherent and fluent text despite the fact that the underlying models perform well under standard metrics (e.g., perplexity). This discrepancy has puzzled the language generation community for the last few years. In this work, we posit that the …