Ask a Question

Prefer a chat interface with context about you and your work?

Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

When writing and talking, people sometimes pause to think. Although reasoning-focused works have often framed reasoning as a method of answering questions or completing agentic tasks, reasoning is implicit in almost all written text. For example, this applies to the steps not stated between the lines of a proof or …