From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by
Step
From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by
Step
When leveraging language models for reasoning tasks, generating explicit chain-of-thought (CoT) steps often proves essential for achieving high accuracy in final outputs. In this paper, we investigate if models can be taught to internalize these CoT steps. To this end, we propose a simple yet effective method for internalizing CoT …