Ask a Question

Prefer a chat interface with context about you and your work?

Can Language Models Solve Olympiad Programming?

Can Language Models Solve Olympiad Programming?

Computing olympiads contain some of the most challenging problems for humans, requiring complex algorithmic reasoning, puzzle solving, in addition to generating efficient code. However, it has been understudied as a domain to evaluate language models (LMs). In this paper, we introduce the USACO benchmark with 307 problems from the USA …