Ask a Question

Prefer a chat interface with context about you and your work?

Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard

Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard

Leaderboards are a ubiquitous part of modern research in applied machine learning. By design, they sort entries into some linear order, where the top-scoring entry is recognized as the "state of the art" (SOTA). Due to the rapid progress being made today, particularly with neural models, the top entry in …