Spider 2.0: Evaluating Language Models on Real-World Enterprise
Text-to-SQL Workflows
Spider 2.0: Evaluating Language Models on Real-World Enterprise
Text-to-SQL Workflows
Real-world enterprise text-to-SQL workflows often involve complex cloud or local data across various database systems, multiple SQL queries in various dialects, and diverse operations from data transformation to analytics. We introduce Spider 2.0, an evaluation framework comprising 632 real-world text-to-SQL workflow problems derived from enterprise-level database use cases. The databases …