Papers by Ellery Smith
StatBot.Swiss: Bilingual Open Data Exploration in Natural Language (2024.findings-acl)
Copied to clipboard
Farhad Nooralahzadeh, Yi Zhang, Ellery Smith, Sabine Maennel, Cyril Matthey-Doret, Raphaël De Fondeville, Kurt Stockinger
| Challenge: | StatBot.Swiss dataset is the first bilingual benchmark for evaluating Text-to-SQL systems based on real-world applications. |
| Approach: | They propose to use a bilingual dataset to evaluate LLMs in Text-to-SQL systems. |
| Outcome: | The proposed dataset contains 455 natural language/SQL-pairs over 35 big databases with varying level of complexity for English and German. |