Papers by Fredrik Riseby
Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark (2024.acl-short)
Copied to clipboard
| Challenge: | BIRD-Bench was created to model dirty and noisy database values, but it was not created to contain noise and errors in the questions and gold SQL queries. |
| Approach: | They analysed the distribution and types of noise in the widely used BIRD-Bench benchmark and the impact of noise on models. |
| Outcome: | The BIRD-Bench benchmark contains ambiguous questions and syntactical errors, but it was not designed to contain noise and errors in the questions and gold SQL queries. |