Papers by Sebastian Houben
Robustness Evaluation of the German Extractive Question Answering Task (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for Question Answering systems only include EM and F1 scores, but they overlook critical factors for the deployment of QA systems. |
| Approach: | They propose to define an evaluation method specifically tailored to the German language to evaluate the robustness of German QA models. |
| Outcome: | The proposed method extends existing methods to German language . it shows that all models are vulnerable to character-level perturbations . |