Papers by Benjamin Börschinger
Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation (2022.emnlp-main)
Copied to clipboard
| Challenge: | despite the importance of question answering, evaluations of QA systems are typically limited by manual annotations . despite this, little progress has been made in QA evaluations based on a single answer . |
| Approach: | They propose to extend over exact match (EM) with predefined rules or token-level F1 measure . they propose to use a BERT matching measure to approximate QA predictions . |
| Outcome: | The proposed model improves AE approximations and more accurately reflects the performance of systems. |
Fool Me Twice: Entailment from Wikipedia Gamification (2021.naacl-main)
Copied to clipboard
| Challenge: | a new dataset of entailment pairs is released to challenge the goal of examining arbitrary statements. |
| Approach: | They propose a multi-player game that challenges players to solve entailment pairs . the game is open source and encourages adversarial examples . |
| Outcome: | The proposed game lowers the number of examples that can be solved using "shortcuts" the game is open source and the code is available for free. |
What Question Answering can Learn from Trivia Nerds (2020.acl-main)
Copied to clipboard
| Challenge: | a question answering dataset is a competition that has a leaderboard that determines the best answers. |
| Approach: | They propose to apply the best practices of trivia tournaments to question answering datasets . they outline key lessons that can transfer to QA research . |
| Outcome: | The proposed model is based on the best practices of trivia tournaments . the model is used to identify the best question answering teams . |