Papers by Martin Pömsl
The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources (2023.acl-long)
Copied to clipboard
Akshatha Arodi, Martin Pömsl, Kaheer Suleman, Adam Trischler, Alexandra Olteanu, Jackie Chi Kit Cheung
| Challenge: | Existing models that make inferences using information from multiple sources are largely understudied . |
| Approach: | They propose a test suite of coreference resolution subtasks that require reasoning over multiple facts and introduce subtask where knowledge is present only at inference time using fictional knowledge. |
| Outcome: | The proposed subtasks differ in terms of which knowledge sources contain the relevant facts and where knowledge is present only at inference time using fictional knowledge. |