Papers with CConS
Probing Physical Reasoning with Counter-Commonsense Context (2023.acl-short)
Copied to clipboard
| Challenge: | Recent language models have succeeded in tasks that do not require contextual reasoning, such as size comparison and prediction of event frequency. |
| Approach: | They propose to use a dataset to measure physical commonsense to infer size relationships between objects in contexts that fit physical common sense. |
| Outcome: | The proposed dataset consists of contexts that fit physical commonsense and those that don't . results show that language models fail to use verbs and make incorrect judgments . |