Papers by Matthew Mandelkern
Conditional and Modal Reasoning in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Inferences involving conditionals and modals play a central role in the fundamental human ability to reason about distal possibilities. |
| Approach: | They propose to assess the extent to which 29 LLMs are able to distinguish logically correct inferences from logical fallacious ones. |
| Outcome: | The LLMs that make basic mistakes with conditionals and modals display inconsistent judgments across inference patterns involving epistemic modal and conditionals, and give answers about complex conditional inferences that do not match reported human judgments. |