Papers by Anthony Cohn
A Notion of Complexity for Theory of Mind via Discrete World Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Theory of Mind (ToM) can be used to assess the capabilities of Large Language Models (LLMs) in complex scenarios where social reasoning is required. |
| Approach: | They propose a framework inspired by cognitive load theory to measure the complexity of ToM tasks by a prompting technique that augments the information available to a model with a description of how the environment changes with the agents’ interactions. |
| Outcome: | The proposed framework assesses the complexity of five widely adopted ToM benchmarks and shows that it performs better than other frameworks. |