Papers by Eitan Wagner
Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for Theory of Mind (ToM) focus on whether agents have correct beliefs about others. |
| Approach: | They propose to evaluate Theory of Mind (ToM) capabilities in Large Language Models (LLMs) they propose to use the theory of mind to determine whether and how to invoke ToM . |
| Outcome: | The proposed frameworks can be used to evaluate the performance of large language models (LLMs) in biological agents. |
Exploring the Learning Capabilities of Language Models using LEVERWORLDS (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models of stochastic learning involve learning general structure rules and specific properties of the instance. |
| Approach: | They propose a framework that allows the generation of physics-inspired worlds that follow a similar generative process with different distributions and their instances can be expressed in natural language. |
| Outcome: | The proposed framework allows the generation of physics-inspired worlds that follow a similar generative process with different distributions and their instances can be expressed in natural language. |
CONTESTS: a Framework for Consistency Testing of Span Probabilities in Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Language model scores are often treated as probabilities, but their reliability as probability estimators has mainly been studied through calibration, overlooking other aspects. |
| Approach: | They propose a framework to assess model reliability across interchangeable completion and conditioning orders by performing statistical tests on real and synthetic data to eliminate training effects. |
| Outcome: | The proposed framework assesses the consistency of model predictions across interchangeable completion and conditioning orders on real and synthetic data to eliminate training effects. |
Computational Analysis of Character Development in Holocaust Testimonies (2025.emnlp-main)
Copied to clipboard
| Challenge: | This work examines character development along the narrative timeline by analyzing changes in the protagonist’s views and behavior and the interplay between them. |
| Approach: | They propose to analyze character development along the narrative timeline using a transcript of Holocaust survivor testimonies as a test case. |
| Outcome: | The proposed approach characterizes changes in the protagonist’s views and behavior and the interplay between them. |
Event-Location Tracking in Narratives: A Case Study on Holocaust Testimonies (2023.emnlp-main)
Copied to clipboard
| Challenge: | a primary goal of narrative analysis is to represent essential dimensions of stories in a schematic manner. |
| Approach: | They propose a task to extract the sequence of locations where the narrative is set through its progression. |
| Outcome: | The proposed task is based on the test case of Holocaust survivor testimonies . it shows that models that are aware of the larger context can generate more accurate locations chains. |
Topical Segmentation of Spoken Narratives: A Test Case on Holocaust Survivor Testimonies (2022.emnlp-main)
Copied to clipboard
| Challenge: | Topical segmentation is a task that has been neglected in recent work . a drawback of this approach is the lack of interpretability, which is crucial in some contexts. |
| Approach: | They propose to model running (spoken) narratives using topic segmentation . they hypothesize that boundary points between segments correspond to low mutual information . |
| Outcome: | The proposed approaches show significant improvements over manual approaches. |