Papers by John Murzaku
Re-Examining FactBank: Predicting the Author’s Presentation of Factuality (2022.coling-1)
Copied to clipboard
| Challenge: | Previously published results on FactBank are no longer valid. |
| Approach: | They propose to correct a subset of FactBank data to improve performance . they use multiple training paradigms, data smoothing techniques, and polarity classifiers . |
| Outcome: | The proposed model improves performance on the FactBank dataset. |
Towards Generative Event Factuality Prediction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event factuality prediction focus on author's presentation of factuity . a novel end-to-end generative task is proposed to predict event factuality holders, targets, and their associated factual values. |
| Approach: | They propose a generative task and system for predicting event factuality holders, targets, and their associated factual values. |
| Outcome: | The proposed system improves on the FactBank corpus and other corpora . it can predict presentation of factuality of nested sources alongside their target events . |
BeLeaf: Belief Prediction as Tree Generation (2024.naacl-demo)
Copied to clipboard
| Challenge: | a novel approach to predicting source-and-target factuality is presented . our linearized tree generation task fully accounts for the factuity tree structure . |
| Approach: | They propose a linearized tree generation task which fully accounts for factuality . they then create a system which leverages the linearized representation to create visualizations . |
| Outcome: | The proposed model and representation fully account for the factuality tree structure, generating the full chain of nested sources instead of the last source only. |
Views Are My Own, but Also Yours: Benchmarking Theory of Mind Using Common Ground (2024.findings-acl)
Copied to clipboard
Adil Soubki, John Murzaku, Arash Yousefi Jordehi, Peter Zeng, Magdalena Markowska, Seyed Abolghasem Mirroshandel, Owen Rambow
| Challenge: | Existing benchmarks for theory of mind (ToM) use synthetic data, which can misalign with human behavior. |
| Approach: | They propose a question-answer benchmark based on naturally occurring spoken dialogs to evaluate theory of mind capabilities of language models. |
| Outcome: | The proposed dataset shows that LMs struggle to demonstrate theory of mind (ToM) . |
Synthetic Audio Helps for Cognitive State Tasks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prior work in NLP focuses on tasks that involve extracting information about the cognitive states of human entities from text. |
| Approach: | They propose a framework for learning to add synthetic audio to text-only corpora and a system that automatically tracks audio signals to produce naturalistic audio. |
| Outcome: | The proposed framework improves on 7 cognitive state modeling tasks on text and synthetic audio data from an off-the-shelf TTS system. |