Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives (N19-1)
Copied to clipboard
| Challenge: | To properly infer the intention of the narrator, one needs a certain degree of common sense and social intuition. |
| Approach: | They propose a task that uses common sense to extract pairs of questions that are appropriate candidates for the task. |
| Outcome: | The proposed method exploits commonalities in experiences people share online to extract pairs of semantically plausible advice-seeking questions that are appropriate candidates for the cloze task. |
Similar Papers
A Corpus for Commonsense Inference in Story Cloze Test (2022.lrec-1)
Copied to clipboard
| Challenge: | Story Cloze Test (SOTA) models can achieve over 90% accuracy on predicting the last sentence, but high accuracy can be achieved by merely using surface-level features. |
| Approach: | They constructed a human-labeled and human-verified commonsense knowledge inference dataset using data from 1871 stories and three human workers labeled each story. |
| Outcome: | The proposed models can achieve 90% accuracy on predicting the last sentence, but they don't perform well on new and more challenging tasks. |
A Simple and Effective Approach to the Story Cloze Test (N18-2)
Copied to clipboard
| Challenge: | Existing approaches to the Cloze Test that use feature engineering to achieve high accuracy are ignoring the training set and training a model on the validation set. |
| Approach: | They propose a fully-neural approach to the Cloze Test using skip-thought embeddings of the stories in a feed-forward network that achieves close to state-of-the-art performance without any feature engineering. |
| Outcome: | The proposed approach achieves close to state-of-the-art performance on the Cloze Test without any feature engineering. |
Answering Narrative-Driven Recommendation Queries via a Retrieve–Rank Paradigm and the OCG-Agent (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate narrative-driven recommendation are based on large language models (LLMs) but the RAG paradigm is inherently ill-suited for such special queries. |
| Approach: | They propose a novel retrieve-rank paradigm that generatively retrieves structurally adaptive and semantically aligned candidates, ensuring both extensive candidate coverage and high-quality information. |
| Outcome: | The proposed paradigm outperforms the existing paradigm and the existing one under real-world scenarios. |
Event2Mind: Commonsense Inference on Events, Intents, and Reactions (P18-1)
Copied to clipboard
| Challenge: | Using a crowdsourced corpus of 25,000 event phrases, we construct a new task that uses commonsense reasoning to reason about the likely intents and reactions of the event participants. |
| Approach: | They construct a crowdsourced corpus of 25,000 event phrases and use them to construct 'commonsense inference' they demonstrate that neural encoder-decoder models can compose embedding representations of previously unseen events and reason about the likely intents and reactions of the event participants. |
| Outcome: | The proposed task can be used to uncover implicit gender inequality in movie scripts. |
ClozEx: A Task toward Generation of English Cloze Explanation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tasks and datasets specifically designed for generating language learner explanations for cloze questions are lacking . clozing questions are used to assess language proficiency and enhance language learning . |
| Approach: | They propose a task ClozEx to generate explanations for cloze questions in LA . they use a curated dataset of clozing questions paired with explanations . |
| Outcome: | The proposed task generates fluent explanations for cloze questions in English as a second language learners. |
Pedagogically Aligned Objectives Create Reliable Automatic Cloze Tests (2024.naacl-long)
Copied to clipboard
| Challenge: | a recent study has focused on the cloze training objective of Masked Language Models . distractors must be distinct and incorrect, and can be biased if the test creator is testing two versions of a text . |
| Approach: | They propose a method that jointly optimizes sets of distractors from Masked Language Models. |
| Outcome: | The proposed method has stronger correlation with teacher-created comprehension tests than state-of-the-art neural method and is more internally consistent. |
Narrative Embedding: Re-Contextualization Through Attention (2021.emnlp-main)
Copied to clipboard
| Challenge: | a novel approach to narrative event representation uses attention to re-contextualize events across the whole story . a recent study shows that attention is used to attach event semantics to tokens . |
| Approach: | They propose an unsupervised approach to narrative event representation using attention to re-contextualize events across the whole story. |
| Outcome: | The proposed approach achieves state of the art performance on multiple choice and story cloze tasks. |
Tackling the Story Ending Biases in The Story Cloze Test (P18-2)
Copied to clipboard
| Challenge: | Story Cloze Test (SCT) is a recent framework for evaluating story comprehension and script learning. |
| Approach: | They propose to use a crowdsourcing scheme to create a new SCT dataset to overcome some of the biases discovered in the original SCT. |
| Outcome: | The proposed model performs better than the baselines on the SCT dataset, despite human-authorship biases. |
EA2E: Improving Consistency with Event Awareness for Document-Level Argument Extraction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work on document-level event argument extraction models each individual event in isolation and therefore causes inconsistency among extracted arguments across events. |
| Approach: | They propose an event-aware argument extraction model with augmented context to improve consistency . they hypothesize that participants tend to play consistent roles across multiple events in a document . |
| Outcome: | The proposed model improves consistency and accuracy of arguments extracted from documents. |
Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) excel in generating coherent texts, but their ability to comprehend the author’s thoughts remains uncertain. |
| Approach: | They conduct a comprehensive survey of narrative understanding tasks, examining their key features, definitions, taxonomy, associated datasets, evaluation metrics, and limitations. |
| Outcome: | The proposed framework could be extended to address novel narrative understanding tasks. |