Reasoning about Actions and State Changes by Injecting Commonsense Knowledge (D18-1)
Copied to clipboard
| Challenge: | Recent work has shown impressive progress in comprehending procedural text, but their predictions can be inconsistent or highly improbable. |
| Approach: | They propose to incorporate global constraints and bias reading with corpora-based preferences to improve the predicted effects of actions in a paragraph. |
| Outcome: | The proposed model significantly outperforms earlier models on a benchmark dataset for procedural text comprehension (+8% relative gain) it avoids nonsensical predictions that earlier models make, and it is more robust than previous models. |
Similar Papers
Learning the Effects of Physical Actions in a Multi-modal Environment (2023.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are trained on large corpora of disembodied texts. |
| Approach: | They propose a multi-modal task of predicting the outcomes of actions solely from realistic sensory inputs (images and text). They extend an LLM to model latent representations of objects to better predict action outcomes in an environment. |
| Outcome: | The proposed model can capture commonsense when augmented with visual information and generalize and learn commonsensical reasoning better. |
Tracking State Changes in Procedural Text: a Challenge Dataset and Models for Process Paragraph Comprehension (N18-1)
Copied to clipboard
| Challenge: | Using synthetic data, existing models struggle with questions that require inference. |
| Approach: | They propose a dataset and two new neural models that exploit alternative mechanisms for state prediction. |
| Outcome: | The proposed dataset improves accuracy by 19% over previous models. |
Everything Happens for a Reason: Discovering the Purpose of Actions in Procedural Text (D19-1)
Copied to clipboard
| Challenge: | XPAD is a new model that predicts actions' effects and their dependencies based on background knowledge . previous work on extracting sequences of actions from text has focused on identifying why they are the way they are . |
| Approach: | They propose a new model that biases effect predictions towards those that explain more of the actions in the paragraph and are more plausible with respect to background knowledge. |
| Outcome: | The proposed model outperforms existing systems on explaining actions by predicting dependencies while maintaining the performance on the original task in ProPara. |
Commonsense Reasoning for Natural Language Processing (2020.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will outline the various types of commonsense knowledge and discuss techniques to gather and represent commonsence knowledge. |
| Approach: | This tutorial will provide researchers with the critical foundations and recent advances in commonsense representation and reasoning. |
| Outcome: | This tutorial will outline the various types of commonsense and discuss techniques to gather and represent commonsence knowledge while highlighting the challenges specific to this type of knowledge (e.g., reporting bias). |
What Action Causes This? Towards Naive Physical Action-Effect Prediction (P18-1)
Copied to clipboard
| Challenge: | a new task on naive physical action-effect prediction addresses the relationship between concrete actions and their effects on the state of the physical world as depicted by images. |
| Approach: | They propose a task that harnesses web image data to facilitate action-effect prediction. |
| Outcome: | The proposed approach harnesses web image data through distant supervision to facilitate learning for action-effect prediction. |
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work proposes lightweight updates to improve commonsense reasoning models . fine-tuning can cause models to overfit to task-specific data and forget knowledge gained during training . |
| Approach: | They propose to use lightweight models to update pre-trained language models to learn commonsense background knowledge. |
| Outcome: | The proposed models learn from commonsense reasoning datasets, but they are overfitted and limited generalized. |
Be Consistent! Improving Procedural Text Comprehension using Label Consistency (N19-1)
Copied to clipboard
| Challenge: | Existing systems for procedural text comprehension still struggle with this task . evaluative work shows that consistent predictions from multiple entities can improve performance . |
| Approach: | They propose a framework that leverages label consistency during training to improve prediction performance. |
| Outcome: | The proposed framework significantly improves prediction performance over previous state-of-the-art systems on a standard benchmark dataset for procedural text, ProPara. |
EvEntS ReaLM: Event Reasoning of Entity States via Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to model event implications fail to reason about the world, despite their knowledge of physical attributes. |
| Approach: | They propose to use a model prompting technique to prompt models of event implications by targeting their understanding of physical attributes. |
| Outcome: | The proposed model prompting technique is especially useful for unseen attributes or when only limited data is available. |
Debiasing Event Understanding for Visual Commonsense Tasks (2022.findings-acl)
Copied to clipboard
| Challenge: | a recent study shows that object-based event understanding is purely likelihood-based, leading to incorrect event prediction. |
| Approach: | They propose to mitigate object-based event understanding by optimizing aggregation with association-based prediction. |
| Outcome: | The proposed approach improves visual commonsense reasoning tasks by combining do-calculus with association-based prediction. |
Commonsense Justification for Action Explanation (D18-1)
Copied to clipboard
| Challenge: | a recent study examines the commonsense reasoning used by humans to justify an AI prediction. |
| Approach: | They propose an approach that models object relations/attributes of the world as latent variables and jointly learns a performer that predicts actions and an explainer that gathers commonsense evidence to justify the action. |
| Outcome: | The proposed model achieves significantly higher performance in both action prediction and justification. |