Social Commonsense Reasoning with Multi-Head Knowledge Attention (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. |
| Approach: | They propose a multi-head knowledge attention model that encodes semi-structured commonsense inference rules and learns to incorporate them in a transformer-based reasoning cell. |
| Outcome: | The proposed model improves performance on two reasoning tasks that require different reasoning skills. |
Similar Papers
It’s All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning (2021.findings-acl)
Copied to clipboard
| Challenge: | gilbert et al.: commonsense reasoning is a key problem in natural language processing but its capabilities are still unstudied. gilland eetal.: a new approach to commonsensible reasoning is needed to solve the problem. |
| Approach: | They propose a method which trains a linear classifier with weights of multi-head attention as features and a multilingual Winograd Schema corpus to measure cross-lingual generalization ability. |
| Outcome: | The proposed approach performs competitively with recent approaches even when applied to other languages in a zero-shot manner. |
Learning Event Graph Knowledge for Abductive Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for abductive reasoning based on formal logic lack commonsense knowledge and effective reasoning mechanism. |
| Approach: | They propose a narrative text-based abductive reasoning task NLI with a latent variable to capture commonsense knowledge from event graph for guiding the abductive reasoning task. |
| Outcome: | The proposed model outperforms baseline methods on the abductive reasoning task. |
Neural-Symbolic Commonsense Reasoner with Relation Predictors (2021.acl-short)
Copied to clipboard
| Challenge: | Existing models for commonsense reasoning are limited by their limited set of facts, rendering them unfit for reasoning over new unseen situations and events. |
| Approach: | They propose a neural-symbolic reasoner which can combine commonsense facts with large-scale dynamic CKGs to draw conclusions about ordinary situations. |
| Outcome: | The proposed model outperforms the state-of-the-art models on the task of link prediction on CKGs. |
Attention Is (not) All You Need for Commonsense Reasoning (P19-1)
Copied to clipboard
| Challenge: | Recent language models such as word2vec have produced impressive results on various tasks such as question-answering and natural language inference. |
| Approach: | They propose a simple re-implementation of BERT for commonsense reasoning . they propose to use attention-guided reasoning to solve the Pronoun Disambiguation Problem . |
| Outcome: | The proposed model outperforms the state-of-the-art on several language understanding benchmarks while outperforming the existing models by a margin. |
Unsupervised Deep Structured Semantic Models for Commonsense Reasoning (N19-1)
Copied to clipboard
| Challenge: | Existing methods for commonsense reasoning rely on human-crafted features and knowledge bases, but unsupervised learning is not feasible due to the lack of labeled training data or comprehensive knowledge bases. |
| Approach: | They propose two unsupervised models based on the Deep Structured Semantic Models framework to tackle two commonsense reasoning tasks: Winograd Schema Challenge (WSC) and Pronoun Disambiguation (PDP). |
| Outcome: | The proposed models capture contextual information in the sentence and co-reference information between pronouns and nouns, and achieve significant improvement over previous state-of-the-art approaches. |
COGEN: Abductive Commonsense Language Generation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing training methods for NLP models to perform on two main tasks are needed to introduce these capabilities into the field of reasoning. |
| Approach: | They propose a model that integrates commonsense reasoning with contextual filtering to improve the inference. |
| Outcome: | The proposed model outperforms existing models and sets new state-of-the-art in regards to alphaNLI and alphaNGG tasks. |
Event2Mind: Commonsense Inference on Events, Intents, and Reactions (P18-1)
Copied to clipboard
| Challenge: | Using a crowdsourced corpus of 25,000 event phrases, we construct a new task that uses commonsense reasoning to reason about the likely intents and reactions of the event participants. |
| Approach: | They construct a crowdsourced corpus of 25,000 event phrases and use them to construct 'commonsense inference' they demonstrate that neural encoder-decoder models can compose embedding representations of previously unseen events and reason about the likely intents and reactions of the event participants. |
| Outcome: | The proposed task can be used to uncover implicit gender inequality in movie scripts. |
Coconut: Contextualized Commonsense Unified Transformers for Graph-Based Commonsense Augmentation of Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that pre-trained language models lack commonsense knowledge . |
| Approach: | They propose a contextualized knowledge prompting scheme to guide the contextualization of structured commonsense knowledge based on large language models. |
| Outcome: | The proposed approach outperforms the state-of-the-art technique by an average of 5.8%. |
COMET-M: Reasoning about Multiple Events in Complex Sentences (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing commonsense models that generate event-centric inferences for simple sentences struggle with the complexity of multi-event sentences prevalent in natural text. |
| Approach: | They propose a commonsense model that generates inferences for a target event within a complex sentence using a multi-event inference dataset. |
| Outcome: | The proposed model produces inferences for a target event within a complex sentence taking the complete context into account. |
CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | HKUST-KnowComp proposes a framework for commonsense reasoning that can be used to conceptualize commonsence knowledge bases at scale. |
| Approach: | They propose a framework that integrates event conceptualization and instantiation to conceptualize commonsense knowledge bases at scale. |
| Outcome: | The proposed framework achieves state-of-the-art on two conceptualization tasks and the acquired abstract commonsense knowledge significantly improves commonsence inference modeling. |