Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing QA frameworks that use event-centric reasoning are lacking. |
| Approach: | They propose a novel QA model with contrastive learning and invertible event transformation . they use an invertable transformation matrix to project event vectors into a common event embedding space . |
| Outcome: | The proposed model achieves 8.4% gain in token-level F1 score and 3.0% gain in Exact Match score on the ESTER dataset. |
Similar Papers
Long Context Question Answering via Supervised Contrastive Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Long-context question answering tasks often require identifying evidence spans (e.g., sentences) prior work showed that jointly training models to perform evidence extraction and question answering is important for achieving high performance. |
| Approach: | They propose a method for equipping long-context QA models with an additional sequence-level objective for better identification of the supporting evidence. |
| Outcome: | The proposed method exhibits consistent improvements on three different strong long-context transformer models, across two challenging question answering benchmarks – HotpotQA and QAsper. |
Event Extraction as Question Generation and Answering (2023.acl-short)
Copied to clipboard
| Challenge: | Recent work on Event Extraction addresses the error propagation issue found in token-based classification approaches. |
| Approach: | They propose a Question Generation (QG) model that generates questions that leverage contextual information instead of fixed templates. |
| Outcome: | The proposed model outperforms all previous single-task-based models on the ACE05 English dataset. |
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work on event-centric reasoning fails to model event-level correlations . Existing studies limit their scope to specific scenarios or overlook event- level correlations. |
| Approach: | They propose to pre-train a general Correlation-aware context-to-Event Transformer for event-centric reasoning by highlighting event-level correlations with effective training. |
| Outcome: | The proposed model is applicable to a wide range of event-centric reasoning scenarios, considering its versatility of event correlation types, application formulations, and reasoning types. |
UNIFIEDQA: Crossing Format Boundaries with a Single QA System (2020.findings-emnlp)
Copied to clipboard
Daniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal, Oyvind Tafjord, Peter Clark, Hannaneh Hajishirzi
| Challenge: | Question answering (QA) tasks have been posed using a variety of formats . a new study aims to develop specialized QA models that can be used to train QA systems . |
| Approach: | They build a pre-trained question answering model that performs well across 19 QA datasets . they argue that format-specialized models can limit the ability to teach reasoning . |
| Outcome: | a new model that trains on QA datasets performs on par with 8 models trained on individual datasets . a single model that trained on UNIFIEDQA performs well on 19 QA data . |
Event Extraction by Answering (Almost) Natural Questions (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work in event argument extraction relies heavily on entity recognition as a preprocessing/concurrent step, causing error propagation. |
| Approach: | They propose a question answering task that extracts event arguments in an end-to-end manner. |
| Outcome: | The proposed framework outperforms prior work on the ACE 2005 task on event argument extraction. |
Event-Centric Query Expansion in Web Search (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing studies rely on long-term search log mining to improve search experience . EQE system is a novel event retrieval framework that can select the best expansion from a significant amount of potential events quickly and accurately. |
| Approach: | They propose a QE system that uses a four-stage event retrieval framework . they collect news headlines and then refine a dual-tower semantic model to serve as an encoder . |
| Outcome: | The proposed system can select the best expansion from a significant amount of potential events quickly and accurately. |
Contrastive Representation Learning for Cross-Document Coreference Resolution of Events and Entities (2022.naacl-main)
Copied to clipboard
| Challenge: | Identifying related entities and events within and across documents is fundamental to natural language understanding. |
| Approach: | They propose an approach to entity and event coreference resolution using contrastive representation learning. |
| Outcome: | The proposed method achieves state-of-the-art results on key metrics on the ECB+ corpus and is competitive on others. |
Question Answering Infused Pre-training of General-Purpose Contextualized Representations (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing pretraining objectives for question answering (QA) are not optimized for being immediately useful without fine-tuning. |
| Approach: | They propose a pre-training objective based on question answering (QA) that is based more directly on context. |
| Outcome: | The proposed model matches predictions of a more accurate cross-encoder model on 80 million synthesized QA pairs and achieves large improvements over previous state-of-the-art models on paraphrase detection and fewshot named entity recognition. |
CEAN: Contrastive Event Aggregation Network with LLM-based Augmentation for Event Extraction (2024.eacl-long)
Copied to clipboard
| Challenge: | Event Extraction is a crucial yet arduous task in natural language processing (NLP), as its performance is hindered by laborious data annotation. |
| Approach: | They propose a Contrastive Event Aggregation Network with LLM-based Augmentation to promote low-resource learning and reduce data noise for event extraction. |
| Outcome: | The proposed approach achieves new state-of-the-art results on the ACE2005 and ERE-EN datasets. |
ESTER: A Machine Reading Comprehension Dataset for Reasoning about Event Semantic Relations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent event-centric reading comprehension datasets focus mostly on event arguments or temporal relations. |
| Approach: | They propose a machine reading comprehension dataset that leverages natural language queries to reason about the five most common event semantic relations. |
| Outcome: | The proposed dataset shows that current SOTA systems achieve 22.1%, 63.3% and 83.5% for token-based exact-match, **F1** and event-based **HIT@1** scores. |