Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extraction (2020.findings-emnlp)
Copied to clipboard
Ranran Haoran Zhang, Qianying Liu, Aysa Xuemo Fan, Heng Ji, Daojian Zeng, Fei Cheng, Daisuke Kawahara, Sadao Kurohashi
| Challenge: | Existing methods to extract relation triplets from plain text introduce exposure bias . prior work has focused on pipeline methods that ignore intrinsic interactions between subtasks and propagate classification errors through the tasks. |
| Approach: | They propose a model that reduces the decoding length to three within a triplet and removes the order among triplets. |
| Outcome: | The proposed model overfits to both datasets while showing better generalization. |
Similar Papers
REBEL: Relation Extraction By End-to-end Language generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to extract relation triplets from text often involve multiple-step pipelines that propagate errors or are limited to a small number of relation types. |
| Approach: | They propose to use autoregressive seq2seq models to simplify Relation Extraction by expressing triplets as a sequence of text and a model that performs end-to-end relation extraction for more than 200 different relation types. |
| Outcome: | The proposed model achieves state-of-the-art on an array of Relation Extraction and Relation Classification benchmarks and achieves top performance in most of them. |
GenerativeRE: Incorporating a Novel Copy Mechanism and Pretrained Model for Joint Entity and Relation Extraction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for extracting relation triplets suffer from incompletion and disorder problems when they extract multi-token entities from input sentences. |
| Approach: | They propose a special entity labelling method that fine-tunes the pre-trained model and learns the special entity labels simultaneously. |
| Outcome: | The proposed model achieves 4.6% and 0.9% improvement over current methods in the NYT24 and NYT29 benchmark datasets. |
EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies only explore entity representations, but propose a novel triple perspective for relation extraction. |
| Approach: | They propose to explicitly introduce relation representation and jointly represent it with entities to identify valid triples. |
| Outcome: | The proposed method is based on ablations and document-level relation extraction and joint entity and relation extraction. |
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to extract rich correlations between entities and relations are not fully exploited by existing methods. |
| Approach: | They propose to unify entities and relations by jointly encoding them within a concatenated natural language sequence and unify the modeling of interactions with a proposed Interaction Map. |
| Outcome: | The proposed method is more efficient and efficient than existing methods and can be scaled up to 2021. |
Debiasing Generative Named Entity Recognition by Calibrating Sequence Likelihood (2023.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to recognize flat, overlapped and discontinuous entities uniformly have been used for Named Entity Recognition. |
| Approach: | They propose a reranking-based approach that redistributes the likelihood among candidate sequences depending on their performance via a contrastive loss. |
| Outcome: | The proposed method boosts baseline and yields competitive or better results compared with the state-of-the-art methods on 8 widely-used datasets for Named Entity Recognition. |
Mutual Exclusivity Training and Primitive Augmentation to Induce Compositionality (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent datasets expose the lack of systematic generalization ability in standard sequence-to-sequence models. |
| Approach: | They propose two techniques to address the lack of systematic generalization ability in standard sequence-to-sequence models by mutual exclusivity training and prim2primX data augmentation. |
| Outcome: | The proposed methods improve on two widely-used compositionality datasets. |
Towards Understanding Gender Bias in Relation Extraction (2020.acl-main)
Copied to clipboard
Andrew Gaut, Tony Sun, Shirlyn Tang, Yuxin Huang, Jing Qian, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, William Yang Wang
| Challenge: | Existing bias mitigation techniques have a negative effect on NRE, a study finds . |
| Approach: | They create a dataset to analyze gender bias in relation extraction systems . they find that existing bias mitigation techniques have a negative effect on NRE . |
| Outcome: | The proposed dataset analyzes gender bias in relation extraction systems using a 10% human annotated test set. |
StereoRel: Relational Triple Extraction from a Stereoscopic Perspective (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for relational triple extraction still face challenges, including information loss and error propagation. |
| Approach: | They propose a model which maps relational triples to a three-dimensional space and leverages three decoders to extract them. |
| Outcome: | The proposed model outperforms the baselines on five public datasets. |
Seq2Emo: A Sequence to Multi-Label Emotion Classification Model (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for multi-label emotion classification are based on binary relevance and classifier chain (CC) |
| Approach: | They propose a sequence-to-emotion approach which implicitly models emotion correlations in a bi-directional decoder. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on a SemEval’18 and GoEmotions dataset. |
UniRE: A Unified Label Space for Entity Relation Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing joint entity relation extraction models setup two separate label spaces for the two sub-tasks . |
| Approach: | They propose to eliminate the different treatment on the two sub-tasks’ label spaces by applying a unified classifier to predict each cell’s label. |
| Outcome: | The proposed model achieves competitive accuracy with the best extractor and is faster. |