REBEL: Relation Extraction By End-to-end Language generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to extract relation triplets from text often involve multiple-step pipelines that propagate errors or are limited to a small number of relation types. |
| Approach: | They propose to use autoregressive seq2seq models to simplify Relation Extraction by expressing triplets as a sequence of text and a model that performs end-to-end relation extraction for more than 200 different relation types. |
| Outcome: | The proposed model achieves state-of-the-art on an array of Relation Extraction and Relation Classification benchmarks and achieves top performance in most of them. |
Similar Papers
GenerativeRE: Incorporating a Novel Copy Mechanism and Pretrained Model for Joint Entity and Relation Extraction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for extracting relation triplets suffer from incompletion and disorder problems when they extract multi-token entities from input sentences. |
| Approach: | They propose a special entity labelling method that fine-tunes the pre-trained model and learns the special entity labels simultaneously. |
| Outcome: | The proposed model achieves 4.6% and 0.9% improvement over current methods in the NYT24 and NYT29 benchmark datasets. |
EmRel: Joint Representation of Entities and Embedded Relations for Multi-triple Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies only explore entity representations, but propose a novel triple perspective for relation extraction. |
| Approach: | They propose to explicitly introduce relation representation and jointly represent it with entities to identify valid triples. |
| Outcome: | The proposed method is based on ablations and document-level relation extraction and joint entity and relation extraction. |
GenIE: Generative Information Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to open information extraction only work with unrealistically small numbers of entities and relations. |
| Approach: | They propose to use a transformer encoder-decoder model to extract triplets from unstructured text . they use 'generative information extraction' to generate triplet representations of information . |
| Outcome: | The proposed model is state-of-the-art on closed information extraction and generalizes from fewer training data points than baselines. |
REDFM: a Filtered and Multilingual Relation Extraction Dataset (2023.acl-long)
Copied to clipboard
| Challenge: | Existing Relation Extraction models rely on small datasets with low coverage of relation types . current systems rely only on small data sets with limited coverage of relationship types - especially when working with languages other than english. |
| Approach: | They propose to use an automatic annotated dataset to train relation extraction systems. |
| Outcome: | The proposed model can extract triplets in multiple languages from a human-revised dataset. |
Improving Relation Extraction by Sequence-to-sequence-based Dependency Parsing Pre-training (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies show that dependency information is used only for encoder-only-based relation extraction tasks. |
| Approach: | They propose a syntax-aware seq2seq pre-trained model for relation extraction that incorporates dependency information into a seq2-trained language model by continual pre-training with a dependency parsing task. |
| Outcome: | The proposed model incorporates dependency information into a seq2seq pre-trained language model by continual pre-training with a generative sequence-to-sequence (sequ2sq)-based dependency parsing task. |
Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) is a task that aims to extract relations from a long context. |
| Approach: | They propose an automated annotation method that integrates an LLM and a natural language inference module to generate relation triples. |
| Outcome: | The proposed method can extract relations from document-level relation datasets with minimal human effort. |
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism (P18-1)
Copied to clipboard
| Challenge: | Existing methods focus on normal class and fail to extract relational triplets precisely. |
| Approach: | They propose an end-to-end model which can jointly extract relational triplets from sentences . they employ two different strategies in decoding process: employing only one united decoder or applying multiple separated decodeurs. |
| Outcome: | The proposed model outperforms the baseline method significantly in two datasets. |
Improving Recall of Large Language Models: A Model Collaboration Approach for Relational Triple Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing large language models can extract triples from simple sentences with few-shot learning or fine-tuning, but they often miss out when extracting from complex sentences. |
| Approach: | They propose an evaluation-filtering framework that integrates large language models with small models for relational triple extraction tasks. |
| Outcome: | The proposed framework integrates large language models with small models for relational triple extraction tasks. |
AutoRE: Document-Level Relation Extraction with Large Language Models (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to Sentence-level Relation Extraction (SentRE) tasks. |
| Approach: | They propose an end-to-end DocRE model that adopts a novel RE extraction paradigm named RHF (Relation-Head-Facts) Unlike existing approaches, AutoRE does not rely on the assumption of known relation options, making it more reflective of real-world scenarios. |
| Outcome: | The proposed model surpasses TAG by 10.03% and 9.03% on the dev and test set. |
GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work adopts data augmentation techniques to generate pseudo-annotated sentences . existing methods neither preserve semantic consistency of original sentences nor preserve syntax structure of sentences when expressing relations using seq2seq models, resulting in less diverse augmentations. |
| Approach: | They propose a dedicated augmentation technique for relational texts, named GDA, which uses two complementary modules to preserve both semantic consistency and syntax structures. |
| Outcome: | The proposed technique can bring 2.0% F1 improvements in three datasets under low-resource setting. |