Preserving Generalization of Language models in Few-shot Continual Relation Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for Few-shot Continual Relations Extraction (FCRE) are limited in labeled training data and models must learn from a few new samples to solve new tasks. |
| Approach: | They propose a method that leverages often-discarded language model heads to integrate knowledge from new relations with limited labeled data while avoiding catastrophic forgetting. |
| Outcome: | The proposed method circumvents catastrophic forgetting and preserves prior knowledge from pre-trained backbones while maintaining accuracy of existing classifications. |
Similar Papers
Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to learn new relations with limited labeled data are prone to catastrophic forgetting and overfitting. |
| Approach: | They propose a framework that uses prompts to acquire more generalized knowledge . they propose CFRE to continuously learn new relations while retaining knowledge of old ones . |
| Outcome: | The proposed method outperforms state-of-the-art methods by a large margin and significantly mitigates catastrophic forgetting and overfitting in low-resource scenarios. |
Mutual-pairing Data Augmentation for Fewshot Continual Relation Extraction (2025.naacl-long)
Copied to clipboard
Nguyen Hoang Anh, Quyen Tran, Thanh Xuan Nguyen, Nguyen Thi Ngoc Diep, Linh Ngo Van, Thien Huu Nguyen, Trung Le
| Challenge: | Existing methods for Few-shot Continual Relation Extraction struggle with catastrophic forgetting and overfitting. |
| Approach: | They propose a method that transforms single input sentences into complex texts by integrating old and new data. |
| Outcome: | The proposed method sharpens model focus and improves model performance . it also uncovers fascinating behaviors of Sharpness-Aware Minimization (SAM) in Few-shot Continual Learning. |
Continual Few-shot Relation Extraction via Adaptive Gradient Correction and Knowledge Decomposition (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to learn new relations with limited samples neglect the instability of embeddings in the process of different task training, which leads to catastrophic forgetting. |
| Approach: | They propose a method to analyze catastrophic forgetting by limiting embedding instability . they propose to decompose knowledge into general and task-related knowledge . |
| Outcome: | The proposed method outperforms the state-of-the-art model and improves the following degree of embeddings. |
Mitigating Non-Representative Prototypes and Representation Bias in Few-Shot Continual Relation Extraction (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for few-shot continual relation extraction (FCRE) face two main challenges: non-representative prototypes and representation bias. |
| Approach: | They propose to use General Orthogonal Frame to create robust class prototypes . they also utilize label description representations as global class representatives . |
| Outcome: | The proposed method outperforms state-of-the-art methods on well-known benchmarks on well known FCRE benchmarks. |
Dynamic-prototype Contrastive Fine-tuning for Continual Few-shot Relation Extraction with Unseen Relation Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to learn relations from labeled data overlook task interference in continual learning and memory requirements for different relations. |
| Approach: | They propose a framework to learn new relations from limited labeled data while preserving knowledge about previously learned relations. |
| Outcome: | The proposed framework is more practical and comprehensive for real-world scenarios. |
Enhancing Discriminative Representation in Similar Relation Clusters for Few-Shot Continual Relation Extraction (2025.naacl-long)
Copied to clipboard
Anh Duc Le, Nam Le Hai, Thanh Xuan Nguyen, Linh Ngo Van, Nguyen Thi Ngoc Diep, Sang Dinh, Thien Huu Nguyen
| Challenge: | Existing methods for relation extraction (RE) fail to address the problem of similar relations, which contributes to catastrophic forgetting. |
| Approach: | They propose a relation extraction method that utilizes relation descriptions and dynamic clustering to identify similar relations. |
| Outcome: | The proposed method mitigates catastrophic forgetting and outperforms state-of-the-art methods by a large margin. |
Rationale-Enhanced Language Models are Better Continual Relation Learners (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have found that catastrophic forgetting arises from the model’s lack of robustness against future analogous relations. |
| Approach: | They propose a multi-task rationale tuning strategy to help the model learn current relations robustly and conduct contrastive rationale replay to further distinguish analogous relations. |
| Outcome: | The proposed method outperforms the state-of-the-art models on two benchmarks. |
Improving Continual Few-shot Relation Extraction through Relational Knowledge Distillation and Prototype Augmentation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to Continual Relation Extraction (CRE) are limited in handling the rapid emergence of new relations in real-world scenarios. |
| Approach: | They propose a framework that integrates prototype-based data augmentation and relational knowledge distillation to solve the problem of Continual Few-shot Relation Extraction (CFRE). |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on the FewRel and TACRED datasets. |
Consistent Prototype Learning for Few-Shot Continual Relation Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for few-shot continual relation extraction are overfitting memory samples, resulting in insufficient activation of old relations and limited ability to handle confusion of similar classes. |
| Approach: | They propose a few-shot continual relation extraction task that uses memory-enhanced modules to train a model on incrementally few-shot data to avoid forgetting old relations. |
| Outcome: | The proposed method outperforms existing methods on two commonly-used datasets. |
Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Relation extraction models require extensive annotated training data, which is costly and labor-intensive to collect. |
| Approach: | They propose a new zero-shot RE task where only relation definitions are provided instead of seen-unseen relation instances. |
| Outcome: | The proposed task significantly improves cost-effective zero-shot performance by large margins. |