| Challenge: | Existing methods assume all silver labels are accurate and treat them equally, but distant supervision is noisy–some silver labels more reliable than others. |
| Approach: | They propose a noise-aware contrastive learning approach that leverages fine-grained information about which silver labels are and are not noisy to improve the quality of learned relationship representations. |
| Outcome: | The proposed approach improves relation extraction performance over state-of-the-art methods on several RE benchmarks. |
Similar Papers
Continual Contrastive Finetuning Improves Low-Resource Relation Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Relation extraction (RE) has been challenging in low-resource domains and with limited resources. |
| Approach: | They propose to pretrain and finetune the RE model using consistent objectives of contrastive learning. |
| Outcome: | The proposed method outperforms PLM-based RE classifier on two document-level RE datasets. |
Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Fine-grained classification tasks involve distinguishing between classes with subtle differences between them. |
| Approach: | They analyse fine-grained text classification tasks by embedding class relationships into a contrastive objective function to help differently weigh the positives and negatives. |
| Outcome: | The proposed model outperforms previous contrastive methods on emotion classification and sentiment analysis. |
RelCLIP: Adapting Language-Image Pretraining for Visual Relationship Detection via Relational Contrastive Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing visual relationship detection models only use numeric ids of relation labels for training, but ignore semantic correlation between labels. |
| Approach: | They propose a visual Relationship prediction framework that transfers natural language knowledge from Contrastive Language-Image Pre-training models to enhance the relationship prediction. |
| Outcome: | The proposed framework improves visual relationship prediction by matching semantic correlations with relation triplets. |
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems. |
| Approach: | They propose a method that automatically labels a sentence with relational triples from a knowledge base. |
| Outcome: | The proposed method outperforms existing methods even with false positive samples. |
Enhancing Contrastive Learning with Noise-Guided Attack: Towards Continual Relation Extraction in the Wild (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for continual relation extraction (CRE) excel in preserving old knowledge but falter when confronted with contaminated data streams. |
| Approach: | They propose a noise-resistant contrastive framework for continual relation extraction (CRE) that preserves old knowledge while learning incremental corrupted relations. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on various benchmarks with increasing noise rates. |
Silver Syntax Pre-training for Cross-Domain Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Relation Extraction (RE) is the task of extracting structured knowledge from unstructured text. |
| Approach: | They exploit the affinity between syntactic structure and semantic RE to obtain low-cost pre-training data. |
| Outcome: | The proposed model outperforms baseline models in five out of six cross-domain setups without additional annotated data. |
Relation Extraction with Weighted Contrastive Pre-training on Distant Supervision (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods ignore the intrinsic noise of distant supervision during the pre-training stage. |
| Approach: | They propose a weighted contrastive learning method that explicitly reduces noise . they leverage supervised data to estimate reliability and reduce noise compared to non-weighted baselines . |
| Outcome: | The proposed method reduces the noise of distant supervision and estimates reliability of pre-training instances. |
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches of distantly supervised relation extraction (DSRE) focus on sentence-level or bag-level de-noising, neglecting the explicit interaction with cross levels. |
| Approach: | They propose a hierarchical contrastive learning framework for distantly supervised relation extraction to reduce noisy sentences. |
| Outcome: | The proposed framework outperforms baselines in various mainstream DSRE datasets. |
Noise-Robust Semi-Supervised Learning for Distantly Supervised Relation Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Distantly supervised relation extraction (DSRE) methods are not capable of extracting relation labels for individual sentences. |
| Approach: | They propose a semi-supervised learning relation extraction framework for sentence-level DSRE . they discard only the labels of the noisy samples and utilize them as unlabeled samples . |
| Outcome: | The proposed framework achieves significant performance enhancements on two real-world datasets. |
Semi-supervised Relation Extraction via Data Augmentation and Consistency-training (2023.eacl-main)
Copied to clipboard
| Challenge: | Obtaining high-quality human labelled data is an expensive and noisy process. |
| Approach: | They propose to leverage unlabelled data to improve the sample efficiency of the models. |
| Outcome: | The proposed methods can be used to extract the Cause-Effect relation between a given head entity and tail entity based on context in the input sentence. |