CORE: A Few-Shot Company Relation Classification Dataset for Robust Domain Adaptation.

Philipp Borchert; Jochen De Weerdt; Kristof Coussement; Arno De Caigny; Marie-Francine Moens

doi:10.18653/v1/2023.emnlp-main.722

CORE: A Few-Shot Company Relation Classification Dataset for Robust Domain Adaptation. (2023.emnlp-main)

Copied to clipboard

Philipp Borchert, Jochen De Weerdt, Kristof Coussement, Arno De Caigny, Marie-Francine Moens

Responsible & Trustworthy NLP

few-shot relation classification (RC

few-shot RC models

few-shot domain adaptation setting

domain generalization

Challenge:	Existing datasets that focus on company relations and business entities are lacking in relation classification.
Approach:	They introduce a few-shot relation classification dataset for company relations and business entities . they use a dataset that includes 4,708 instances of 12 relation types .
Outcome:	The proposed dataset includes 4,708 instances of 12 relation types with corresponding textual evidence extracted from company Wikipedia pages.

Similar Papers

Overview

Challenge

Approach

Outcome

Towards Realistic Few-Shot Relation Extraction (2021.emnlp-main)

Copied to clipboard

Sam Brody, Sichao Wu, Adrian Benton

Information Extraction & Text Mining

Challenge:	Recent studies have shown that few-shot relation classification models can be used to extract any relation of interest from a collection of text with only a few example instances.
Approach:	They propose to modify the training routine to encourage models to better discriminate between relations involving similar entity types.
Outcome:	The proposed models outperform human models on relation extraction tasks while relying on entity type information.

Few-Shot Named Entity Recognition: An Empirical Baseline Study (2021.emnlp-main)

Copied to clipboard

Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han

Language Models

Challenge:	Existing methods to build named entity recognition systems with limited labeled data are lacking.
Approach:	They propose three orthogonal schemes to build named entity recognition systems when labeled data is limited.
Outcome:	The proposed NER systems outperform existing methods on few-shot and training-free settings.

FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation (D18-1)

Copied to clipboard

Xu Han, Hao Zhu, Pengfei Yu, Ziyun Wang, Yuan Yao, Zhiyuan Liu, Maosong Sun

Low-Resource NLP

Challenge:	Empirical results show that even the most competitive few-shot learning models struggle on this task, especially as compared with humans.
Approach:	They propose a Few-Shot Relation Classification Dataset consisting of 70, 000 sentences on 100 relations derived from Wikipedia and annotated by crowdworkers.
Outcome:	The proposed methods perform well on the most competitive few-shot learning models, especially as compared with humans.

Towards Realistic Few-Shot Relation Extraction: A New Meta Dataset and Evaluation (2024.lrec-main)

Copied to clipboard

Fahmida Alam, Md Asiful Islam, Robert Vacareanu, Mihai Surdeanu

Low-Resource NLP

Challenge:	Existing methods for few-shot relation extraction are not realistic due to the large amount of training data required.
Approach:	They propose a meta dataset for few-shot relation extraction based on existing supervised relation extraction datasets and a few-shot form of the TACRED dataset.
Outcome:	The proposed methods perform poorly on the few-shot relation extraction task.

Few-NERD: A Few-shot Named Entity Recognition Dataset (2021.acl-long)

Copied to clipboard

Ning Ding, Guangwei Xu, Yulin Chen, Xiaobin Wang, Xu Han, Pengjun Xie, Haitao Zheng, Zhiyuan Liu

Low-Resource NLP

Challenge:	Existing approaches to few-shot named entity recognition (NER) focus on coarse-grained entities with few examples, while most unseen entities are fine-grounded.
Approach:	They present a human-annotated few-shot named entity recognition dataset . they construct benchmark tasks to assess the generalization capability of models .
Outcome:	The proposed model is the first few-shot NER dataset and the largest human-crafted NER data set.

FewRel 2.0: Towards More Challenging Few-Shot Relation Classification (D19-1)

Copied to clipboard

Tianyu Gao, Xu Han, Hao Zhu, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

Information Extraction & Text Mining

Challenge:	Few-shot domain adaptation and NOTA detection are two real-world challenges for few-shot relation classification models.
Approach:	They propose a task to investigate two aspects of few-shot relation classification models . they build upon the FewRel dataset by adding a new test set in a different domain .
Outcome:	The proposed task can evaluate few-shot domain adaptation and few- shot none-of-the-above detection on a new domain and NOTA relation choice.

Large-Scale Label Interpretation Learning for Few-Shot Named Entity Recognition (2024.eacl-long)

Copied to clipboard

Jonas Golde, Felix Hamborg, Alan Akbik

Responsible & Trustworthy NLP

Challenge:	Few-shot named entity recognition (NER) uses only a few annotated examples to identify named entities within text.
Approach:	They propose to leverage natural language descriptions of each entity type to perform few-shot named entity recognition.
Outcome:	The proposed model learns to interpret verbalized descriptions of entities using natural language descriptions of their types and their verbalizations.

Best of Both Worlds: A Pliable and Generalizable Neuro-Symbolic Approach for Relation Classification (2024.findings-naacl)

Copied to clipboard

Robert Vacareanu, Fahmida Alam, Md Asiful Islam, Haris Riaz, Mihai Surdeanu

Information Extraction & Text Mining

Challenge:	a novel neuro-symbolic architecture for relation classification combines rule-based methods with deep learning techniques.
Approach:	They propose a neuro-symbolic architecture for relation classification that combines rule-based methods with deep learning techniques.
Outcome:	The proposed approach outperforms state-of-the-art models in three out of four settings . human interventions boost the performance on the relation org:parents by as much as 26% relative improvement .

Exploring the zero-shot limit of FewRel (2020.coling-main)

Copied to clipboard

Alberto Cetoli

Language Models

Challenge:	Existing methods to extract information from a language model are limited in their ability to generalize and do not perform as well as few-shot learning models.
Approach:	They propose a general purpose relation extractor that uses Wikidata descriptions to represent the relation’s surface form.
Outcome:	The proposed system is based on a FewRel 1.0 dataset, which provides an excellent framework for training and evaluating the proposed system in English.

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification (2020.coling-main)

Copied to clipboard

Bowen Dong, Yuan Yao, Ruobing Xie, Tianyu Gao, Xu Han, Zhiyuan Liu, Fen Lin, Leyu Lin, Maosong Sun

Language Models

Challenge:	Existing meta-learning models rely on implicit instance statistics and are unreliability and weak interpretability.
Approach:	They propose a meta-information guided meta-learning framework that uses semantics to guide meta- learning . experimental results demonstrate the effectiveness of the proposed framework .
Outcome:	The proposed framework can establish connections between instance-based information and semantic-based data, enabling faster initialization and adaptation.