ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations (2022.naacl-demo)
Copied to clipboard
| Challenge: | Information Extraction (IE) analysts use supervised machine learning to define the schema and build a training corpus with annotated examples. |
| Approach: | They propose a workflow where the analyst verbalizes the entities/relations, which are then used by a Textual Entailment model to perform zero-shot IE. |
| Outcome: | The proposed workflow performs very well on four IE tasks with a single user interface and a video demonstration is available on vimeo. |
Similar Papers
Zshot: An Open-source Framework for Zero-Shot Named Entity Recognition and Relation Extraction (2023.acl-demo)
Copied to clipboard
Gabriele Picco, Marcos Martinez Galindo, Alberto Purpura, Leopold Fuchs, Vanessa Lopez, Thanh Lam Hoang
| Challenge: | ZSL is a machine learning field that uses textual descriptions of entities or relations to perform tasks that are not seen during training. |
| Approach: | They propose a framework that allows researchers to compare state-of-the-art ZSL methods with standard benchmark datasets. |
| Outcome: | The proposed framework compares state-of-the-art methods with benchmark datasets and provides APIs for production under the standard SpaCy NLP pipeline. |
ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learning (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to relation extraction require labeled data, but labeling is difficult . Existing models cannot recognize rare instances that are never covered by training data . |
| Approach: | They propose a multi-task learning model that directly predicts unseen relations without hand-crafted attribute labeling and multiple pairwise classifications. |
| Outcome: | The proposed model outperforms existing methods by 13.54% on two well-known datasets. |
Label Verbalization and Entailment for Effective Zero and Few-Shot Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Relation extraction systems require large amounts of labeled examples which are costly to annotate. |
| Approach: | They propose to use hand-made relation extraction tasks to refine a pretrained textual entailment engine which is run as-is or further fine-tuned on labeled examples. |
| Outcome: | The proposed system achieves 63% F1 zero-shot, 69% with 16 examples per relation and 4 points short of the state-of-the-art system on the same conditions. |
Document-Level Zero-Shot Relation Extraction with Entity Side Information (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches rely on Large Language Models (LLMs) to generate synthetic data for unseen labels. |
| Approach: | They propose a document-level zero-shot relation extraction framework with Entity Side Information to solve existing problems. |
| Outcome: | The proposed approach achieves an average improvement of 11.6% in the macro F1-Score compared to baseline models and existing benchmarks. |
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work shows that Relation Extraction tasks can be recasted as Textual Entailment tasks using verbalizations. |
| Approach: | They propose to recasted RE tasks as Textual Entailment tasks using verbalizations . they show that entailment reduces the need for manual annotation to 50% and 20% . |
| Outcome: | The proposed method reduces the need for manual annotation to 50% and 20% in event argument extraction tasks while achieving the same performance as with full training. |
Handling Missing Entities in Zero-Shot Named Entity Recognition: Integrated Recall and Retrieval Augmentation (2025.naacl-long)
Copied to clipboard
| Challenge: | Zero-shot Named Entity Recognition (ZS-NER) aims to recognize entities in unseen domains without specific annotated data. |
| Approach: | They propose a novel two-stage framework leveraging large language model techniques to improve the ZS-NER’s recall rate. |
| Outcome: | The proposed framework improves the ZS-NER’s recall rate and accuracy by incorporating a large language model. |
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | a number of information extraction tasks require task-specific training. |
| Approach: | They propose a text-to-triple translation framework for information extraction tasks . they propose enabling task-agnostic translation by leveraging latent knowledge of a pre-trained language model . |
| Outcome: | The proposed framework outperforms the existing methods on open information extraction tasks. |
Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination (2022.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale pretrained language models suffer from reporting bias, describing the lack of explicit commonsense knowledge in written text. |
| Approach: | They propose to endow language models with visual imagination capabilities by recalling existing images and synthesizing nonexistent images via text-to-image generation. |
| Outcome: | The proposed model improves the performance of existing language models across a diverse set of language tasks. |
ZEST: Zero-shot Learning from Text Descriptions using Textual Similarity and Visual Summarization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Specifically, given birds’ images with free-text descriptions of their species, we learn to classify images of previously-unseen species based on specie descriptions. |
| Approach: | They propose to leverage the similarity between species and extract visual summaries from the texts to match visual features to the parts of the text that discuss them. |
| Outcome: | The proposed model outperforms the state-of-the-art on the largest benchmarks for text-based zero-shot learning. |
A weakly supervised textual entailment approach to zero-shot text classification (2023.eacl-main)
Copied to clipboard
Marc Pàmies, Joan Llop, Francesco Multari, Nicolau Duran-Silva, César Parra-Rojas, Aitor Gonzalez-Agirre, Francesco Alessandro Massucci, Marta Villegas
| Challenge: | Existing methods to train on weakly supervised datasets are expensive due to the computational cost of pre-training. |
| Approach: | They propose a method that trains on a weakly supervised dataset that is used as a proxy for a textual entailment problem and a target zero-shot text classification task. |
| Outcome: | The proposed model achieves state-of-the-art performance in the scientific domain and competitive results in other areas. |