Prompt-based Text Entailment for Low-Resource Named Entity Recognition (2022.coling-1)
Copied to clipboard
| Challenge: | Pre-trained Language Models (PLMs) have been applied in NLP tasks but require labeled data for downstream tasks. |
| Approach: | They propose a method for low-resource named entity recognition that uses prompts to get entailment scores for each candidate and inject tagging labels into prompts. |
| Outcome: | The proposed method achieves competitive performance on the CoNLL03 dataset, and better than fine-tuned counterparts on the MIT Movie and Few-NERD datasets in low-resource settings. |
Similar Papers
Prompt-learning for Fine-grained Entity Typing (2022.findings-emnlp)
Copied to clipboard
Ning Ding, Yulin Chen, Xu Han, Guangwei Xu, Xiaobin Wang, Pengjun Xie, Haitao Zheng, Zhiyuan Liu, Juanzi Li, Hong-Gee Kim
| Challenge: | Extensive experiments on fine-grained entity typing under fully supervised, few-shot, and zero-shot settings show the effectiveness of prompt-learning. |
| Approach: | They propose a prompt-learning pipeline that stimulates versatile knowledge of pre-trained language models (PLMs) by constructing entity-oriented verbalizers and templates and conducting masked language modeling. |
| Outcome: | The proposed approach can be applied to fine-grained entity typing in fully supervised, few-shot, and zero-shot scenarios. |
EvoPrompt: Evolving Prompts for Enhanced Zero-Shot Named Entity Recognition with Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a low-resource task that requires supervised learning, but practical scenarios lack annotated data. |
| Approach: | They propose an Evolving Prompts framework that guides the model to better address these issues through continuous prompt refinement. |
| Outcome: | The proposed framework shows consistent performance improvements on four benchmarks. |
PromptNER: Prompt Locating and Typing for Named Entity Recognition (2023.acl-long)
Copied to clipboard
Yongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang, Rongsheng Zhang, Yadong Xi, Weiming Lu, Yueting Zhuang
| Challenge: | Existing methods for prompt learning require a multi-round prompting manner and require elaborate templates. |
| Approach: | They propose to unify entity locating and entity typing into prompt learning by enumerating spans to predict their entity types or constructing type-specific prompts to locate entities. |
| Outcome: | The proposed model outperforms the state-of-the-art model in a few-shot setting . it uses a template filled with multiple prompts and a bipartite graph matching mechanism . |
Entailment as Robust Self-Learner (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have found that entailment pretraining benefits weakly supervised fine-tuning. |
| Approach: | They propose a prompting strategy that formulates different NLU tasks as contextual entailment and propose an algorithm for better pseudo-labeling quality in self-training. |
| Outcome: | The proposed approach improves the zero-shot adaptation performance on downstream tasks. |
DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt-based methods have shown their efficacy in transferring general knowledge within pre-trained language models (PLMs) however, when applied to zero-shot entity and relation extraction, they struggle with the limited coverage of verbalizers to labels and the slow inference speed. |
| Approach: | They propose a method which reformulates zero-shot tasks into token discrimination tasks without having to construct verbalizers. |
| Outcome: | The proposed method outperforms baselines on two zero-shot entity recognition datasets with higher inference speed and achieves 7.5% improvement over previous state-of-the-art models on Wiki-ZSL and FewRel. |
Improving and Simplifying Template-Based Named Entity Recognition (2023.eacl-srw)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is traditionally approached as a sequence labeling task where a tag is predicted for each token. |
| Approach: | They propose to convert a Named Entity Recognition task into a seq2seq task by generating synthetic sentences using templates. |
| Outcome: | The proposed model outperforms the current state-of-the-art approach in resource-rich, low resource and domain transfer settings and the negative examples play an important role in its performance. |
Prompt-Based Metric Learning for Few-Shot NER (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing metric learning methods do not fully incorporate label semantics into modeling. |
| Approach: | They propose a method to largely improve metric learning for few-shot named entity recognition (NER) a pre-defined category is a key natural language understanding task . |
| Outcome: | The proposed method outperforms the previous state-of-the-art (SOTA) method with 16 of 18 settings outperformed previous methods by 9.12% and 34.51% . |
PromptDA: Label-guided Data Augmentation for Prompt-based Few Shot Learners (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on prompt-based few-shot tuning focus on deriving proper label words with a verbalizer or generating prompt templates to elicit semantics from PLMs. |
| Approach: | They propose a framework that leverages label semantics for prompt-based tuning. |
| Outcome: | The proposed framework improves on few-shot text classification tasks by leveraging label semantics and data augmentation. |
Improving Low-Resource Named Entity Recognition using Joint Sentence and Token Labeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models for named entity recognition (NER) use sentence-level labels, which are expensive to obtain, to improve NER. |
| Approach: | They propose a sentence-level named entity recognition model that uses sentence-based labels that are easy to obtain. |
| Outcome: | The proposed model produces 3.78%, 4.20%, 2.08% improvements in F1 over the baseline on e-commerce product titles in Vietnamese, Thai, and Indonesian, respectively. |
Prompt Tuning for Discriminative Pre-trained Language Models (2022.findings-acl)
Copied to clipboard
Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang
| Challenge: | Recent studies have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing tasks. |
| Approach: | They propose a prompt tuning framework that reformulates NLP tasks into a discriminative language modeling problem. |
| Outcome: | The proposed framework improves on text classification and question answering tasks and prevents unstable tuning problems in low-resource settings. |