| Challenge: | Existing prompt tuning methods for RC are limited by label spaces and rigid prompt restrictions. |
| Approach: | They propose a generative prompt tuning method to reformulate relation classification as an infilling problem by adding cloze-style phrases to masked language modeling problems. |
| Outcome: | The proposed method exploits rich semantics of entity and relation types and can predict label verbalizations with varying lengths at multiple predicted positions. |
Similar Papers
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that pre-trained language models have gained rich knowledge during pre-training. |
| Approach: | They propose to tune pre-trained language models with task-specific prompts to improve and stabilize prompttuning. |
| Outcome: | Extensive experiments on zero and few-shot text classification tasks show that prompt-tuning improves and stabilizes prompttun-ing. |
FPC: Fine-tuning with Prompt Curriculum for Relation Extraction (2022.aacl-main)
Copied to clipboard
| Challenge: | Existing methods for relation extraction ignore semantics of relation labels . prompt-based fine-tuning has been proposed for RE . |
| Approach: | They propose a method for relation extraction using prompt-based fine-tuning . they use auxiliary prompt-tuned learning task to make the model capture semantics of relation labels . |
| Outcome: | The proposed method outperforms existing methods on four widely used RE benchmarks under fully supervised and low-resource settings. |
Prompt Tuning for Discriminative Pre-trained Language Models (2022.findings-acl)
Copied to clipboard
Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang
| Challenge: | Recent studies have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing tasks. |
| Approach: | They propose a prompt tuning framework that reformulates NLP tasks into a discriminative language modeling problem. |
| Outcome: | The proposed framework improves on text classification and question answering tasks and prevents unstable tuning problems in low-resource settings. |
Prompt Tuning for Few-shot Relation Extraction via Modeling Global and Local Graphs (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies show that prompt-tuning is effective for few-shot relation extraction tasks. |
| Approach: | They propose to incorporate the knowledge in relation labels into prompt-tuning by inserting prompt templates into the input. |
| Outcome: | The proposed method improves on four datasets under low-resource conditions. |
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent research shows that prompt-based learning improves performance on relation extraction tasks. |
| Approach: | They propose a prompt-based learning method that generates comprehensive prompts for biomedical relation extraction using a ChemProt dataset. |
| Outcome: | The proposed method improves fine-tuning on a biomedical relation extraction task with a cloze-test task and fewer training examples to make reasonable predictions. |
Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Multi-level implicit discourse relation recognition (MIDRR) aims at identifying hierarchical discourse relations among arguments. |
| Approach: | They propose a prompt-based multi-level implicit discourse relation recognition framework that leverages parameter-efficient prompt tuning to drive inputted arguments to match the pre-trained space. |
| Outcome: | The proposed framework achieves comparable results on PDTB 2.0 and 3.0 using about 0.1% trainable parameters compared with baselines. |
The Power of Prompt Tuning for Low-Resource Semantic Parsing (2022.acl-short)
Copied to clipboard
| Challenge: | Prompt tuning is an effective method for adapting pre-trained language models to downstream tasks. |
| Approach: | They propose to use prompt tuning for semantic parsing to map natural language utterances onto formal meaning representations. |
| Outcome: | The proposed method outperforms the fine-tuned model on low-resource splits of Overnight and TOPv2 on language representations with increasing model scale and target representations. |
Knowledge-enhanced Prompt Tuning for Dialogue-based Relation Extraction with Trigger and Label Semantic (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to determine semantic relation between two arguments in dialogues are limited due to the low information density of text. |
| Approach: | They propose a Knowledge-Enhanced Prompt-Tuning method to enhance DRE model by exploiting trigger and label semantics. |
| Outcome: | The proposed method achieves state-of-the-art in F1 and F1c scores on a DialogRE dataset. |
Multilingual Relation Classification via Efficient and Effective Prompting (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on prompt-based multilingual relation classification (RC) uses pre-trained language models with limited resources. |
| Approach: | They propose a prompt-based multilingual relation classification method that constructs relation triples from relation triple labels and requires minimal translation for the class labels. |
| Outcome: | The proposed method outperforms baselines in English-task training in cross-lingual settings and in fully supervised and few-shot scenarios. |
Prompt Tuning for Unified Multimodal Pretrained Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt tuning has demonstrated success in natural language pretraining and even vision pretraining. |
| Approach: | They propose to apply prompt tuning to a unified sequence-to-sequence pretrained model by adding a sequence of learnable embeddings to each layer and finetuning the pretrained models on downstream tasks. |
| Outcome: | The proposed method outperforms other parameter-efficient tuning methods on multimodal models and is robust against adversarial attacks. |