SimCKP: Simple Contrastive Learning of Keyphrase Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation and keyphrase extraction use a token level to generate keyphrases that do not appear in a document. |
| Approach: | They propose a simple contrastive learning framework that generates keyphrases that do not appear in a document and a reranker that adapts the scores for each generated phrase. |
| Outcome: | The proposed model outperforms the state-of-the-art models on multiple benchmark datasets. |
Similar Papers
An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods on keyphrase generation are purely extractive or generative . however, extractive methods cannot predict absent keyphrases which are not in the document. |
| Approach: | They propose a multi-task learning framework that jointly learns an extractive model and a generative model. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five keyphrase generation tasks. |
Exclusive Hierarchical Decoding for Deep Keyphrase Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to generate keyphrases ignore hierarchical compositionality of keyphrase set and generate duplicated keyphrase sets. |
| Approach: | They propose a hierarchical decoding framework that explicitly models hierarchic compositionality of a keyphrase set and either a soft or a hard exclusion mechanism to enhance the diversity of the generated keyphrases. |
| Outcome: | The proposed framework generates less duplicated and more accurate keyphrases on a set of keyphrase sets. |
A Survey on Recent Advances in Keyphrase Extraction from Pre-trained Language Models (2023.findings-eacl)
Copied to clipboard
| Challenge: | Keyphrase extraction is a key component in Natural Language Processing (NLP) systems for selecting a set of phrases from the document that could summarize the important information discussed in the source document. |
| Approach: | They propose to use supervised and unsupervised keyphrase extraction techniques to investigate the state-of-the-art models for keyphrase extracting. |
| Outcome: | The proposed keyphrase extraction system can significantly accelerate the speed of retrieval and help people get first-hand information from a long document quickly and accurately. |
Fine-grained Contrastive Learning for Definition Generation (2022.aacl-main)
Copied to clipboard
| Challenge: | Recent pre-trained transformer-based definition generation models lack effective representation learning to contain full semantic components of the given word, leading to under-specific definitions. |
| Approach: | They propose a novel contrastive learning method that encourages the model to capture more detailed semantic representations from the definition sequence encoding. |
| Outcome: | The proposed method could generate more specific definitions compared with state-of-the-art models. |
Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation (2022.acl-long)
Copied to clipboard
Mingzhe Li, XieXiong Lin, Xiuying Chen, Jinxiong Chang, Qishen Zhang, Feng Wang, Taifeng Wang, Zhongyi Liu, Wei Chu, Dongyan Zhao, Rui Yan
| Challenge: | Existing studies focus on contrastive learning on the instance level without discriminating the contribution of each word. |
| Approach: | They propose a hierarchical contrastive learning mechanism which can unify semantic meaning in the input text. |
| Outcome: | The proposed model outperforms baselines on storytelling, paraphrasing, dialogue generation, and storytelling tasks. |
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories. |
| Approach: | They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator. |
| Outcome: | The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks. |
KFCNet: Knowledge Filtering and Contrastive Learning for Generative Commonsense Reasoning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have led to substantial gains over a broad range of NLP tasks, but have limitations for high-quality tasks such as commonsense generation and ad keyword generation. |
| Approach: | They propose a Knowledge Filtering and Contrastive learning Network which references external knowledge and achieves better generation performance. |
| Outcome: | The proposed model outperforms the current state of the art on the CommonGen benchmark by a large margin. |
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Generally, documents are truncated before being inputs to deep neural networks, resulting in missing keyphrases . evaluators use layer-wise coverage attention to cover all the critical points in a document . |
| Approach: | They propose a neural keyphrase generation model that identifies the salient sentences in a document and an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art keyphrase generation methods on keyphrases generated from scientific and web documents. |
Match More, Extract Better! Hybrid Matching Model for Open Domain Web Keyphrase Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for keyphrase extraction use noisy information to filter the salient phrases from the document. |
| Approach: | They propose a hybrid matching model that combines representation-focused and interaction-based matching modules into a unified framework for improving keyphrase extraction. |
| Outcome: | The proposed model outperforms state-of-the-art keyphrase extraction models on the OpenKP dataset. |
MetaKP: On-Demand Keyphrase Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing keyphrase prediction methods only output a single set of keyphrases per document . however, existing methods fail to cater to diverse needs of users and downstream applications . |
| Approach: | They propose a method that requires keyphrases that conform to specific high-level goals or intents to generate on-demand keyphrase generation. |
| Outcome: | The proposed method surpasses the performance of a fully fine-tuned BART-base model in 0.548 SemF1 . it can be used in epidemic event detection from social media. |