One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing selection methods make redundant selections, causing poor recall and accuracy. |
| Approach: | They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector. |
| Outcome: | The proposed framework surpasses state-of-the-art models in absent keyphrase prediction. |
Similar Papers
One2Set: Generating Diverse Keyphrases as a Set (2021.acl-long)
Copied to clipboard
| Challenge: | Recent keyphrase generation models are wrongly imposing a predefined order on keyphrases . a new training paradigm is proposed to concatenate keyphrase sequences in parallel . |
| Approach: | They propose a training paradigm that concatenates keyphrases in a predefined order . they propose combining a fixed set of learned control codes with a bipartite matching mechanism . |
| Outcome: | The proposed model outperforms the state-of-the-art methods on multiple benchmarks. |
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document . |
| Approach: | They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document. |
| Outcome: | The proposed model over-estimates tokens and makes it well-calibrated on common datasets. |
Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Keyphrase generation is a longstanding task in NLP with widespread applications. |
| Approach: | They propose a likelihood-based decode-select algorithm for seq2seq PLMs that improves greedy search by an average of 4.7% semantic F1 across five datasets. |
| Outcome: | The proposed algorithm improves greedy search by an average of 4.7% semantic F1 across five datasets. |
On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | a new study examines the use of encoder-only pre-trained language models in keyphrase generation (KPG) keyphrases are phrases that condense salient information of a document. |
| Approach: | They propose to use encoder-only pre-trained language models in keyphrase generation . they also examine optimal architectural decisions for employing encoder only PLMs in KPG . |
| Outcome: | The proposed model outperforms general-domain seq2seq models in keyphrase generation. |
General-to-Specific Transfer Labeling for Domain Adaptable Keyphrase Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Large distribution shifts among different domains hinder transferability of keyphrase generation models. |
| Approach: | They propose a pipeline which guides KPG models’ learning focus from general syntactical features to domain-related semantics in a data-efficient manner. |
| Outcome: | The proposed pipeline can produce good quality keyphrases in new domains and achieve consistent improvements after adaptation with limited in-domain annotated data. |
An Empirical Study on Neural Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent years have seen a flourishing of neural keyphrase generation (KPG) works, including the release of several large-scale datasets and a host of new models to tackle them. |
| Approach: | They propose to compare the generalizability of KPG models with other models by analyzing the most crucial factors that may affect their generalizarability. |
| Outcome: | The proposed model can be used to predict keyphrases from a set of input sequences, and it can be compared with existing models. |
Zero-Shot Keyphrase Generation: Investigating Specialized Instructions and Multi-sample Aggregation on Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Keyphrase generation is a long-standing NLP task for automatically generating keyphrases for a given document. |
| Approach: | They propose to use open-source instruction-tuned LLMs for keyphrase generation . they propose task-specific counterparts to self-consistency-style strategies for LLM . |
| Outcome: | The proposed model improves on existing models and shows significant benefits over baselines. |
Automatic Keyphrase Generation by Incorporating Dual Copy Mechanisms in Sequence-to-Sequence Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation use a copy mechanism to generate keyphrases, but they do not identify key words in the source text and copy them to create more keyphrase. |
| Approach: | They propose a dual-copier keyphrase generation model that uses a sequence-to-sequence model to generate keyphrases for a piece of text. |
| Outcome: | The proposed model outperforms baseline models and achieves an obvious performance improvement. |
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories. |
| Approach: | They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator. |
| Outcome: | The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks. |
Keyphrase Generation: Lessons from a Reproducibility Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Reproducibility studies are used to verify the validity of a scientific method, but what else can we learn from such experiments? |
| Approach: | They use Keyphrase Generation to examine reproducibility under different conditions . they draw conclusions on state of the art in KPG and provide guidelines for researchers . |
| Outcome: | The proposed models are compared under the same or varied conditions and provide guidelines for reporting results in a more comprehensive manner. |