Improving Absent Keyphrase Generation with Diversity Heads (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to generating keyphrases for a given text are limited to extracting only the keyphrase that is directly seen in the document. |
| Approach: | They propose to treat present keyphrase extraction as a sequence labeling problem and treat absent keyphrases together in a text-to-text generation framework during training. |
| Outcome: | The proposed model improves on the state-of-the-art for present keyphrase extraction and five datasets for absent keyphrase generation among the six English datasets. |
Similar Papers
KPDROP: Improving Absent Keyphrase Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generate absent keyphrases have limited results in generating present keyphrase. |
| Approach: | They propose a model-agnostic approach to generate absent keyphrases by randomly dropping present keyphrase from a document and turning them into artificial absent key phrases during training. |
| Outcome: | The proposed approach improves absent keyphrase generation in both supervised and resource-constrained settings. |
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories. |
| Approach: | They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator. |
| Outcome: | The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks. |
Redefining Absent Keyphrases and their Effect on Retrieval Effectiveness (2021.naacl-main)
Copied to clipboard
| Challenge: | Neural keyphrase generation models can output absent keyphrases, which are keyphrase that do not appear in the source text. |
| Approach: | They propose a finer-grained categorization scheme that sheds more light on the impact of absent keyphrases on scientific document retrieval. |
| Outcome: | The proposed model shows that only 20% of the words that make up keyphrases actually serve as document expansion, but this small fraction behind much of the gains observed in retrieval effectiveness. |
Improving Low-Resource Keyphrase Generation through Unsupervised Title Phrase Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised keyphrase generation use phrases extracted from document title instead of phrase bank. |
| Approach: | They propose a method for generating pseudo labels from a document title . they use phrases mined from the document title to generate absent keyphrases . |
| Outcome: | The proposed method outperforms existing methods on human-annotated datasets even with fewer labeled data. |
Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on keyphrase generation on non-English languages haven’t been vastly investigated. |
| Approach: | They propose a retrieval-augmented method for multilingual keyphrase generation that leverages keyphrase annotations in English datasets to facilitate generating keyphrases in low-resource languages. |
| Outcome: | The proposed model outperforms baselines on non-English keyphrase generation datasets and the proposed model is scalable. |
An Empirical Study on Neural Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent years have seen a flourishing of neural keyphrase generation (KPG) works, including the release of several large-scale datasets and a host of new models to tackle them. |
| Approach: | They propose to compare the generalizability of KPG models with other models by analyzing the most crucial factors that may affect their generalizarability. |
| Outcome: | The proposed model can be used to predict keyphrases from a set of input sequences, and it can be compared with existing models. |
Heterogeneous Graph Neural Networks for Keyphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for keyphrase generation generate uncontrollable and inaccurate absent keyphrases. |
| Approach: | They propose a graph-based method that captures explicit knowledge from related references. |
| Outcome: | The proposed model improves on baseline keyphrase generation models on multiple benchmarks. |
One2Set + Large Language Model: Best Partners for Keyphrase Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing selection methods make redundant selections, causing poor recall and accuracy. |
| Approach: | They propose a framework to generate keyphrases from a one2set-based model and an LLM as selector. |
| Outcome: | The proposed framework surpasses state-of-the-art models in absent keyphrase prediction. |
Keyphrase Generation: Lessons from a Reproducibility Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Reproducibility studies are used to verify the validity of a scientific method, but what else can we learn from such experiments? |
| Approach: | They use Keyphrase Generation to examine reproducibility under different conditions . they draw conclusions on state of the art in KPG and provide guidelines for researchers . |
| Outcome: | The proposed models are compared under the same or varied conditions and provide guidelines for reporting results in a more comprehensive manner. |
Diverse Keyphrase Generation with Neural Unlikelihood Training (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in neural natural language generation have made possible remarkable progress on the task of keyphrase generation, however, the importance of diversity in keyphrases has been largely ignored. |
| Approach: | They propose to train a sequence-to-sequence keyphrase generation model from the perspective of diversity. |
| Outcome: | The proposed model achieves large diversity gains while maintaining competitive output quality. |