Challenge: Neural keyphrase generation models can output absent keyphrases, which are keyphrase that do not appear in the source text.
Approach: They propose a finer-grained categorization scheme that sheds more light on the impact of absent keyphrases on scientific document retrieval.
Outcome: The proposed model shows that only 20% of the words that make up keyphrases actually serve as document expansion, but this small fraction behind much of the gains observed in retrieval effectiveness.

Similar Papers

Keyphrase Generation for Scientific Document Retrieval (2020.acl-main)

Copied to clipboard

Challenge: Sequence-to-sequence models have been used to generate keyphrases, but it is unclear whether they are reliable enough for document retrieval.
Approach: They propose a framework for extrinsic evaluation that allows for a better understanding of the limitations of keyphrase generation models.
Outcome: The proposed models improve retrieval performance by supplementing documents with keyphrases that are not present in the source text and generalizing models across domains.
KPDROP: Improving Absent Keyphrase Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to generate absent keyphrases have limited results in generating present keyphrase.
Approach: They propose a model-agnostic approach to generate absent keyphrases by randomly dropping present keyphrase from a document and turning them into artificial absent key phrases during training.
Outcome: The proposed approach improves absent keyphrase generation in both supervised and resource-constrained settings.
Improving Absent Keyphrase Generation with Diversity Heads (2024.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to generating keyphrases for a given text are limited to extracting only the keyphrase that is directly seen in the document.
Approach: They propose to treat present keyphrase extraction as a sequence labeling problem and treat absent keyphrases together in a text-to-text generation framework during training.
Outcome: The proposed model improves on the state-of-the-art for present keyphrase extraction and five datasets for absent keyphrase generation among the six English datasets.
Keyphrase Generation: A Text Summarization Struggle (N19-1)

Copied to clipboard

Challenge: Existing methods for keyphrase generation are unable to produce valuable terms that do not appear in the text.
Approach: They propose to consider the keyphrase string as an abstractive summary of the title and the abstract.
Outcome: The proposed method can generate better keyphrases than the existing methods or the unsupervised ones.
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories.
Approach: They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator.
Outcome: The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks.
One Size Does Not Fit All: Generating and Evaluating Variable Number of Keyphrases (2020.acl-main)

Copied to clipboard

Challenge: Existing models for keyphrase generation do not provide a desideratum for the number of keyphrases in texts.
Approach: They propose a recurrent generative model that generates multiple keyphrases as delimiter-separated sequences.
Outcome: The proposed model outperforms baseline models on all datasets.
Keyphrase Generation Beyond the Boundaries of Title and Abstract (2022.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to keyphrase generation use only the title and abstract of the articles.
Approach: They propose to integrate full text and semantically similar articles to generate keyphrases from a dataset that includes the full text of the articles along with the title and abstract.
Outcome: The proposed model can generate keyphrases that are present or absent from the text.
An Empirical Study on Neural Keyphrase Generation (2021.naacl-main)

Copied to clipboard

Challenge: Recent years have seen a flourishing of neural keyphrase generation (KPG) works, including the release of several large-scale datasets and a host of new models to tackle them.
Approach: They propose to compare the generalizability of KPG models with other models by analyzing the most crucial factors that may affect their generalizarability.
Outcome: The proposed model can be used to predict keyphrases from a set of input sequences, and it can be compared with existing models.
A Survey on Recent Advances in Keyphrase Extraction from Pre-trained Language Models (2023.findings-eacl)

Copied to clipboard

Challenge: Keyphrase extraction is a key component in Natural Language Processing (NLP) systems for selecting a set of phrases from the document that could summarize the important information discussed in the source document.
Approach: They propose to use supervised and unsupervised keyphrase extraction techniques to investigate the state-of-the-art models for keyphrase extracting.
Outcome: The proposed keyphrase extraction system can significantly accelerate the speed of retrieval and help people get first-hand information from a long document quickly and accurately.
Paraphrase Types for Generation and Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Current approaches to paraphrase generation and detection ignore the intricate linguistic properties of language.
Approach: They propose two tasks to consider specific linguistic perturbations at particular text positions.
Outcome: The proposed tasks address the shortcoming of ignoring the linguistic properties of language.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations