Enhancing Phrase Representation by Information Bottleneck Guided Text Diffusion Process for Keyphrase Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for keyphrase extraction lack the ability to utilize keyphrase information, which may result in biased results. |
| Approach: | They propose a keyphrase extraction task that leverages the supervised Variational Information Bottleneck to guide the text diffusion process for generating enhanced keyphrase representations. |
| Outcome: | The proposed keyphrase extraction model outperforms existing methods on open domain keyphrase extractor benchmark and scientific domain dataset. |
Similar Papers
MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Keyphrase extraction (KPE) extracts phrases in a document that provide a concise summary of the core content. |
| Approach: | They propose an unsupervised keyphrase extraction method that ranks candidates by similarity between embeddings of source document and masked document. |
| Outcome: | The proposed method outperforms state-of-the-art methods on six benchmarks . it achieves average 3.53 improvement over the existing method . |
A Survey on Recent Advances in Keyphrase Extraction from Pre-trained Language Models (2023.findings-eacl)
Copied to clipboard
| Challenge: | Keyphrase extraction is a key component in Natural Language Processing (NLP) systems for selecting a set of phrases from the document that could summarize the important information discussed in the source document. |
| Approach: | They propose to use supervised and unsupervised keyphrase extraction techniques to investigate the state-of-the-art models for keyphrase extracting. |
| Outcome: | The proposed keyphrase extraction system can significantly accelerate the speed of retrieval and help people get first-hand information from a long document quickly and accurately. |
Open Domain Web Keyphrase Extraction Beyond Language Modeling (D19-1)
Copied to clipboard
| Challenge: | Recent neural methods for keyphrase extraction are mostly observed in documents originating from the scientific domain. |
| Approach: | They develop a neural keyphrase extraction model that goes beyond language understanding to handle the variations of domain and content quality. |
| Outcome: | The proposed model can handle the variations of domain and content quality without restriction of the domain, quality, nor content of the documents. |
Representation Learning for Resource-Constrained Keyphrase Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art keyphrase generation methods depend on large annotated datasets, limiting their performance in domains with limited annotation data. |
| Approach: | They propose a method that first identifies salient information using retrieval-based corpus-level statistics and then learns a task-specific intermediate representation based on a pre-trained language model. |
| Outcome: | The proposed method improves keyphrase generation and zero-shot domain adaptation on multiple keyphrase benchmarks. |
Incorporating Multimodal Information in Open-Domain Web Keyphrase Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain Keyphrase extraction (KPE) is a fundamental yet complex NLP task . effective designs encode within layout and formatting signals that point to where the important information can be found. |
| Approach: | They propose a multi-modal approach to open-domain keyphrase extraction (KPE) on the Web that leverages layout and formatting signals to aid in the task. |
| Outcome: | The proposed model outperforms state-of-the-art models on the open-domain keyphrase extraction task. |
SimCKP: Simple Contrastive Learning of Keyphrase Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation and keyphrase extraction use a token level to generate keyphrases that do not appear in a document. |
| Approach: | They propose a simple contrastive learning framework that generates keyphrases that do not appear in a document and a reranker that adapts the scores for each generated phrase. |
| Outcome: | The proposed model outperforms the state-of-the-art models on multiple benchmark datasets. |
An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods on keyphrase generation are purely extractive or generative . however, extractive methods cannot predict absent keyphrases which are not in the document. |
| Approach: | They propose a multi-task learning framework that jointly learns an extractive model and a generative model. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five keyphrase generation tasks. |
Keyphrase Prediction from Video Transcripts: New Dataset and Directions (2022.coling-1)
Copied to clipboard
Amir Pouran Ben Veyseh, Quan Hung Tran, Seunghyun Yoon, Varun Manjunatha, Hanieh Deilamsalehy, Rajiv Jain, Trung Bui, Walter W. Chang, Franck Dernoncourt, Thien Huu Nguyen
| Challenge: | Existing studies on keyphrase prediction have focused on formal texts and informal-text domains. |
| Approach: | They propose to annotate large-scale video transcripts with keyphrases from live-stream video . they propose to feed models with paragraph-level keyphrase extraction to foster future research . |
| Outcome: | The proposed model improves keyphrase prediction in live-stream video transcripts by feeding models with paragraph-level keyphrases. |
Data Augmentation for Low-Resource Keyphrase Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing works on keyphrase generation rely on large-scale annotated datasets, which are not easy to acquire. |
| Approach: | They propose to use full text to improve keyphrase generation in resource-constrained domains by using the full text of the articles to augment their methods. |
| Outcome: | The proposed methods improve both present and absent keyphrase generation on three datasets and show that they are cost-effective. |
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Generally, documents are truncated before being inputs to deep neural networks, resulting in missing keyphrases . evaluators use layer-wise coverage attention to cover all the critical points in a document . |
| Approach: | They propose a neural keyphrase generation model that identifies the salient sentences in a document and an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art keyphrase generation methods on keyphrases generated from scientific and web documents. |