A Timestep aware Sentence Embedding and Acme Coverage for Brief but Informative Title Generation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for title generation are based on timestep aware sentence embeddings, but they are not effective for generating a title with appropriate information in the content. |
| Approach: | They propose a Timestep aware Sentence Embedding mechanism which refreshes the sentences’ embeddings with corresponding key words in different decoding timesteps. |
| Outcome: | The proposed framework outperforms existing methods on various title generation tasks and the evaluation scores are significantly higher than previous approaches. |
Similar Papers
Adversarial Domain Adaptation Using Artificial Titles for Abstractive Title Generation (P19-1)
Copied to clipboard
| Challenge: | Obtaining good quality labeled data can be difficult and expensive for abstractive summarization models . authors propose the use of artificial titles for unlabeled target documents . |
| Approach: | They propose to use artificial titles and sequential training to capture grammatical style of unlabeled target domains to adapt to/from news articles and Stack Exchange posts. |
| Outcome: | The proposed techniques can boost performance for unsupervised adaptation and fine-tuning with limited target data. |
Structure-Augmented Keyphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Creating keyphrases that are likely to be words absent from the given document is challenging . |
| Approach: | They propose novel keyphrase generation tasks that augment missing context by adding keyphrases to documents. |
| Outcome: | The proposed keyphrase generation task outperforms the state-of-the-art in two keyphrase tasks. |
Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Sentence embedding is essential for many NLP tasks, but reliance on manual labels limits scalability. |
| Approach: | They propose a method for controlling the generation direction of large language models in the latent space by integrating ranking information and semantic information. |
| Outcome: | The proposed method achieves new SOTA performance with a modest cost in ranking sentence synthesis. |
Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for news headline generation focus on producing a single short sentence . et al., 2017; Gehrmann e.t., 2018; Zhong ee., 2019) focus on single-headline generation. |
| Approach: | They propose a method to generate multiple headlines with keyphrases of user interests . they propose generating multiple keyphrase-relevant headlines using a transformer decoder . |
| Outcome: | The proposed method achieves state-of-the-art in terms of quality and diversity. |
Keyphrase Generation Beyond the Boundaries of Title and Abstract (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to keyphrase generation use only the title and abstract of the articles. |
| Approach: | They propose to integrate full text and semantically similar articles to generate keyphrases from a dataset that includes the full text of the articles along with the title and abstract. |
| Outcome: | The proposed model can generate keyphrases that are present or absent from the text. |
Hooks in the Headline: Learning to Generate Headlines with Controlled Styles (2020.acl-main)
Copied to clipboard
| Challenge: | Current summarization systems only produce plain, factual headlines, far from the practical needs for exposure and memorableness of the articles. |
| Approach: | They propose a task to generate relevant headlines with three style options . they propose combining summarization and reconstruction tasks into a multitasking framework . |
| Outcome: | The proposed method outperforms the state-of-the-art summarization model by 9.68% . it can generate relevant, fluent headlines with humor, romance and clickbait . |
Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing supervised sentence embedding techniques rely on expensive human-annotated sentence pairs as the supervised signals. |
| Approach: | They propose a semi-supervised sentence embedding framework that leverages large-scale unlabeled data. |
| Outcome: | The proposed framework surpasses state-of-the-art methods on four domain adaptation tasks. |
Static Word Embeddings for Sentence Semantic Representation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to learn fixed-length embeddings for sentence semantics require large computational cost, making it difficult to process billions of sentences cost-efficiently or deploy models on resource-constrained devices such as smartphones. |
| Approach: | They propose to extract word embeddings from a pre-trained Sentence Transformer and improve them with sentence-level principal component analysis followed by knowledge distillation or contrastive learning. |
| Outcome: | The proposed model outperforms existing models on sentence semantic tasks and surpasses a basic Sentence Transformer model (SimCSE) on a text embedding benchmark. |
The Summary Loop: Learning to Write Abstractive Summaries Without Examples (2020.acl-main)
Copied to clipboard
| Challenge: | Unsupervised abstractive summarization is important for news headlines and research papers . a novel method that encourages the inclusion of key terms from the original document into the summary is presented . |
| Approach: | They propose a method that encourages the inclusion of key terms from the original document into the summary by a coverage model along with a fluency model. |
| Outcome: | The proposed method outperforms existing methods on news summarization datasets and is competitive with existing methods. |
Dynamic Meta-Embeddings for Improved Sentence Representations (D18-1)
Copied to clipboard
| Challenge: | A sprawling literature has emerged about what word embeddings are most useful for which tasks . word embed-ding is a technique that can be used to learn word-level meaning representations for a variety of tasks. |
| Approach: | They propose a method for supervised learning of embedding ensembles that leads to state-of-the-art performance on a variety of tasks. |
| Outcome: | The proposed method leads to state-of-the-art performance on a variety of tasks. |