Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation (N18-1)
Copied to clipboard
| Challenge: | Existing models tend to memorize words instead of learning meaning of words . existing models tend not to model semantic information, resulting in incorrect sentences . |
| Approach: | They propose a novel model that generates words by querying distributed word representations . they evaluate model on two paraphrase-oriented tasks, namely text simplification and short abstractive summarization . |
| Outcome: | The proposed model outperforms the baseline model on two paraphrase-oriented tasks . it achieves state-of-the-art performance on these benchmark datasets . |
Similar Papers
Neural-Driven Search-Based Paraphrase Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-supervised paraphrase generation models are biased toward specific problems like question answering or image captioning. |
| Approach: | They propose a search-based paraphrase generation scheme where candidate paraphrases are generated by iterated transformations from the original sentence and evaluated in terms of syntax quality, semantic distance, and lexical distance. |
| Outcome: | The proposed algorithms perform well against non-supervised baselines. |
Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features (N18-1)
Copied to clipboard
| Challenge: | Currently, unsupervised word embeddings are routinely trained on large amounts of raw text data. |
| Approach: | They propose to use unsupervised word embeddings to train distributed representations of sentences. |
| Outcome: | The proposed method outperforms state-of-the-art models on most benchmark tasks and is robust to the produced general-purpose sentence embeddings. |
Transformer and seq2seq model for Paraphrase Generation (D19-56)
Copied to clipboard
| Challenge: | Existing methods for generating paraphrases fall into one of these broad categories -rule-based, seq2seq, deep generative models and a varied combination. |
| Approach: | They propose a framework that combines transformer and sequence-to-sequence models for better quality of generated paraphrases. |
| Outcome: | The proposed framework improves on two datasets-QUORA and MSCOCO using transformer and sequence-to-sequence models. |
Learning to Generate Word- and Phrase-Embeddings for Efficient Phrase-Based Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) often fails in one-to-many translation, e.g., in the translation of multi-word expressions, compounds, and collocations. |
| Approach: | They propose a phrase-based NMT model that generates embeddings of words or phrases. |
| Outcome: | The proposed model performs on par with state-of-the-art phrase-based NMT. |
Semi-Supervised Learning for Neural Keyphrase Generation (D18-1)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation only use labeled data, which is limited to resource-rich domains. |
| Approach: | They propose semi-supervised keyphrase generation methods by leveraging labeled data and large-scale unlabeled samples for learning. |
| Outcome: | The proposed methods outperform state-of-the-art models trained with labeled data and large-scale unlabeled samples for learning. |
Advances in Pre-Training Distributed Word Representations (L18-1)
Copied to clipboard
| Challenge: | Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications. |
| Approach: | They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations. |
| Outcome: | The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data. |
Revisiting Pivot-Based Paraphrase Generation: Language Is Not the Only Optional Pivot (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation rely on language as the pivot . however, there is no evidence that parallel data of paraphrases is needed for paraphrasing. |
| Approach: | They propose to use semantic and syntactic representations as pivot for paraphrase generation. |
| Outcome: | The proposed method can generate paraphrases with better quality than using language as pivot. |
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)
Copied to clipboard
| Challenge: | a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining . |
| Approach: | They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages. |
| Outcome: | The proposed model outperforms the existing model on human evaluation in five of the six languages. |
An End-to-End Generative Architecture for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating paraphrases with linguistic knowledge are often domain specific and hard to scale, or yield inferior results. |
| Approach: | They propose an end-to-end conditional generative architecture for generating paraphrases via adversarial training which does not depend on extra linguistic information. |
| Outcome: | The proposed method outperforms existing models on automatic metrics and human evaluations on four public datasets. |
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks . |
| Approach: | They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models. |
| Outcome: | This paper examines various approaches to paraphrase generation with a main focus on neural methods. |