| Challenge: | Recent work on automatic paraphrasing focuses on methods leveraging machine translation as an intermediate step. |
| Approach: | They propose to learn paraphrasing models only from a monolingual corpus . they propose a residual variant of vector-quantized variational auto-encoder . |
| Outcome: | The proposed model outperforms supervised and unsupervised translation methods in paraphrase identification and training set augmentation. |
Similar Papers
Paraphrasing as Zero-shot Translation with Feature-guided Diversity Enhancement (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies use parallel corpora for training, which results in less diverse paraphrases. |
| Approach: | They train a bidirectional multilingual neural machine translation model on a bilingual parallel corpus and use it as a paraphrasing model. |
| Outcome: | The proposed method generates paraphrases with higher semantic consistency, literal fluency and sentential diversity than existing parabanks and LLMs. |
Paraphrase Generation as Unsupervised Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation rely on labeled datasets or are limited in narrow domains. |
| Approach: | They propose a paradigm for paraphrase generation by treating the task as unsupervised machine translation based on pairs of unlabeled monolingual sentences. |
| Outcome: | The proposed paradigm can generate paraphrases on a large unlabeled monolingual corpus without relying on bilingual sentence pairs. |
Unsupervised Paraphrasing with Pretrained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Paraphrase generation has benefited from recent advances in the design of training objectives and model architectures, but previous studies focused on supervised methods that require a large amount of labeled data that is costly to collect. |
| Approach: | They propose a transfer learning approach that enables pre-trained language models to generate high-quality paraphrases in an unsupervised setting. |
| Outcome: | The proposed model performs state-of-the-art on the Quora Question Pair and ParaNMT datasets and is robust to domain shift between the two datasets. |
Multilingual Whispers: Generating Paraphrases with Translation (D19-55)
Copied to clipboard
| Challenge: | Humans naturally paraphrase, but they can generate approximately the same meaning with a different surface realization. |
| Approach: | They compare translation-based paraphrase gathering using human, automatic, or hybrid techniques to monolingual paraphrasing by experts and non-experts. |
| Outcome: | The proposed methods outperform human translation systems in a variety of translation tasks. |
Syntactically-Informed Unsupervised Paraphrasing with Non-Parallel Data (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on syntactically controlled paraphrase generation rely on large-scale parallel data. |
| Approach: | They propose a syntactically-informed unsupervised paraphrasing model based on conditional variational auto-encoder which can generate texts in a specified syntastic structure. |
| Outcome: | The proposed model can generate diverse paraphrases with specified syntactic structure using non-parallel data. |
Paraphrastic Representations at Scale (2022.emnlp-demos)
Copied to clipboard
| Challenge: | a new system allows users to train their own state-of-the-art paraphrastic sentence representations in a variety of languages. |
| Approach: | They propose a system that allows users to train their own paraphrastic sentence representations in a variety of languages. |
| Outcome: | The proposed models outperform previous models on monolingual and cross-lingual tasks and can be used on CPUs with little difference in inference speed. |
Vector-Quantized Prompt Learning for Paraphrase Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation are difficult to understand and generate. |
| Approach: | They propose to generate diverse paraphrases by using instance-dependent prompts to control the generation of pre-trained models. |
| Outcome: | The proposed method achieves state-of-the-art on three benchmark datasets, including Quora, Wikianswers, and MSCOCO. |
Unifying Discrete and Continuous Representations for Unsupervised Paraphrase Generation (2023.emnlp-main)
Copied to clipboard
Mingfeng Xue, Dayiheng Liu, Wenqiang Lei, Jie Fu, Jian Lan, Mei Li, Baosong Yang, Jun Xie, Yidan Zhang, Dezhong Peng, Jiancheng Lv
| Challenge: | Existing unsupervised paraphrase generation methods require large-scale, manually annotated paraphrase datasets, which are labor-intensive to build. |
| Approach: | They propose a self-supervised pseudo-data construction method that generates diverse pseudo-paraphrases in distinct surface structures for a given sentence. |
| Outcome: | The proposed method generates diverse pseudo-paraphrases in distinct surface structures for a given sentence. |
Unsupervised Paraphrasing by Simulated Annealing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to generate accurate and different-appearing paraphrases require massive parallel samples for training. |
| Approach: | They propose a novel approach that accomplishes Unsupervised Paraphrasing by Simulated Annealing by performing local editing. |
| Outcome: | The proposed approach outperforms existing models in automatic and human evaluations on Quora, Wikianswers, MSCOCO, and Twitter. |
Unsupervised Machine Translation in Real-World Scenarios (2022.lrec-1)
Copied to clipboard
Ona de Gibert Bonet, Iakes Goenaga, Jordi Armengol-Estapé, Olatz Perez-de-Viñaspre, Carla Parra Escartín, Marina Sanchez, Mārcis Pinnis, Gorka Labaka, Maite Melero
| Challenge: | a recent study has shown that unsupervised methods rely on monolingual corpora to build MT systems. |
| Approach: | They present the results of the MT4All CEF project using monolingual corpora . they propose to generate bilingual dictionaries and translation models from monolingual data . |
| Outcome: | The proposed method generates bilingual dictionaries and translation models from monolingual corpora . results show that it is comparable to general domain supervised translation . |