Learning to Selectively Learn for Weakly-supervised Paraphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate paraphrases with weak supervision are limited in real-world scenarios due to the lack of coherent and controllable generated paraphrase. |
| Approach: | They propose a method to generate high-quality paraphrases with weak supervision . they obtain abundant weakly-labeled parallel sentences via retrieval-based pseudo paraphrase expansion . |
| Outcome: | The proposed approach achieves significant improvements over existing methods and is even comparable in performance with supervised state-of-the-arts. |
Similar Papers
Learning to Selectively Learn for Weakly Supervised Paraphrase Generation with Model-based Reinforcement Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Paraphrase generation is an important natural language generation task . however, the effectiveness of paraphrase generation can be limited due to the limited data available. |
| Approach: | They propose a weakly supervised approach to paraphrase generation that leverages reinforcement learning for effective model training with data selection. |
| Outcome: | The proposed model improves the state-of-the-art performance on four weakly supervised paraphrase generation tasks. |
Semi-Supervised Learning for Neural Keyphrase Generation (D18-1)
Copied to clipboard
| Challenge: | Existing models for keyphrase generation only use labeled data, which is limited to resource-rich domains. |
| Approach: | They propose semi-supervised keyphrase generation methods by leveraging labeled data and large-scale unlabeled samples for learning. |
| Outcome: | The proposed methods outperform state-of-the-art models trained with labeled data and large-scale unlabeled samples for learning. |
BART-TL: Weakly-Supervised Topic Label Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for topic labeling use weak labelers to train rankers . recent studies show that weakly-supervised methods can produce meaningful labels . |
| Approach: | They propose a weakly-supervised method for assigning topic labels to models by using weak labelers. |
| Outcome: | The proposed model can generate valuable and novel labels in a weakly-supervised manner and can be improved by adding other weak labelers or distant supervision on similar tasks. |
Unsupervised Paraphrasing with Pretrained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Paraphrase generation has benefited from recent advances in the design of training objectives and model architectures, but previous studies focused on supervised methods that require a large amount of labeled data that is costly to collect. |
| Approach: | They propose a transfer learning approach that enables pre-trained language models to generate high-quality paraphrases in an unsupervised setting. |
| Outcome: | The proposed model performs state-of-the-art on the Quora Question Pair and ParaNMT datasets and is robust to domain shift between the two datasets. |
An End-to-End Generative Architecture for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating paraphrases with linguistic knowledge are often domain specific and hard to scale, or yield inferior results. |
| Approach: | They propose an end-to-end conditional generative architecture for generating paraphrases via adversarial training which does not depend on extra linguistic information. |
| Outcome: | The proposed method outperforms existing models on automatic metrics and human evaluations on four public datasets. |
ConRPG: Paraphrase Generation using Contexts as Regularizer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation lack reliable supervision signals. |
| Approach: | They propose an unsupervised paradigm for paraphrase generation based on contextual language models, candidate filtering and paraphrase model training based upon the selected candidates. |
| Outcome: | The proposed paradigm outperforms existing paraphrase generation methods in supervised and unsupervised setups. |
Learning to Adapt to Low-Resource Paraphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches to paraphrase generation often rely on a large number of parallel paraphrases, which require a lot of domain knowledge. |
| Approach: | They propose an adapter for paraphrase generation models optimized by meta-learning to overcome domain shifting problem when training on scarce labeled data. |
| Outcome: | The proposed model achieves state-of-the-art on three benchmark datasets. |
Vector-Quantized Prompt Learning for Paraphrase Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation are difficult to understand and generate. |
| Approach: | They propose to generate diverse paraphrases by using instance-dependent prompts to control the generation of pre-trained models. |
| Outcome: | The proposed method achieves state-of-the-art on three benchmark datasets, including Quora, Wikianswers, and MSCOCO. |
Jointly Improving Language Understanding and Generation with Quality-Weighted Weak Supervision of Automatic Labeling (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural natural language generation and understanding models are data-hungry and require massive amounts of annotated data to be competitive. |
| Approach: | They propose a framework that automatically synthesizes weak labels from large-scale weakly-labeled data with a fine-tuned GPT-2 and adapts parameter updates to the models according to the estimated label-quality. |
| Outcome: | The proposed framework outperforms benchmark systems on the E2E and Weather datasets when 100% of the training data is used. |
Exploring Diverse Expressions for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications. |
| Approach: | They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases. |
| Outcome: | The proposed model gains significant diversity and improves quality over state-of-the-art datasets. |