Paraphrase Generation with Deep Reinforcement Learning (D18-1)

Copied to clipboard

Challenge: Paraphrase generation is an important but challenging task in natural language processing . traditional symbolic approaches to paraphrase generation include rule-based methods, thesaurus-based approaches and statistical machine translation (SMT)
Approach: They propose a deep reinforcement learning approach to automatic paraphrase generation . they propose supervised learning and reinforcement learning for evaluators .
Outcome: The proposed framework outperforms state-of-the-art methods in paraphrase generation on two datasets.

Similar Papers

Exploring Diverse Expressions for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications.
Approach: They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases.
Outcome: The proposed model gains significant diversity and improves quality over state-of-the-art datasets.
Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewards (P19-1)

Copied to clipboard

Challenge: Existing generative models generate too few keyphrases, but they often generate too many . et al. (2017) propose a reinforcement learning approach for keyphrase generation .
Approach: They propose a reinforcement learning approach that encourages a model to generate sufficient keyphrases with an adaptive reward function.
Outcome: The proposed method improves state-of-the-art generative models with conventional and new evaluation methods on real-world datasets.
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)

Copied to clipboard

Challenge: Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks .
Approach: They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models.
Outcome: This paper examines various approaches to paraphrase generation with a main focus on neural methods.
An End-to-End Generative Architecture for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing methods for generating paraphrases with linguistic knowledge are often domain specific and hard to scale, or yield inferior results.
Approach: They propose an end-to-end conditional generative architecture for generating paraphrases via adversarial training which does not depend on extra linguistic information.
Outcome: The proposed method outperforms existing models on automatic metrics and human evaluations on four public datasets.
Multi-task Learning for Paraphrase Generation With Keyword and Part-of-Speech Reconstruction (2022.findings-acl)

Copied to clipboard

Challenge: PGKPR is a deep learning approach to generate paraphrases using key semantics of the source sentence.
Approach: They propose a model with keyword and part-of-speech reconstruction for paraphrase generation using deep learning.
Outcome: The proposed model outperforms comparative models on two commonly-used datasets.
Delexicalized Paraphrase Generation (2020.coling-industry)

Copied to clipboard

Challenge: Using convolutional neural networks, we generate delexicalized sentences . 1.29% accuracy is achieved with the generated paraphrases .
Approach: They propose a neural paraphrasing model that generates delexicalized sentences . they use convolutional neural networks to pool on slot values and use pointers to locate them .
Outcome: The proposed model generates delexicalized sentences with high quality . it can be used for intent classification and named entity recognition tasks .
Learning to Selectively Learn for Weakly Supervised Paraphrase Generation with Model-based Reinforcement Learning (2022.naacl-main)

Copied to clipboard

Challenge: Paraphrase generation is an important natural language generation task . however, the effectiveness of paraphrase generation can be limited due to the limited data available.
Approach: They propose a weakly supervised approach to paraphrase generation that leverages reinforcement learning for effective model training with data selection.
Outcome: The proposed model improves the state-of-the-art performance on four weakly supervised paraphrase generation tasks.
Neural-Driven Search-Based Paraphrase Generation (2021.eacl-main)

Copied to clipboard

Challenge: Existing non-supervised paraphrase generation models are biased toward specific problems like question answering or image captioning.
Approach: They propose a search-based paraphrase generation scheme where candidate paraphrases are generated by iterated transformations from the original sentence and evaluated in terms of syntax quality, semantic distance, and lexical distance.
Outcome: The proposed algorithms perform well against non-supervised baselines.
Generative Pretraining for Paraphrase Evaluation (2022.acl-long)

Copied to clipboard

Challenge: ParaBLEU is a paraphrase representation learning model and evaluation metric for text generation.
Approach: They propose a paraphrase representation learning model and evaluation metric for text generation that uses generative conditioning as a pretraining objective.
Outcome: The proposed model outperforms existing models on the 2017 WMT Metrics Shared Task using only 50% of the available training data and surpasses BLEU, ROUGE and METEOR with only 40 examples.
A Learning-Exploring Method to Generate Diverse Paraphrases with Multi-Objective Deep Reinforcement Learning (2020.coling-main)

Copied to clipboard

Challenge: Paraphrase generation is of great importance for many downstream tasks in natural language processing.
Approach: They propose a method to generate sentences as learning objectives from the learned data distribution and employ reinforcement learning to combine these new learning objectives for model training.
Outcome: The proposed method gains significant diversity and improves generation quality over state-of-the-art datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations