Challenge: Paraphrase generation is an interesting and challenging task which has numerous practical applications.
Approach: They analyze datasets commonly used for paraphrase generation research and show that simply parroting input sentences surpasses state-of-the-art models when evaluated on standard metrics.
Outcome: The proposed model can generate paraphrases even without making any changes to the input sentence or even none at all, compared with other models.

Similar Papers

Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)

Copied to clipboard

Challenge: Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks .
Approach: They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models.
Outcome: This paper examines various approaches to paraphrase generation with a main focus on neural methods.
Using Paraphrases to Study Properties of Contextual Embeddings (2022.naacl-main)

Copied to clipboard

Challenge: Previously, paraphrases have been used to probe whether compositionality is accurately captured by BERT, but we believe they can be used to explore many other questions.
Approach: They propose to use paraphrases as a unique source of data to analyze contextualized embeddings, with a particular focus on BERT.
Outcome: The proposed analysis of paraphrases and paraphrase representations using the Paraphrase Database shows that BERT handles polysemous words, but different representations in many cases.
Comparative Study of Sentence Embeddings for Contextual Paraphrasing (2020.lrec-1)

Copied to clipboard

Challenge: Paraphrasing is an important aspect of natural-language generation that can produce more variety in the way specific content is presented.
Approach: They propose to use contextual paraphrasing to capture the meaning of a sentence while performing dialogue act clustering.
Outcome: The proposed task combines paraphrases with dialogue act clustering to capture such contextual paraphrasing.
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)

Copied to clipboard

Challenge: a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining .
Approach: They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages.
Outcome: The proposed model outperforms the existing model on human evaluation in five of the six languages.
Improving Paraphrase Detection with the Adversarial Paraphrasing Task (2021.acl-long)

Copied to clipboard

Challenge: a new adversarial method of paraphrase identification is being used to identify paraphrases based on word overlap and syntax . authors propose a dataset that generates semantically equivalent but lexically and syntactically disparate paraphrase pairs .
Approach: They propose an adversarial method for paraphrase identification that uses word overlap and syntax to identify paraphrases.
Outcome: The proposed method improves paraphrase detection accuracy and speed of generation of datasets.
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing datasets only annotate a binary label for each sentence pair. Existing models only annnotate binary labels for each phrase pair.
Approach: They propose a novel binary paraphrase classification task that annotates the degree of paraphrase between sentences and a new annotation schema that labels the minimum spans of tokens in a sentence that don't have the corresponding paraphrases in the other sentence.
Outcome: The proposed dataset can be used to train an automatic scorer for language generation evaluation.
Neural-Driven Search-Based Paraphrase Generation (2021.eacl-main)

Copied to clipboard

Challenge: Existing non-supervised paraphrase generation models are biased toward specific problems like question answering or image captioning.
Approach: They propose a search-based paraphrase generation scheme where candidate paraphrases are generated by iterated transformations from the original sentence and evaluated in terms of syntax quality, semantic distance, and lexical distance.
Outcome: The proposed algorithms perform well against non-supervised baselines.
Paraphrase Types for Generation and Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Current approaches to paraphrase generation and detection ignore the intricate linguistic properties of language.
Approach: They propose two tasks to consider specific linguistic perturbations at particular text positions.
Outcome: The proposed tasks address the shortcoming of ignoring the linguistic properties of language.
Controllable Paraphrase Generation for Semantic and Lexical Similarities (2024.lrec-main)

Copied to clipboard

Challenge: Lexically diverse paraphrases are crucial in data augmentation because they enhance the linguistic diversity of the corpus.
Approach: They propose a controllable model for semantic and lexical similarities by attaching tags to the head of the input sentence.
Outcome: The proposed model can paraphrase an input sentence according to the tags specified.
Generating Syntactic Paraphrases (D18-1)

Copied to clipboard

Challenge: Using data-to-text generation, text-totext generation and text reduction, we show that conditioning text generation on syntactic constraints permits the generation of syntakically distinct paraphrases for the same input.
Approach: They propose to use four different models for automatic generation of syntactic paraphrases to study the automatic generation process.
Outcome: The proposed models can generate syntactic paraphrases for the same input and exploit different types of input to increase the number of distinct paraphrased for a given input.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations