Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets (D19-1)
Copied to clipboard
| Challenge: | Paraphrase generation is an interesting and challenging task which has numerous practical applications. |
| Approach: | They analyze datasets commonly used for paraphrase generation research and show that simply parroting input sentences surpasses state-of-the-art models when evaluated on standard metrics. |
| Outcome: | The proposed model can generate paraphrases even without making any changes to the input sentence or even none at all, compared with other models. |
Similar Papers
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks . |
| Approach: | They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models. |
| Outcome: | This paper examines various approaches to paraphrase generation with a main focus on neural methods. |
Using Paraphrases to Study Properties of Contextual Embeddings (2022.naacl-main)
Copied to clipboard
| Challenge: | Previously, paraphrases have been used to probe whether compositionality is accurately captured by BERT, but we believe they can be used to explore many other questions. |
| Approach: | They propose to use paraphrases as a unique source of data to analyze contextualized embeddings, with a particular focus on BERT. |
| Outcome: | The proposed analysis of paraphrases and paraphrase representations using the Paraphrase Database shows that BERT handles polysemous words, but different representations in many cases. |
Comparative Study of Sentence Embeddings for Contextual Paraphrasing (2020.lrec-1)
Copied to clipboard
| Challenge: | Paraphrasing is an important aspect of natural-language generation that can produce more variety in the way specific content is presented. |
| Approach: | They propose to use contextual paraphrasing to capture the meaning of a sentence while performing dialogue act clustering. |
| Outcome: | The proposed task combines paraphrases with dialogue act clustering to capture such contextual paraphrasing. |
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)
Copied to clipboard
| Challenge: | a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining . |
| Approach: | They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages. |
| Outcome: | The proposed model outperforms the existing model on human evaluation in five of the six languages. |
Improving Paraphrase Detection with the Adversarial Paraphrasing Task (2021.acl-long)
Copied to clipboard
| Challenge: | a new adversarial method of paraphrase identification is being used to identify paraphrases based on word overlap and syntax . authors propose a dataset that generates semantically equivalent but lexically and syntactically disparate paraphrase pairs . |
| Approach: | They propose an adversarial method for paraphrase identification that uses word overlap and syntax to identify paraphrases. |
| Outcome: | The proposed method improves paraphrase detection accuracy and speed of generation of datasets. |
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets only annotate a binary label for each sentence pair. Existing models only annnotate binary labels for each phrase pair. |
| Approach: | They propose a novel binary paraphrase classification task that annotates the degree of paraphrase between sentences and a new annotation schema that labels the minimum spans of tokens in a sentence that don't have the corresponding paraphrases in the other sentence. |
| Outcome: | The proposed dataset can be used to train an automatic scorer for language generation evaluation. |
Neural-Driven Search-Based Paraphrase Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-supervised paraphrase generation models are biased toward specific problems like question answering or image captioning. |
| Approach: | They propose a search-based paraphrase generation scheme where candidate paraphrases are generated by iterated transformations from the original sentence and evaluated in terms of syntax quality, semantic distance, and lexical distance. |
| Outcome: | The proposed algorithms perform well against non-supervised baselines. |
Paraphrase Types for Generation and Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to paraphrase generation and detection ignore the intricate linguistic properties of language. |
| Approach: | They propose two tasks to consider specific linguistic perturbations at particular text positions. |
| Outcome: | The proposed tasks address the shortcoming of ignoring the linguistic properties of language. |
Controllable Paraphrase Generation for Semantic and Lexical Similarities (2024.lrec-main)
Copied to clipboard
| Challenge: | Lexically diverse paraphrases are crucial in data augmentation because they enhance the linguistic diversity of the corpus. |
| Approach: | They propose a controllable model for semantic and lexical similarities by attaching tags to the head of the input sentence. |
| Outcome: | The proposed model can paraphrase an input sentence according to the tags specified. |
Generating Syntactic Paraphrases (D18-1)
Copied to clipboard
| Challenge: | Using data-to-text generation, text-totext generation and text reduction, we show that conditioning text generation on syntactic constraints permits the generation of syntakically distinct paraphrases for the same input. |
| Approach: | They propose to use four different models for automatic generation of syntactic paraphrases to study the automatic generation process. |
| Outcome: | The proposed models can generate syntactic paraphrases for the same input and exploit different types of input to increase the number of distinct paraphrased for a given input. |