Continuous Decomposition of Granularity for Neural Paraphrase Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Prior work has shown that decomposing sentences at different levels of granularity has improved paragraph generation. |
| Approach: | They propose a model for continuous decomposing granularity for neural paraphrase generation that incorporates granules into attention. |
| Outcome: | The proposed model outperforms baseline models on Quora question pairs and Twitter URLs on two benchmarks. |
Similar Papers
Decomposable Neural Paraphrase Generation (P19-1)
Copied to clipboard
| Challenge: | Existing models learn to generate paraphrases by mapping a sequence to another, with each word processed and generated in a uniform way. |
| Approach: | They propose a Transformer-based model that can learn and generate paraphrases at different levels of granularity in a disentangled way. |
| Outcome: | The proposed model achieves competitive in-domain performance compared to state-of-the-art models and significantly better performance when adapting to a new domain. |
Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approach (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent years, neural paraphrase generation models have demonstrated superior performance, but the output paraphrase still lacks diversity. |
| Approach: | They propose a back-translation guided multi-round paraphrase generation framework which leverages multi- round paraphrases to improve diversity while preserving semantic information. |
| Outcome: | The proposed model improves diversity while preserving semantic information. |
Document-Level Event Role Filler Extraction using Multi-Granularity Contextualized Encoding (2020.acl-main)
Copied to clipboard
| Challenge: | Document-level event extraction requires a view of a larger context to determine which spans of text correspond to event role fillers. |
| Approach: | They propose a multi-granularity reader to dynamically aggregate information captured by neural representations learned at different levels of granularities. |
| Outcome: | The proposed model performs substantially better than previous models on the MUC-4 event extraction dataset. |
Multi-Granularity Self-Attention for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Existing neural machine translation models use a deep multi-head self-attention network with no explicit phrase information. |
| Approach: | They propose a neural network that combines multi-head self-attention and phrase modeling to train attention heads to attend to phrases in either n-gram or syntactic formalisms. |
| Outcome: | The proposed approach improves on English-to-German and NIST Chinese-to English translation tasks. |
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Generally, documents are truncated before being inputs to deep neural networks, resulting in missing keyphrases . evaluators use layer-wise coverage attention to cover all the critical points in a document . |
| Approach: | They propose a neural keyphrase generation model that identifies the salient sentences in a document and an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art keyphrase generation methods on keyphrases generated from scientific and web documents. |
Hierarchical Sketch Induction for Paraphrase Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models of paraphrase generation are based on a syntactic sketch, but prior work has included inductive bias. |
| Approach: | They propose a method for learning decompositions of dense encodings as a sequence of discrete latent variables that make iterative refinements of increasing granularity. |
| Outcome: | The proposed model improves on human paraphrase generation by predicting syntactic sketches at test time. |
Neural-Driven Search-Based Paraphrase Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-supervised paraphrase generation models are biased toward specific problems like question answering or image captioning. |
| Approach: | They propose a search-based paraphrase generation scheme where candidate paraphrases are generated by iterated transformations from the original sentence and evaluated in terms of syntax quality, semantic distance, and lexical distance. |
| Outcome: | The proposed algorithms perform well against non-supervised baselines. |
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks . |
| Approach: | They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models. |
| Outcome: | This paper examines various approaches to paraphrase generation with a main focus on neural methods. |
Transformer and seq2seq model for Paraphrase Generation (D19-56)
Copied to clipboard
| Challenge: | Existing methods for generating paraphrases fall into one of these broad categories -rule-based, seq2seq, deep generative models and a varied combination. |
| Approach: | They propose a framework that combines transformer and sequence-to-sequence models for better quality of generated paraphrases. |
| Outcome: | The proposed framework improves on two datasets-QUORA and MSCOCO using transformer and sequence-to-sequence models. |
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)
Copied to clipboard
| Challenge: | a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining . |
| Approach: | They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages. |
| Outcome: | The proposed model outperforms the existing model on human evaluation in five of the six languages. |