Generating Diverse Translations with Sentence Codes (P19-1)

Copied to clipboard

Challenge: Existing methods to generate diverse translations use different sentence structures . Xu et al., 2018: generating multiple valid translations with high diversity is difficult .
Approach: They propose to use sentence codes to condition the sentence generation to obtain diverse translations . they propose to sample multiple candidates, each of which conditioned on a unique code .
Outcome: The proposed method generates paraphrase translations with drastically different structures . the proposed method can be easily adopted to existing translation systems .

Similar Papers

Exploring Diverse Expressions for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications.
Approach: They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases.
Outcome: The proposed model gains significant diversity and improves quality over state-of-the-art datasets.
Mixup Decoding for Diverse Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for generating multiple translations for source and target languages neglect the one-to-many mapping between the source and the target languages.
Approach: They propose a method to generate different translations for the input sentence by linearly interpolating it with different sentence pairs sampled from the training corpus during decoding.
Outcome: Experiments on WMT’16 en-ro, WMT'14 en de, and WMT ‘17 zh-en show that the proposed method outperforms all previous diverse machine translation methods.
Multilingual Whispers: Generating Paraphrases with Translation (D19-55)

Copied to clipboard

Challenge: Humans naturally paraphrase, but they can generate approximately the same meaning with a different surface realization.
Approach: They compare translation-based paraphrase gathering using human, automatic, or hybrid techniques to monolingual paraphrasing by experts and non-experts.
Outcome: The proposed methods outperform human translation systems in a variety of translation tasks.
Multi-Source Text Classification for Multilingual Sentence Encoder with Machine Translation (2024.naacl-srw)

Copied to clipboard

Challenge: Pre-trained multilingual sentence encoders suffer from performance degradation for non-English languages.
Approach: They propose a method of machine translating a source sentence into English and then inputting it together with the source sentence in a multi-source manner.
Outcome: The proposed method improves the performance of pre-trained multilingual sentence encoders in Japanese on sentiment analysis and topic classification tasks.
Vector-Quantized Prompt Learning for Paraphrase Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for paraphrase generation are difficult to understand and generate.
Approach: They propose to generate diverse paraphrases by using instance-dependent prompts to control the generation of pre-trained models.
Outcome: The proposed method achieves state-of-the-art on three benchmark datasets, including Quora, Wikianswers, and MSCOCO.
Generating Syntactic Paraphrases (D18-1)

Copied to clipboard

Challenge: Using data-to-text generation, text-totext generation and text reduction, we show that conditioning text generation on syntactic constraints permits the generation of syntakically distinct paraphrases for the same input.
Approach: They propose to use four different models for automatic generation of syntactic paraphrases to study the automatic generation process.
Outcome: The proposed models can generate syntactic paraphrases for the same input and exploit different types of input to increase the number of distinct paraphrased for a given input.
ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation (2023.acl-long)

Copied to clipboard

Challenge: Paraphrase generation is a long-standing task in natural language processing (NLP).
Approach: They propose to generate large-scale syntactically diverse paraphrase datasets by abstract meaning representation back-translation.
Outcome: The proposed dataset is syntactically more diverse than existing datasets while maintaining good semantic similarity.
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)

Copied to clipboard

Challenge: a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining .
Approach: They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages.
Outcome: The proposed model outperforms the existing model on human evaluation in five of the six languages.
Comparison of Diverse Decoding Methods from Conditional Language Models (P19-1)

Copied to clipboard

Challenge: Conditional language models can generate a diverse set of outputs, but for open-ended tasks, beam search is ill-suited to generating a set of diverse sequences.
Approach: They propose a method where we over-sample candidates and use clustering to remove similar sequences to achieve high diversity without sacrificing quality.
Outcome: The proposed method over-samples candidates and removes similar sequences to achieve high diversity without sacrificing quality.
Exploring Multilingual Syntactic Sentence Representations (D19-55)

Copied to clipboard

Challenge: Recent studies on language models that learn syntactic information focus on learning the semantic structures of language.
Approach: They propose to use a multilingual parallel corpus augmented by universal part-of-speech tags to learn syntactic sentence embeddings.
Outcome: The proposed method performs better than state-of-the-art language models in low-resource languages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations