Challenge: Using unsupervised datasets, we train models on sentence complexification and same-level paraphrasing tasks.
Approach: They compare two unsupervised datasets with a single supervised dataset to train models on sentence complexification and same-level paraphrasing tasks.
Outcome: The proposed models outperform previous work on sentence-level targeting and improve on the ASSET simplification benchmark.

Similar Papers

Dynamic Multi-Level Multi-Task Learning for Sentence Simplification (C18-1)

Copied to clipboard

Challenge: Sentence simplification is the task of improving readability and understandability of an input text.
Approach: They propose a strong pointer-copy mechanism based sequence-to-sequence sentence simplification model and a novel ‘multi-level’ soft sharing approach where each auxiliary task shares different (higher versus lower) level layers of the model.
Outcome: The proposed model outperforms competing simplification systems in SARI and FKGL automatic metrics, and human evaluation.
MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases (2022.lrec-1)

Copied to clipboard

Challenge: MUSS trains strong models using sentence-level paraphrase data instead of labeled simplification data.
Approach: They propose a multilingual unsupervised sentence simplification system that does not require labeled simplification data.
Outcome: The proposed model outperforms the previous best supervised models on English, French, and Spanish benchmarks despite not using labeled simplification data.
Paraphrastic Representations at Scale (2022.emnlp-demos)

Copied to clipboard

Challenge: a new system allows users to train their own state-of-the-art paraphrastic sentence representations in a variety of languages.
Approach: They propose a system that allows users to train their own paraphrastic sentence representations in a variety of languages.
Outcome: The proposed models outperform previous models on monolingual and cross-lingual tasks and can be used on CPUs with little difference in inference speed.
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations (2020.acl-main)

Copied to clipboard

Challenge: Existing models for sentence simplification are focused on a single transformation, such as lexical paraphrasing or splitting.
Approach: They propose a dataset for assessing sentence simplification in English using a crowdsourced multi-reference corpus.
Outcome: The proposed dataset shows that it captures characteristics of simplicity better than other datasets.
Controllable Text Simplification with Explicit Paraphrasing (2021.naacl-main)

Copied to clipboard

Challenge: Existing text simplification systems rely on deletion and do not paraphrase well.
Approach: They propose a hybrid approach that leverages linguistically-motivated rules for splitting and deletion and couples them with a neural paraphrasing model to produce varied rewriting styles.
Outcome: The proposed model improves paraphrasing capability and paraphrases more often than existing models.
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to build parallel sentence simplification corpora are limited . SS is used to rephrase sentences into simpler forms for those with cognitive disabilities .
Approach: They propose to build SS corpora from large-scale bilingual translation corpors using a parallel approach.
Outcome: The proposed method outperforms the existing methods on WikiLarge and achieves state-of-the-art results.
Paraphrase to Explicate: Revealing Implicit Noun-Compound Relations (P18-1)

Copied to clipboard

Challenge: Existing methods for paraphrasing nouncompounds lack the ability to generalize and have a hard time interpreting infrequent or new noun-compound.
Approach: They propose a neural model that generalizes better by representing paraphrases in a continuous space, generalizing for both unseen noun-compounds and rare paraphrase.
Outcome: The proposed model generalizes better by representing paraphrases in a continuous space, generalizing for unseen noun-compounds and rare paraphrase.
Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification (N19-1)

Copied to clipboard

Challenge: Recent research has applied sequence-to-sequence (Seq2Sequen) models to text simplification . generic models tend to copy directly from the original sentence, resulting in outputs that are long and complex.
Approach: They propose to incorporate word complexities into the loss function during training and generate a large set of diverse candidate simplifications at test time.
Outcome: The proposed model can perform competitively with state-of-the-art systems while generating simpler sentences.
Controlling Text Complexity in Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Prior work on text complexity has focused on simplifying input text in one language, primarily English.
Approach: They propose a method to align news articles written for different levels of target language proficiency.
Outcome: The proposed model outperforms pipeline approaches that translate and simplify text independently.
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing datasets only annotate a binary label for each sentence pair. Existing models only annnotate binary labels for each phrase pair.
Approach: They propose a novel binary paraphrase classification task that annotates the degree of paraphrase between sentences and a new annotation schema that labels the minimum spans of tokens in a sentence that don't have the corresponding paraphrases in the other sentence.
Outcome: The proposed dataset can be used to train an automatic scorer for language generation evaluation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations