Substance over Style: Document-Level Targeted Content Transfer (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models excel at writing from scratch, but many real-world scenarios require rewriting an entire document to fit a set of constraints. |
| Approach: | They propose a document-level targeted content transfer task that addresses the challenge of rewriting an entire document coherently by generating coherent and diverse rewrites that obey a constraint while remaining close to the original document. |
| Outcome: | The proposed model outperforms existing methods by generating coherent and diverse rewrites that obey the constraint while remaining close to the original document. |
Similar Papers
Counterfactual Recipe Generation: Exploring Compositional Generalization in a Realistic Scenario (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail to learn and use culinary knowledge in a compositional way, argues a new study. |
| Approach: | They propose a task that asks models to modify a base recipe according to the change of an ingredient. |
| Outcome: | The proposed model can perform compositional generalization in a realistic setting . existing models have difficulties in modifying ingredients while preserving original style . |
Is It Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Text simplification and elaboration tasks are limited to only relatively altering the readability of texts to cater to a diverse audience. |
| Approach: | They propose to generate 8 versions of a text at different readability levels using ChatGPT and Llama-2 and introduce a two-step process to generate paraphrases. |
| Outcome: | The proposed task requires the generation of 8 versions at various target readability levels for each input text. |
Story-level Text Style Transfer: A Proposal (2020.acl-srw)
Copied to clipboard
| Challenge: | Text style transfer is a task that aims to change the style of input text to the target style while preserving the content to some extent. |
| Approach: | They propose to use story-level text style transfer to generate stories that preserve plot . they propose to employ BERT-based method, Story Realization method, and Graph-based methods . |
| Outcome: | The proposed method preserves the plot of the input story while exhibiting a strong target style. |
A Plug-and-Play Method for Controlled Text Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for controlling language generation are not able to produce fluent text . current methods require additional models or fine-tuning to ensure specific words are included . |
| Approach: | They propose a plug-and-play decoding method that allows for controlled language generation . they add a shift in the probability distribution over our vocabulary towards semantically similar words . |
| Outcome: | The proposed method outperforms competing methods in human evaluations and does not impact fluency. |
Don’t Add, don’t Miss: Effective Content Preserving Generation from Pre-Selected Text Spans (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing CTR models are mediocre and lack reliable performance . authors propose an explicit decomposition of these two subtasks into a single task . |
| Approach: | They propose an isolated task that challenges models to generate coherent text conforming to pre-selected content within the input text ("highlights") authors propose a high-quality, open-source CTR model that tackles two prior key limitations: inadequate enforcement of the content-preservation constraint, and suboptimal silver training data. |
| Outcome: | The proposed model significantly improves silver training data quality over the existing model, with up to 30 ROUGE-L points. |
Sentence-Level Content Planning and Style Specification for Neural Text Generation (D19-1)
Copied to clipboard
| Challenge: | Recent advances in text generation systems often produce incoherent and unfaithful outputs . a novel automated text generation system takes into account content selection, text planning, and surface realization. |
| Approach: | They propose an end-to-end trained two-step text generation model that considers sentence-level content planners and language styles. |
| Outcome: | The proposed model outperforms competing models in three domains with diverse topics and varying language styles. |
Towards Content Transfer through Grounded Text Generation (N19-1)
Copied to clipboard
| Challenge: | Recent work in neural natural language generation has attracted significant interest in controlling the form of text, such as style, persona, and wordiness. |
| Approach: | They propose a task where the task is to generate a next sentence in a document that fits its context and is grounded in . external textual source such as a news story. |
| Outcome: | The proposed task is based on 640k Wikipedia referenced sentences paired with the source articles to show significant improvements against baselines. |
Reference-guided Style-Consistent Content Transfer (2024.lrec-main)
Copied to clipboard
| Challenge: | Text style transfer involves changing the style of a text while preserving its original style. |
| Approach: | They propose a task of style-consistent content transfer which involves modifying a text’s content based on a provided reference statement while preserving its original style. |
| Outcome: | The proposed approach meets three important conditions: reference faithfulness, style adherence, and coherence. |
Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfer (2021.acl-short)
Copied to clipboard
| Challenge: | Formality style transfer models have limited success in preserving content due to the scarcity of parallel data. |
| Approach: | They propose to fine-tune pre-trained language and sequence-to-sequence models with rewards that target style and content to enhance content preservation. |
| Outcome: | The proposed models can be fine-tuned with rewards that target style and content, and achieve good performance even with limited amounts of parallel data. |
Semantic-aware transformation of short texts using word embeddings: An application in the Food Computing domain (2021.eacl-srw)
Copied to clipboard
| Challenge: | Recent work in food computing focus on generating new recipes from scratch . however, there are a large number of new recipes generated daily with user reviews . |
| Approach: | They propose to use word embedding models to capture the semantic meaning of recipe ingredients and use them to enrich their data. |
| Outcome: | The proposed engine will use food data to modify a recipe to fit user preferences. |