RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of outputs. |
| Approach: | They propose a new approach to attribute-controlled translation that leverages multilingual language models to perform ACT in few-shot and zero-shot settings. |
| Outcome: | The proposed approach improves generation accuracy over the standard prompting approach in both zero-shot and few-shot settings. |
Similar Papers
Attribute-Controlled Translation with Preference Optimization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a natural language processing task that produces translations that satisfy specific constraints on linguistic and stylistic attributes. |
| Approach: | They propose to leverage the contrastive nature of ACT tasks with preference optimization . they also propose to exploit knowledge distillation with synthetically-generated training samples . |
| Outcome: | The proposed approach improves attribute matching and translation quality in small-medium size models. |
Prompting Vision-Language Models For Aspect-Controlled Generation of Referring Expressions (2024.findings-naacl)
Copied to clipboard
Danfeng Guo, Sanchit Agarwal, Arpit Gupta, Jiun-Yu Kao, Emre Barut, Tagyoung Chung, Jing Huang, Mohit Bansal
| Challenge: | Referring Expression Generation (REG) is the task of generating a descriptive caption that uniquely identifies a given target in the scene. |
| Approach: | They propose an Aspect-Controlled REG task which requires generating a referring expression conditioned on the input aspect(s) by changing the input input such as color, location, action etc. |
| Outcome: | The proposed model beats all prior works in the CIDEr score and achieves comparable performance to training with 100% of real data. |
R-Bind: Unified Enhancement of Attribute and Relation Binding in Text-to-Image Diffusion Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve semantic binding require costly retraining or focus on only correctly generating attributes of entities. Existing methods focus on correctly generating attributes, ignoring the cruciality of correctly forming relations between entities. |
| Approach: | They propose a training-free method that improves both entity-attribute and entity-relation-entity binding by introducing three inference-time optimization losses that adjust attention maps during generation. |
| Outcome: | The proposed method improves both entity-attribute and entity-relation-entity binding without additional training. |
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time. |
| Approach: | They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute. |
| Outcome: | The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters. |
Prompting PaLM for Translation: Assessing Strategies and Performance (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models trained on multilingual but not parallel text exhibit remarkable ability to translate between languages. |
| Approach: | They investigate the pathways language model which has demonstrated the strongest machine translation performance among similarly-trained LLMs to date. |
| Outcome: | The pathways language model (PaLM) has demonstrated the strongest machine translation performance among similarly-trained LLMs to date. |
Controlling Machine Translation for Multiple Attributes with Additive Interventions (2021.emnlp-main)
Copied to clipboard
| Challenge: | A standard approach for exerting control in MT is to prepend the input with a special tag to signal the desired output attribute. |
| Approach: | They propose a vector-valued approach which allows for fine-grained control over multiple attributes simultaneously via a weighted linear combination of the corresponding vectors. |
| Outcome: | The proposed approach achieves better control over a wider range of tasks than tagging and even fine-tuning a model trained without annotations. |
Prompt Refinement with Image Pivot for Text-to-Image Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generation have markedly expanded the boundaries of digital artistry, enabling the creation of visually compelling images with unprecedented ease. |
| Approach: | They propose to decompose the prompt refinement process into two tasks: inferring user-preferred images from user languages and translating them into system languages. |
| Outcome: | Experiments show that PRIP outperforms baselines and transfers to unseen systems in a zero-shot manner. |
MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators (2022.acl-long)
Copied to clipboard
| Challenge: | Prompting has been shown to be a promising approach for applying pre-trained language models to perform downstream tasks. |
| Approach: | They propose a method that divides the translation process into three stages using pre-trained language models. |
| Outcome: | The proposed method significantly improves translation performance of pre-trained language models on three translation tasks. |
How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models? (2024.eacl-long)
Copied to clipboard
| Challenge: | Pretrained multilingual translation models with massive coverage are becoming of the backbone of many translation systems. |
| Approach: | They propose to use a gradient-based inference-time controller to control a pretrained multilingual model by using a model with attribute annotations. |
| Outcome: | The proposed model performs well on pretrained multilingual models and is attribute- rather than language-specific. |
Focused Prefix Tuning for Controllable Text Generation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing unannotated attributes could degrade models' performance . focus on the desired attribute can be achieved with focused prefix tuning . |
| Approach: | They propose focused prefix tuning to enable the control to focus on the desired attribute . they propose to reduce the number of unannotated attributes in a controllable text generation dataset . |
| Outcome: | The proposed approach achieves better control accuracy and text fluency than baseline models in single-attribute tasks. |