Papers by Georgiana Dinu
Distilling Multiple Domains for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation is a powerful tool for high-resource domains, but performance suffers when the input domain is low-resourced. |
| Approach: | They propose a framework for training a single multi-domain neural machine translation model that can translate multiple domains without increasing inference time or memory usage. |
| Outcome: | The proposed model improves translation on both high- and low-resource domains over strong multi-domain baselines and is robust under noisy data conditions. |
Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Instruction-conditioning has become the dominant approach for embedding specialization, but its direct application to low-capacity models imposes representational constraints that limit the performance gains derived from specialization. |
| Approach: | They propose a mixture of task experts transformer block which leverages task-specialized parameters trained with Task-Aware Contrastive Learning to enhance the model’s ability to generate specialized embeddings. |
| Outcome: | The proposed model achieves 64% higher performance gains in retrieval datasets (+3.27 +5.21) and 43% higher performance gain across all datasets (+1.81 2.60). |
GFST: Gender-Filtered Self-Training for More Accurate Gender in Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on gender bias in neural machine translation (NMT) incorrectly gendered translations can reflect or amplify social biases. |
| Approach: | They propose to use a monolingual corpus to generate gender-specific pseudo-parallel corpora and filter them to improve gender translation accuracy. |
| Outcome: | The proposed approach improves gender accuracy without damaging generic quality on translations from English into five languages. |
Training Neural Machine Translation to Apply Terminology Constraints (P19-1)
Copied to clipboard
| Challenge: | Existing methods to integrate domain terminology into neural machine translation (NMT) are brittle when tested in real-world situations. |
| Approach: | They propose a method to inject custom terminology into neural machine translation at run time by using the target side of terminology entries whose source side match the input as decoding-time constraints. |
| Outcome: | The proposed method is faster than state-of-the-art decoding and more efficient than constraint-free decoding. |
RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of outputs. |
| Approach: | They propose a new approach to attribute-controlled translation that leverages multilingual language models to perform ACT in few-shot and zero-shot settings. |
| Outcome: | The proposed approach improves generation accuracy over the standard prompting approach in both zero-shot and few-shot settings. |
CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formality (2022.findings-naacl)
Copied to clipboard
| Challenge: | Specific problems arise when translating from English into languages with formality markers, such as “Are you sure?” . Using wrong or inconsistent tone may be perceived as inappropriate or jarring for users of certain cultures and demographics. |
| Approach: | They propose to train formality-controlled models by fine-tuning on labeled contrastive data and a metric to evaluate them. |
| Outcome: | The proposed model achieves high accuracy (82% in-domain and 73% out-of-domain) while maintaining overall quality. |
MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation (2022.emnlp-main)
Copied to clipboard
Anna Currey, Maria Nadejde, Raghavendra Reddy Pappagari, Mia Mayer, Stanislas Lauly, Xing Niu, Benjamin Hsu, Georgiana Dinu
| Challenge: | Existing benchmarks have limited diversity in terms of gender phenomena, sentence structure, or language coverage. |
| Approach: | They propose a benchmark to evaluate gender accuracy in translation from English into eight widely-spoken languages. |
| Outcome: | The proposed benchmark provides realistic, gender-balanced, counterfactual data in eight language pairs where the gender of individuals is unambiguous in the input segment. |
Evaluating Robustness to Input Perturbations for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work has shown that Neural Machine Translation models are brittle to small perturbations in the input. |
| Approach: | They propose to use subword regularization to measure the relative degradation and changes in translation when perturbations are added to the input. |
| Outcome: | The proposed measures show that the models are more robust to perturbations when subword regularization methods are used. |