Papers by Tobias Domhan
A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism (2024.findings-acl)
Copied to clipboard
| Challenge: | Multi-way parallel, machine generated content dominates the translations in lower resource languages . a limited investigation suggests this selection bias is the result of low quality content generated in English and translated into many lower resource language via MT. |
| Approach: | They show that multi-way parallel, machine generated content dominates translations in many languages . they also find evidence of a selection bias in the type of content which is translated into many languages. |
| Outcome: | The results suggest that the low quality of multi-way translations on the web was likely created using machine translation. |
How Much Attention Do You Need? A Granular Analysis of Neural Machine Translation Architectures (P18-1)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) has been replaced by convolutional or self-attentional approaches. |
| Approach: | They propose an architecture definition language that allows for a flexible combination of common building blocks. |
| Outcome: | The proposed architectures can bring recurrent and convolutional models close to the Transformer architecture, but not using self-attention. |
The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Neural Machine Translation models can be optimized to improve latency by constraining the set of output words . lexical shortlisting fails to select the right set of input words for semantically non-compositional phenomena such as idiomatic expressions. |
| Approach: | They propose a model of vocabulary selection that constrains the set of allowed output words . they propose to increase the size of the allowed set to restore translation quality . |
| Outcome: | The proposed model restores translation quality of an unconstrained system, as measured by human evaluations on WMT newstest2020 and idiomatic expressions, at an inference latency competitive with alignment-based selection using aggressive thresholds. |
Same evaluation, more tokens: On the effect of input length for machine translation evaluation using Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can be used to evaluate long documents, but they are limited by context window limitations. |
| Approach: | They propose to use granularity-aligned prompting and Focus Sentence Prompting to improve evaluation. |
| Outcome: | a new study shows that long texts lead to fewer error spans and reduced system ranking accuracy. |
Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain Adaptation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Building neural machine translation systems to perform well on a specific target domain remains a challenge. |
| Approach: | They propose to train a single NMT system per language pair that performs well across multiple domains. |
| Outcome: | The proposed approach improves the Pareto frontier on this task. |