Lost in Machine Translation: A Method to Reduce Meaning Loss (N19-1)

Copied to clipboard

Challenge: state-of-the-art translation systems often fail in preserving meaning . ambiguity between source and target languages can cause translation problems .
Approach: They propose to use a pre-trained neural sequence-to-sequence model to define a less ambiguous translation system.
Outcome: The proposed system preserves meaning in two languages without compromising translation quality.

Similar Papers

Crossing the Threshold: Idiomatic Machine Translation through Retrieval Augmentation and Loss Weighting (2023.emnlp-main)

Copied to clipboard

Challenge: idioms are common in everyday language, but often pose a challenge to translators because their meanings do not follow from the meanings of their parts.
Approach: They propose to use retrieval-augmented models to increase the accuracy of a strong pretrained machine translation model on idiomatic sentences by up to 13%.
Outcome: The proposed techniques improve the accuracy of a strong pretrained model on idiomatic sentences by up to 13% in absolute accuracy, and holds potential benefits for non-idiomatic phrases.
Lost in Back-Translation: Emotion Preservation in Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: MT is used to support human-to-human communication across languages, but it is unclear whether it can translate the non-propositional level of emotions.
Approach: They propose to use a re-ranking approach to change emotions to reverse this tendency . they find that emotions are toned down or amplified through linguistic changes .
Outcome: The proposed model can be used to change emotions, and it can be applied to other languages.
Lost in Translationese? Reducing Translation Effect Using Abstract Meaning Representation (2024.eacl-long)

Copied to clipboard

Challenge: Abstract Meaning Representation (AMR) can be used to reduce translationese in text . if translationeses are not addressed in training or test sets, evaluation scores can be overinflated .
Approach: They propose to use Abstract Meaning Representation (AMR) to reduce translationese in translated texts.
Outcome: The proposed approach outperforms other methods based on machine translation and paraphrase generation.
Improving Lexical Choice in Neural Machine Translation (N18-1)

Copied to clipboard

Challenge: False positives: the output layer rewards frequent words disproportionately, we argue . Falsibles: a model that learns word representations in continuous space tends to translate rare words .
Approach: They propose to fix the norms of both vectors to a constant value and integrate a lexical module which is jointly trained with the rest of the model.
Outcome: The proposed approach achieves improvements of up to +4.3 BLEU surpassing phrase-based translation in nearly all settings.
Tagged Back-translation Revisited: Why Does It Really Work? (2020.acl-main)

Copied to clipboard

Challenge: In this paper, we show that neural machine translation systems trained on large back-translated data overfit some of the characteristics of machine-transcribed texts.
Approach: They propose to add a tag to back-translations to help distinguish back-translated data from original parallel training data.
Outcome: The proposed tag helps the system distinguish back-translated data from original parallel training data and is as effective as a tag in high-resource training.
Phrase-Based & Neural Unsupervised Machine Translation (D18-1)

Copied to clipboard

Challenge: Recent advances in machine translation have reported near human-level performance on several languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences.
Approach: They propose two models that leverage a careful initialization of the parameters and denoising effect of language models.
Outcome: The proposed models outperform the current methods on English-French and German-English benchmarks while being simpler and having fewer hyper-parameters.
Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain Adaptation (2021.emnlp-main)

Copied to clipboard

Challenge: Building neural machine translation systems to perform well on a specific target domain remains a challenge.
Approach: They propose to train a single NMT system per language pair that performs well across multiple domains.
Outcome: The proposed approach improves the Pareto frontier on this task.
On the Importance of Distinguishing Word Meaning Representations: A Case Study on Reverse Dictionary Mapping (N19-1)

Copied to clipboard

Challenge: Sense representations target meaning conflation deficiency but their potential impact has not been investigated in downstream NLP applications.
Approach: They propose to use a reverse dictionary system to address meaning conflation deficiency . they propose to integrate senses into the system to improve semantic understanding .
Outcome: The proposed approach can improve the performance of a downstream NLP application.
Losing our Tail, Again: (Un)Natural Selection & Multilingual LLMs (2026.acl-long)

Copied to clipboard

Challenge: a few million years ago, we lost our tails, and with them, the narratives and identities they carry.
Approach: They argue that multilingual large language models are threatening our linguistic diversity . they argue that models collapse towards what is likely, driven by statistical biases .
Outcome: a new paper shows that models can collapse and lead to loss of linguistic diversity . the authors argue that models are a field that values and protects multilingual diversity - a key challenge for the field .
Similarity-Based Reconstruction Loss for Meaning Representation (D18-1)

Copied to clipboard

Challenge: a new paper proposes and evaluates a set of loss functions that can be used to train models for representation learning . cross-entropy loss penalizes models when they fail to generate the exact word from ground truth data .
Approach: They propose and evaluate loss functions that can be used to train any neural model for representation learning.
Outcome: The proposed loss functions amplify semantic diversity while preserving original meaning . they show performance improvement on paraphrase detection and language inference tasks .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations