On the Evaluation of Semantic Phenomena in Neural Machine Translation Using Natural Language Inference (N18-2)
Copied to clipboard
| Challenge: | Existing methods to investigate whether sentence representations from NMT systems capture distinct semantic phenomena are limited. |
| Approach: | They propose a process to investigate the extent to which sentence representations arising from neural machine translation systems encode distinct semantic phenomena. |
| Outcome: | The proposed model is suited to supporting inferences at the syntax-semantics interface, compared to anaphora resolution requiring world knowledge. |
Similar Papers
Evaluating Discourse Phenomena in Neural Machine Translation (N18-1)
Copied to clipboard
| Challenge: | Existing models for machine translation have been evaluated with standard automatic metrics, but are poorly adapted to evaluating discourse phenomena. |
| Approach: | They propose to use BLEU to train multi-encoder NMT models on English subtitles to test their ability to exploit previous source and target sentences. |
| Outcome: | The proposed multi-encoder models give limited improvements on the coreference and coherence tests. |
Neural Semantic Parsing (P18-5)
Copied to clipboard
| Challenge: | Semantic parsing is the study of translating natural language utterances into machine-executable programs. |
| Approach: | They will describe the various approaches researchers have taken to translate natural language into a formal language . they will also discuss why much recent work has chosen to use standard programming languages instead of more linguistically-motivated representations. |
| Outcome: | This paper will describe the various approaches researchers have taken to translate natural language into a formal language. |
SuperNMT: Neural Machine Translation with Semantic Supersenses and Syntactic Supertags (P18-3)
Copied to clipboard
| Challenge: | Neural Machine Translation models have become the state-of-the-art in the field of machine translation. |
| Approach: | They incorporate semantic supersensetags and syntactic supertag features into EN–FR and EN–DE factored NMT systems and show that they improve model training. |
| Outcome: | The proposed model training improves on EN–FR and EN–DE factored NMT systems. |
Bridging the Gap between Training and Inference for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation generates target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Approach: | They propose to use ground truth and inference to generate target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Outcome: | Experiments on Chinese->English and WMT’14 English->German translation tasks show that the proposed model can achieve significant improvements on multiple datasets. |
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)
Copied to clipboard
Yingfeng Luo, Tong Zheng, Yongyu Mu, Bei Li, Qinghong Zhang, Yongqi Gao, Ziqiang Xu, Peinan Feng, Xiaoqian Liu, Tong Xiao, JingBo Zhu
| Challenge: | Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT . |
| Approach: | They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models. |
| Outcome: | The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache. |
One Sentence One Model for Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a new state of the art that can produce better results than traditional statistical machine translation. |
| Approach: | They propose a dynamic neural network which learns a general network as usual and fine-tunes it for each test sentence. |
| Outcome: | The proposed method improves translation performance when similar sentences are available. |
Automatic Evaluation and Analysis of Idioms in Neural Machine Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) struggles with the translation of rare multi-word expressions (MWEs). |
| Approach: | They propose a metric for automatically measuring the frequency of literal translation errors without human involvement. |
| Outcome: | The proposed metric measures the frequency of literal translation errors without human involvement with the models trained in different conditions and across a wide range of metrics and test sets. |
Using Semantic Role Labeling to Improve Neural Machine Translation (2022.lrec-1)
Copied to clipboard
| Challenge: | despite progress in machine translation, some form of language understanding may be desirable . current systems rely on pattern recognition, but some form may be useful . |
| Approach: | They use semantic role labeling to annotate a standard parallel corpus with semantic roles . they then train a neural machine translation system using the annotated corpus and original unannotated text . |
| Outcome: | The proposed system improves BLEU scores for English, French, German, Greek and Spanish. |
Revisiting Commonsense Reasoning in Machine Translation: Training, Evaluation and Challenge (2023.acl-long)
Copied to clipboard
| Challenge: | CR is the ability to understand and navigate the world using basic knowledge and understanding shared by most people. |
| Approach: | They propose to incorporate pretrained knowledge into NMT models and use them as robust testbeds for investigating CR in NMT. |
| Outcome: | The proposed method improves the training of NMT models with high CR abilities and provides accurate evaluation metrics. |
Thesis proposal: Are We Losing Textual Diversity to Natural Language Processing? (2026.eacl-srw)
Copied to clipboard
| Challenge: | Using Neural Machine Translation, we examine whether the algorithms used in NMT have inherent inductive biases that are beneficial for most types of inputs but might harm the processing of untypical texts. |
| Approach: | They propose to use a set of measures to quantify text diversity based on its statistical properties to determine whether NMT systems struggle with maintaining the diversity of such texts. |
| Outcome: | The proposed approaches maintain the diversity and complexity of language and allow for better global planning of the output generation. |