How Much Context Span is Enough? Examining Context-Related Issues for Document-level MT (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent advances in neural machine translation (NMT) have made it possible to include discourse into translation systems. |
| Approach: | They use the DELA corpus to examine the context span needed to translate from English into Portuguese. |
| Outcome: | The shortest span to disambiguate issues can appear in different positions in the document including preceding, following, global, world knowledge. |
Similar Papers
On Context Span Needed for Machine Translation Evaluation (2020.lrec-1)
Copied to clipboard
| Challenge: | a number of common patterns can be observed for context-aware MT evaluation, authors say . document-level evaluations have largely been performed at the sentence level . the definition of what constitutes a "document level" evaluation is still unclear . |
| Approach: | They propose to use a series of surveys to identify the necessary context span . they find common patterns that can be used to draw general guidelines . |
| Outcome: | The proposed evaluations of machine translation systems show that some issues and spans depend on domain and target language. |
Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP (2024.emnlp-main)
Copied to clipboard
| Challenge: | Improvements in language models’ capabilities have pushed their applications towards longer contexts, making long-context evaluation and development an active research area. |
| Approach: | They propose to unpack the taxonomy of long-context based on the properties that make them more difficult with longer contexts. |
| Outcome: | The proposed taxonomy is based on the properties that make them more difficult with longer contexts. |
A Nontrivial Sentence Corpus for the Task of Sentence Readability Assessment in Portuguese (C18-1)
Copied to clipboard
| Challenge: | Effective textual communication depends on readers being proficient enough to comprehend texts . when meaning is not well conveyed, many losses and damages may occur . |
| Approach: | They propose automatic evaluation of sentence readability task in Portuguese to improve readability. |
| Outcome: | The proposed method correctly identifies the ranking of sentence pairs with an accuracy of 74.2%. |
The brWaC Corpus: A New Open Resource for Brazilian Portuguese (L18-1)
Copied to clipboard
| Challenge: | a large corpus for Brazilian Portuguese is needed for NLP applications . the corpus is 2.7 billion tokens, and domain diversity is maximized . |
| Approach: | They propose to build a large Web corpus for Brazilian Portuguese with 2.7 billion tokens . they also propose an updated sentence-level approach for the strict removal of duplicated content . |
| Outcome: | The proposed corpus is based on a pipeline methodology and is available for querying and downloading. |
A New Annotated Portuguese/Spanish Corpus for the Multi-Sentence Compression Task (L18-1)
Copied to clipboard
| Challenge: | Existing corpus for Multi-sentence Compression (MSC) tasks is limited to English . a dataset is available for MSC tasks in the French language . |
| Approach: | They propose a new corpus for Multi-Sentence Compression task in Portuguese and Spanish. |
| Outcome: | The proposed corpus is compared with two state-of-the-art systems in Portuguese and Spanish. |
When and Why is Document-level Context Useful in Neural Machine Translation? (D19-65)
Copied to clipboard
| Challenge: | Recent advances in document-level NMT focus on sophisticated integration of the context, explaining its improvement with only a few selected examples or targeted test sets. |
| Approach: | They extensively quantify the causes of improvements by a document-level model in general test sets, clarifying the limit of the usefulness of document- level context in NMT. |
| Outcome: | The proposed model is not interpretable as utilizing the context, and a long context is not helpful for NMT. |
Recovering document annotations for sentence-level bitext (2024.findings-acl)
Copied to clipboard
| Challenge: | In machine translation, historical models were incapable of handling longer contexts, so the lack of document-level datasets was less noticeable. |
| Approach: | They propose a document-level filtering technique that discards document- level metadata. |
| Outcome: | The proposed method improves translation without degradation of sentence-level translation. |
Same evaluation, more tokens: On the effect of input length for machine translation evaluation using Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can be used to evaluate long documents, but they are limited by context window limitations. |
| Approach: | They propose to use granularity-aligned prompting and Focus Sentence Prompting to improve evaluation. |
| Outcome: | a new study shows that long texts lead to fewer error spans and reduced system ranking accuracy. |
Lost in Decomposition: Analyzing and Mitigating the Limitations of Long Context Methods via Context Dependency (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing workflow-based long context methods do not perform well on specific datasets . performance degradation is associated with the indiscriminate application of long context models . |
| Approach: | They propose a training-free adaptive routing strategy to improve long context large language models' robustness. |
| Outcome: | The proposed method can be generalized to all types of datasets, but performance degradation is a concern. |
Revisiting Context Choices for Context-aware Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent work has cast doubt on whether context-aware machine translation models learn useful signals from context or are improvements in automatic evaluation metrics just a side-effect. |
| Approach: | They propose to use separate encoders for source sentence and context as multiple sources for one target sentence to train context-aware machine translation models. |
| Outcome: | The proposed model improves translation quality even with empty lines as context, but the correct context improves it and random out-of-domain context degrades it. |