| Challenge: | In machine translation, historical models were incapable of handling longer contexts, so the lack of document-level datasets was less noticeable. |
| Approach: | They propose a document-level filtering technique that discards document- level metadata. |
| Outcome: | The proposed method improves translation without degradation of sentence-level translation. |
Similar Papers
Document-Level Machine Translation with Large-Scale Public Parallel Corpora (2024.acl-long)
Copied to clipboard
| Challenge: | Document-level machine translation has inherent advantages over sentence-level translation due to additional information available to a model from document context. |
| Approach: | They propose to use document context to train context-aware models on these datasets and to use it to model document-level phenomena. |
| Outcome: | The proposed models improve translation quality and target document-level phenomena by incorporating contextual information from several preceding sentences. |
Rethinking Document-level Neural Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Neural machine translation models are weak enough for document-level translation . current models only translate sentences individually, resulting in poor document coherence . |
| Approach: | They propose to use the original Transformer model to test document-level neural machine translation . they find that the original transformer models can achieve strong results for document translation if trained properly . |
| Outcome: | The proposed model outperforms sentence-level models on nine datasets and two sentence- level datasets across six languages. |
Improving the Transformer Translation Model with Document-Level Context (D18-1)
Copied to clipboard
| Challenge: | Existing models for document-level context translation ignore documentlevel context. |
| Approach: | They propose a document-level context encoder to represent document- level context and integrate it into the Transformer model. |
| Outcome: | Experiments on NIST Chinese-English and IWSLT French-English datasets show that the proposed translation model outperforms the Transformer model significantly. |
Discourse-Centric Evaluation of Document-level Machine Translation with a New Densely Annotated Parallel Corpus of Novels (2023.acl-long)
Copied to clipboard
| Challenge: | Several recent papers claim to have achieved human parity at sentence-level machine translation. |
| Approach: | They propose to use a dataset with rich discourse annotations to evaluate MT performance . they find that MT outputs differ fundamentally from human translations in terms of latent discourse structures. |
| Outcome: | The proposed dataset builds upon the large-scale parallel corpus BWB . it covers 15,095 entity mentions in both languages and compares them to human translations . |
Exploring Paracrawl for Document-level Neural Machine Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Document-level neural machine translation (NMT) has outperformed sentence-level NMT on a number of datasets. |
| Approach: | They use Paracrawl to extract parallel paragraphs from Paracral webpages . they also use the extracted parallel paragraph as parallel documents for training . |
| Outcome: | The proposed model outperforms sentence-level NMT on a number of datasets. |
DocRED: A Large-Scale Document-Level Relation Extraction Dataset (P19-1)
Copied to clipboard
Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun
| Challenge: | Existing relation extraction methods focus on extracting intra-sentence relations for single entities. |
| Approach: | They propose a relation extraction dataset from Wikipedia and Wikidata with three features . document-level relation extraction is a task to identify relational facts between entities . |
| Outcome: | The proposed dataset is the largest human-annotated dataset for document-level RE from plain text. |
Challenges in Context-Aware Neural Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | despite well-reasoned intuitions, most context-aware neural machine translation models show only modest improvements over sentence-level systems. |
| Approach: | They propose a more realistic setting for document-level translation called paragraph-to-paragraph (PARA2PARA) they collect a dataset of Chinese-English novels to promote future research . |
| Outcome: | The proposed model improves translation quality across document-level metrics and discourse phenomena. |
Simple and Effective Paraphrastic Similarity from Parallel Translations (P19-1)
Copied to clipboard
| Challenge: | Existing methods for learning paraphrastic sentence embeddings on bitext are expensive and require manual annotation. |
| Approach: | They propose a method that trains paraphrastic sentence embeddings directly from bitext, eliminating the time-consuming step of creating paraphrase corpora. |
| Outcome: | The proposed model outperforms and is faster than state-of-the-art models on cross-lingual tasks. |
Document Sub-structure in Neural Machine Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Current approaches to machine translation (MT) translate sentences in isolation, disregarding context they appear in, or model context at the level of the full document. |
| Approach: | They propose to include information about the topic of the section within which each sentence is found in a document that is not homogeneous . they use a cache-based model to model the context of the document, instead of translating sentences in isolation . |
| Outcome: | The proposed model incorporates information about the topic of the section within which each sentence is found into a neural model. |
AMR Beyond the Sentence: the Multi-sentence AMR corpus (C18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is limited to capturing the semantics of individual sentences. |
| Approach: | They propose a corpus that annotates coreference and similar phenomena on top of existing AMRs. |
| Outcome: | The proposed corpus is compared with existing corpora on sentence-level semantics . it shows that it can be used for information extraction and question answering . |