Papers with WMT16
Document Alignment based on Overlapping Fixed-Length Segments (2024.acl-srw)
Copied to clipboard
| Challenge: | Existing studies show that web crawling can be used to obtain large-scale parallel corpora for NLP tasks. |
| Approach: | They propose a sentence-based segmentation method for document alignment . they compare it with a fixed-length segmentation technique to handle long-text encoding better. |
| Outcome: | The proposed method improves document alignment and recall by 1% to 10% on a document alignment task for Japanese-English and French-English datasets. |
BERTSeg: BERT Based Unsupervised Subword Segmentation for Neural Machine Translation (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing subword segmenters are frequency-based without semantics information or neural-based but trained on parallel corpora. |
| Approach: | They propose an unsupervised neural subword segmenter for neural machine translation that utilizes contextualized semantic embeddings of words from characterBERT and maximizes the generation probability of subword segments. |
| Outcome: | The proposed method improves translation performance on ALT, IWSLT15 Vi->En, WMT16 Ro->En and WMT15 Fi->En datasets. |
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive models have boosted the efficiency of neural machine translation, but their performance is significantly worse than that of autoregressive counterparts. |
| Approach: | They propose to incorporate syntactic and semantic structures among natural languages into a non-autoregressive Transformer for the task of neural machine translation. |
| Outcome: | The proposed model achieves faster speed and keeps translation quality compared with other models. |
Word Embedding-Based Automatic MT Evaluation Metric using Word Position Information (N19-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics for machine translation are difficult to address word meaning because it is a surface-level metric. |
| Approach: | They propose to use word embeddings, sentence-level tf-idf, and cosine similarity between two word embeds as features, weight, and the distance between two features as features. |
| Outcome: | The proposed metric can evaluate machine translation based on word meaning . it achieves highest correlation with human judgment among several representative metrics. |
Continuous Language Generative Flow (2021.acl-long)
Copied to clipboard
| Challenge: | Recent years have witnessed various types of generative models for natural language generation (NLG), especially RNNs or transformers. |
| Approach: | They propose a flow-based language generation model that adapts flow-derived generative models to language generation via continuous input embeddings, adapted affine coupling structures, and a novel architecture for autoregressive text generation. |
| Outcome: | The proposed model improves on QG and NMT and improves performance over baselines on SQuAD and TVQA and NML16. |
Exploiting Monolingual Data at Scale for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a well-known and expensive task. |
| Approach: | They propose a method to use target-side monolingual data for neural machine translation and propose 'synthetic bitext' they propose generating synthetic bitext by translating monolingual into the other domain using models pretrained on genuine bitext. |
| Outcome: | The proposed approach achieves state-of-the-art results on WMT16, WMT17, WTM18 EnglishGerman translations and WTM19 GermanFrench translations. |
Machine Translation With Weakly Paired Documents (D19-1)
Copied to clipboard
| Challenge: | Recent studies explore the possibility of unsupervised machine translation with monolingual data only. |
| Approach: | They propose a method to mine bilingual sentences from weakly paired documents . they use word distribution-level alignments to constrain word distributions of two weakly-paired documents. |
| Outcome: | The proposed method outperforms previous results on six translation tasks using weakly paired bilingual documents and a large number of bilingual sentences. |
Exploiting Sentence Order in Document Alignment (2020.emnlp-main)
Copied to clipboard
| Challenge: | a document alignment method that exploits sentence order information is beneficial even when the end goal is sentence-level bitext. |
| Approach: | They propose a document alignment method that incorporates sentence order information in both candidate generation and candidate re-scoring. |
| Outcome: | The proposed method outperforms the most recent document alignment method on Sinhala–English documents. |
BiMax: Bidirectional MaxSim Score for Document-Level Alignment (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Document alignment is necessary for the hierarchical mining of documents across source and target languages. |
| Approach: | They propose a cross-lingual Bidirectional Maxsim score for computing doc-to-doc similarity. |
| Outcome: | The proposed method achieves accuracy comparable to OT with an approximate 100-fold speed increase. |
Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive Transformers (NAT) models generate the entire sequence in parallel, but the multimodality problem limits their performance. |
| Approach: | They propose a method to generate distilled data by the NAT model itself, eliminating the need for additional teacher networks. |
| Outcome: | The proposed method can generate distilled data by the NAT model without teacher networks and adapt to different NAT models without precise adjustments. |