| Challenge: | Existing methods to extract parallel sentences from Wikipedia are limited for some language pairs such as Persian-English. |
| Approach: | They propose a bidirectional method to extract parallel sentences from Wikipedia . they add extracted sentences to existing training data and use IR system to measure similarity . |
| Outcome: | The proposed method outperforms the one-directional approach in analyzing translation data from two translation systems and IR systems. |
Similar Papers
Extracting Parallel Sentences with Bidirectional Recurrent Neural Networks to Improve Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Parallel sentence extraction is a task addressing the data sparsity problem found in multilingual natural language processing applications. |
| Approach: | They propose a bidirectional recurrent neural network based approach to extract parallel sentences from multilingual corpora. |
| Outcome: | The proposed approach outperforms existing approaches on noisy parallel corpora and shows significant improvements in translation performance. |
Neural Machine Translation for Low Resource Languages using Bilingual Lexicon Induced from Comparable Corpora (N18-4)
Copied to clipboard
| Challenge: | Recent crowdsourcing efforts and workshops on machine translation have resulted in small amounts of parallel texts for building viable machine translation systems for low resource pairs. |
| Approach: | They propose to use an end-to-end Siamese bidirectional recurrent neural network to extract parallel sentences from Wikipedia to improve BLEU scores on both NMT and phrase-based SMT systems. |
| Outcome: | The proposed approach improves BLEU scores on both NMT and phrase-based SMT systems for the low-resource language pairs English–Hindi and English–Tamil when compared to training exclusively on the limited bilingual corpora. |
Esposito: An English-Persian Scientific Parallel Corpus for Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing scientific corpus for English-Persian language pairs is lacking . supervised neural machine translation requires millions of parallel sentences . |
| Approach: | They propose a parallel corpus called Esposito which contains 3.5 million parallel sentences . they also propose 'test sets' that might serve as a baseline for future studies . |
| Outcome: | The proposed system improves the baseline on average by 7.6 and 8.4 BLEU scores for English-Persian language pairs. |
Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings (P19-1)
Copied to clipboard
| Challenge: | Traditional parallel corpus mining methods focus on the textual content instead of the size and quality of training data. |
| Approach: | They propose a method for machine translation based on multilingual sentence embeddings. |
| Outcome: | The proposed method outperforms the best published methods on the BUCC mining task and the UN reconstruction task by more than 10 F1 and 30 precision points. |
Deep Neural Networks at the Service of Multilingual Parallel Sentence Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing models for parallel data harvesting from Wikipedia are language-independent, robust and highly scalable. |
| Approach: | They propose an end-to-end neural model for large-scale parallel data harvesting from Wikipedia . their model is language-independent, robust, and highly scalable . |
| Outcome: | The proposed model is language-independent, robust, and highly scalable. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |
Parallel Sentence Mining by Constrained Decoding (2020.acl-main)
Copied to clipboard
| Challenge: | Using a neural machine translation system to extract parallel sentences from two monolingual corpora is challenging. |
| Approach: | They propose a method to extract parallel sentences from two monolingual corpora by constraining the decoding by a prefix tree built on the other corpus. |
| Outcome: | The proposed method achieves comparable results to other submissions on the BUCC shared task. |
Improving Machine Translation with Phrase Pair Injection and Corpus Filtering (2022.emnlp-main)
Copied to clipboard
| Challenge: | In this paper, we show that the combination of Phrase Pair Injection and Corpus Filtering boosts the performance of Neural Machine Translation systems. |
| Approach: | They propose to combine Phrase Pair Injection and Corpus Filtering to boost performance of Neural Machine Translation systems. |
| Outcome: | The proposed method improves machine translation models on low-resource language pairs . BLEU score improves over models trained with whole pseudo-parallel corpus augmented with parallel corpus. |
BiVert: Bidirectional Vocabulary Evaluation Using Relations for Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) evaluation is crucial to determine the quality of translations. |
| Approach: | They propose a bidirectional semantic-based evaluation method to assess the sense distance of the translation from the source text. |
| Outcome: | The proposed method uses the multilingual encyclopedic dictionary BabelNet . it shows a strong correlation between the evaluation scores and human assessments . |
Large Language Models for Persian-English Idiom Translation (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models have shown superior capabilities in translating figurative language compared to neural machine translation systems. |
| Approach: | They evaluate LLMs, NMTs and their combinations using PersianIdioms datasets . they find that automatic evaluation methods like BLEU and BERTScore are effective . |
| Outcome: | The proposed model performs better in both directions than other models. |