Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Lectures translation is a case of spoken language translation and there is nil available corpus for this purpose. |
| Approach: | They propose a framework for mining a parallel corpus from publicly available lectures at Coursera . they use machine translation and cosine similarity over continuous-space sentence representations to determine sentence alignments . |
| Outcome: | The proposed framework improves translation performance when used with out-of-domain parallel corpora . it also addresses noise in the mined data, and creates high-quality evaluation splits . |
Similar Papers
Exploiting Multilingualism through Multistage Fine-Tuning for Low-Resource Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Using multi-parallel corpora for transfer learning is a useful technique for low-resource NMT. |
| Approach: | They compare multi-parallel corpora for transfer learning in a low-resource setting . their results show that multi-paralleled corpors are extremely useful . |
| Outcome: | The proposed model can give 3–9 BLEU score gains over a one-to-one model. |
A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models. |
| Approach: | They investigate the impact of parallel corpora quality and quantity, training objectives, and model size on performance of multilingual large language models enhanced with parallel corporeal. |
| Outcome: | The proposed approach improves performance in bilingual and general-purpose tasks. |
Filtering and Mining Parallel Data in a Joint Multilingual Space (P18-2)
Copied to clipboard
| Challenge: | Using a cosine distance in a joint multilingual sentence embedding, we filter out noisy parallel data and mine for bitexts in large news collections. |
| Approach: | They propose to learn a joint multilingual sentence embedding and use the distance between sentences in different languages to filter noisy parallel data and to mine for parallel data in large monolingual texts. |
| Outcome: | The proposed approach improves a competitive baseline on the WMT'14 task by 0.3 BLEU by filtering out 25% of the training data. |
JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Recent machine translation algorithms rely on parallel corpora, but only some resource-rich language pairs can benefit from them. |
| Approach: | They construct a parallel corpus for English-Japanese, which has 8.7 million sentence pairs . they use a web crawler to automatically align parallel sentences in the corpus . |
| Outcome: | The proposed corpus includes a broader range of domains and can be trained with a pre-trained model. |
Word Alignment by Fine-tuning Embeddings on Parallel Corpora (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing work on word alignment has focused on unsupervised learning on parallel text. |
| Approach: | They propose to combine pre-trained contextualized word embeddings with multilingually trained language models to achieve competitive results on word alignment tasks. |
| Outcome: | The proposed model outperforms state-of-the-art models on five language pairs and can train multilingual word aligners that can obtain robust performance on different language pairs. |
Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings (P19-1)
Copied to clipboard
| Challenge: | Traditional parallel corpus mining methods focus on the textual content instead of the size and quality of training data. |
| Approach: | They propose a method for machine translation based on multilingual sentence embeddings. |
| Outcome: | The proposed method outperforms the best published methods on the BUCC mining task and the UN reconstruction task by more than 10 F1 and 30 precision points. |
BanglaSTEM: A Parallel Corpus and Term-Weighted Evaluation for Technical Bangla-English Translation (2026.acl-srw)
Copied to clipboard
| Challenge: | Large language models excel at technical problem solving in English but struggle when questions are posed in Bangla. |
| Approach: | They propose a dataset of 5,000 Bangla-English sentence pairs to align technical terms . they use OCR to extract matching passages from bilingual textbooks . |
| Outcome: | The proposed pipeline extracts matching passages from bilingual textbooks and uses them to align sentences and mark technical terms. |
Quality Does Matter: A Detailed Look at the Quality and Utility of Web-Mined Parallel Corpora (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing web-mined corpora for low-resource languages have serious quality issues, especially for lowresource language pairs. |
| Approach: | They ranked each corpus according to a similarity measure and evaluated different portions of this ranked corpus. |
| Outcome: | The results show that the quality of web-mined corpora for low-resource languages is significantly different from human-curated corporats. |
Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation (2020.emnlp-main)
Copied to clipboard
Tahmid Hasan, Abhik Bhattacharjee, Kazi Samin, Masum Hasan, Madhusudan Basak, M. Sohel Rahman, Rifat Shahriyar
| Challenge: | despite being the seventh most widely spoken language, Bengali has received little attention in machine translation due to being low in resources. |
| Approach: | They propose a customized sentence segmenter for Bengali and two new methods for parallel corpus creation on low-resource setups. |
| Outcome: | The proposed method improves Bengali-English parallel corpus by 9 BLEU over previous approaches . the results will pave the way for future research on Bengali and other low-resource languages . |
Unsupervised Bitext Mining and Translation via Self-Trained Contextual Embeddings (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to extract parallel sentences from unaligned text yield surprisingly good results. |
| Approach: | They propose an unsupervised method to create pseudo-parallel corpora for machine translation (MT) from unaligned text using multilingual BERT to create source and target sentence embeddings for nearest-neighbor search and adapt the model via self-training. |
| Outcome: | The proposed method outperforms existing methods and outperformed previous state-of-the-art methods by boosting translation performance by up to 3.5 BLEU on the WMT’14 French-English and WMT'16 German-English tasks. |