Deep Neural Networks at the Service of Multilingual Parallel Sentence Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing models for parallel data harvesting from Wikipedia are language-independent, robust and highly scalable. |
| Approach: | They propose an end-to-end neural model for large-scale parallel data harvesting from Wikipedia . their model is language-independent, robust, and highly scalable . |
| Outcome: | The proposed model is language-independent, robust, and highly scalable. |
Similar Papers
Extracting Parallel Sentences with Bidirectional Recurrent Neural Networks to Improve Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Parallel sentence extraction is a task addressing the data sparsity problem found in multilingual natural language processing applications. |
| Approach: | They propose a bidirectional recurrent neural network based approach to extract parallel sentences from multilingual corpora. |
| Outcome: | The proposed approach outperforms existing approaches on noisy parallel corpora and shows significant improvements in translation performance. |
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia (2021.eacl-main)
Copied to clipboard
| Challenge: | a new approach to extract parallel sentences from Wikipedia articles is proposed . the approach is based on multilingual sentence embeddings, but does not limit it to English . |
| Approach: | They propose to automatically extract parallel sentences from Wikipedia articles in 96 languages . they train neural MT baseline systems on the mined data and evaluate them on the TED corpus . |
| Outcome: | The proposed approach extracts parallel sentences from Wikipedia articles in 96 languages . the extracted sentences achieve strong BLEU scores for many language pairs . |
Neural Machine Translation for Low Resource Languages using Bilingual Lexicon Induced from Comparable Corpora (N18-4)
Copied to clipboard
| Challenge: | Recent crowdsourcing efforts and workshops on machine translation have resulted in small amounts of parallel texts for building viable machine translation systems for low resource pairs. |
| Approach: | They propose to use an end-to-end Siamese bidirectional recurrent neural network to extract parallel sentences from Wikipedia to improve BLEU scores on both NMT and phrase-based SMT systems. |
| Outcome: | The proposed approach improves BLEU scores on both NMT and phrase-based SMT systems for the low-resource language pairs English–Hindi and English–Tamil when compared to training exclusively on the limited bilingual corpora. |
Learning to Generate Wikipedia Summaries for Underserved Languages from Wikidata (N18-2)
Copied to clipboard
Lucie-Aimée Kaffee, Hady Elsahar, Pavlos Vougiouklis, Christophe Gravier, Frédérique Laforest, Jonathon Hare, Elena Simperl
| Challenge: | Existing Wikipedia content is unevenly distributed among 287 languages . authors propose a neural network architecture that generates textual summaries from Wikidata triples . |
| Approach: | They propose an automated approach to generate Wikipedia summaries from Wikidata triples using structured data. |
| Outcome: | The proposed approach is tested on Arabic and Esperanto languages with limited editors and content in the most under-resourced Wikipedias. |
Models and Datasets for Cross-Lingual Summarisation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent years have witnessed increased interest in abstractive summarisation thanks to the popularity of neural network models and the availability of datasets containing hundreds of thousands of document-summary pairs. |
| Approach: | They propose to create a cross-lingual summarisation corpus with long documents in a source language associated with multi-sentence summaries in . target language. |
| Outcome: | The proposed task can be applied to several other languages and covers twelve languages and directions. |
MassiveSumm: a very large-scale, very multilingual, news summarisation dataset (2021.emnlp-main)
Copied to clipboard
| Challenge: | Current research in automatic summarisation is expensive to create, posing a challenge for any language. |
| Approach: | They propose to use a large-scale multilingual summarisation dataset with articles in 92 languages and more than 35 writing scripts to generate a multilingual dataset. |
| Outcome: | The proposed method is the largest, most inclusive, existing dataset and one of the largest and most inclusive datasets for any NLP task. |
“Wikily” Supervised Neural Translation Tailored to Cross-Lingual Tasks (2021.emnlp-main)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation models perform well in low-resource or distant languages. |
| Approach: | They propose a model that leverages Wikipedia for machine translation and cross-lingual tasks without supervision from external parallel data or supervised models in target language. |
| Outcome: | The proposed model outperforms supervised models in Arabic and English translation tasks. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |
An Open Multilingual System for Scoring Readability of Wikipedia (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on the readability of Wikipedia have focused on English only and there are currently no systems supporting automatic readability assessment of the 300+ languages in Wikipedia. |
| Approach: | They propose a multilingual model to assess Wikipedia's readability using a dataset spanning 14 languages. |
| Outcome: | The proposed model outperforms existing models in a zero-shot scenario and is more accurate than previous benchmarks. |
Harvesting Paragraph-level Question-Answer Pairs from Wikipedia (P18-1)
Copied to clipboard
| Challenge: | Existing models that only take into account sentence-level information do not generate question-answer pairs. |
| Approach: | They propose a neural network approach that incorporates coreference knowledge via a novel gating mechanism for paragraphlevel question generation. |
| Outcome: | The proposed model outperforms existing models on a Wikipedia article question-answer generation task. |