| Challenge: | Existing methods for clustering comparable corpora are not suitable for bilingual corpors. |
| Approach: | They propose new clustering models fully adapted to comparable corpora based on a deep variant of Kmeans . they illustrate their behavior on bilingual collections created from Wikipedia . |
| Outcome: | The proposed models show that they can cluster comparable corpora on bilingual collections . the proposed models are based on a state-of-the-art deep variant of Kmeans . |
Similar Papers
Creating dialect sub-corpora by clustering: a case in Japanese for an adaptive method (L18-1)
Copied to clipboard
| Challenge: | a mixed corpus composed of different dialects is sufficiently resourced to cluster them into dialects. |
| Approach: | They propose a pipeline to derive clusters of dialects from a mixed corpus when their standard counterpart is sufficiently resourced. |
| Outcome: | The proposed pipeline can identify dialectal content when its standard counterpart is sufficiently resourced and can then cluster it into four dialects. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |
Language Clustering for Multilingual Named Entity Recognition (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work in multilingual natural language processing has shown progress on tasks such as natural language inference and joint multilingual translation. |
| Approach: | They propose a technique that groups similar languages together by embeddings from a pre-trained masked language model and automatically discovering language clusters in this embeddable space. |
| Outcome: | The proposed technique outperforms baselines on 15 languages in the WikiAnn dataset showing meaningful multilingual transfer for low-resource languages (Swahili and Yoruba). |
Leveraging Meta-Embeddings for Bilingual Lexicon Extraction from Specialized Comparable Corpora (C18-1)
Copied to clipboard
| Challenge: | Recent studies on bilingual lexicon extraction from specialized comparable corpora show differences in performance . lack of large specialized corporan to build efficient representations can be partially explained . |
| Approach: | They propose to use character-based embedding models to combine different embeddable models . they emphasize how character-driven embeddance models outperform other models on quality . |
| Outcome: | The proposed model outperforms other models on quality of extracted bilingual lexicons . comparable corpora are an interesting and practical alternative to parallel corporation . |
Improving Multilingual Models with Language-Clustered Vocabularies (2020.emnlp-main)
Copied to clipboard
| Challenge: | State-of-the-art multilingual models depend on vocabularies that cover all languages . but the methods for generating those vocalaries are not ideal for massively multilingual applications. |
| Approach: | They propose a procedure for multilingual vocabulary generation that combines separately trained vocabularies of several automatically derived language clusters. |
| Outcome: | The proposed procedure shows improvements across languages on multilingual benchmark tasks . the proposed procedure reduces out-of-vocabulary rate by a factor of 8 . |
Stylometry in a Bilingual Setup (2020.lrec-1)
Copied to clipboard
| Challenge: | a stylometric method of comparing texts by most frequent words does not allow direct comparison of original texts and their translations, i.e. across languages. |
| Approach: | They propose a stylometric method that removes language-specific features and parses each language counterpart with a corresponding language model in UDPipe. |
| Outcome: | The proposed method removes language-specific features and keeps linguistically independent features of individual author signal. |
Dialect Clustering with Character-Based Metrics: in Search of the Boundary of Language and Dialect (2020.lrec-1)
Copied to clipboard
| Challenge: | 'A language is a dialect with an army and navy' is attributed to sociologist Max Weinrich. |
| Approach: | They propose a universal character-based method for representing sentences so that one can calculate the distance between any two sentence pairs. |
| Outcome: | The proposed method can be used to calculate distance between two sentences by clustering a dialect/sub-language mixed corpus into sub-groups and to partially answer the question of what separates languages from dialects. |
Multilingual Clustering of Streaming News (D18-1)
Copied to clipboard
| Challenge: | a novel method for clustering news across languages is proposed . a key challenge in handling news streams is that they must be generated on the fly . |
| Approach: | They propose a method for clustering news across languages into monolingual and crosslingual clusters . they use real news datasets in multiple languages to find an ever growing number of cluster labels . |
| Outcome: | The proposed method produces state-of-the-art results on real news datasets in German, English and Spanish. |
A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models. |
| Approach: | They investigate the impact of parallel corpora quality and quantity, training objectives, and model size on performance of multilingual large language models enhanced with parallel corporeal. |
| Outcome: | The proposed approach improves performance in bilingual and general-purpose tasks. |
Building Comparable Corpora for Assessing Multi-Word Term Alignment (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to extract bilingual terminologies from corpora are limited . MWTs pose serious challenges for alignment and machine translation systems . |
| Approach: | They propose an approach to build comparable corpora and bilingual term dictionaries that evaluate bilingual term alignment in comparable corpus. |
| Outcome: | The proposed method is validated on an existing dataset and manually annotated data. |