DELTA: A Toolkit for Measuring Linguistic Diversity in Dependency-Parsed Corpora (2026.eacl-demo)
Copied to clipboard
| Challenge: | Existing tools for measuring diversity of specific linguistic phenomena are limited . we present an open-source framework for measuring linguistic diversity . |
| Approach: | They propose an open-source framework that integrates dependency tree querying with diversity computation. |
| Outcome: | The proposed framework can measure diversity across multiple linguistic levels and dimensions. |
Similar Papers
Fine-Grained Analysis of Cross-Linguistic Syntactic Divergences (2020.acl-main)
Copied to clipboard
Dmitry Nikolaev, Ofir Arviv, Taelin Karidi, Neta Kenneth, Veronika Mitnik, Lilja Maria Saeboe, Omri Abend
| Challenge: | Existing work on quantifying the prevalence of syntactic divergences across languages has not been done. |
| Approach: | They propose a framework for extracting divergence patterns for any language pair from a parallel corpus building on Universal Dependencies. |
| Outcome: | The proposed framework provides a detailed picture of cross-language divergences, generalizes previous approaches, and lends itself to full automation. |
A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Sets (2024.findings-naacl)
Copied to clipboard
| Challenge: | a new study aims to assess linguistic diversity of multilingual data sets against a reference language sample . linguistic diversity is typically measured as the number of languages included in the data set . but such measures do not consider structural properties of the included languages . |
| Approach: | They propose to measure linguistic diversity against a reference language sample to maximise linguistic diversity. |
| Outcome: | The proposed measure can be used to identify the types of languages that are not represented in a data set. |
Building and curating conversational corpora for diversity-aware language science and technology (2022.lrec-1)
Copied to clipboard
| Challenge: | Language resources that capture language use in its natural habitat of social interaction are rare despite the obvious merits of studying the very environment where we all learn and use it everyday. |
| Approach: | They propose to build an analysis pipeline and best practice guidelines for building and curating corpora of everyday conversation in diverse languages. |
| Outcome: | The proposed pipeline can be used to collect and curate conversational corpora in 67 languages and varieties from 28 phyla. |
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
How Universal are Universal Dependencies? Exploiting Syntax for Multilingual Clause-level Sentiment Detection (2020.lrec-1)
Copied to clipboard
| Challenge: | a new method for clause-level sentiment detection is proposed for multilingual use cases. |
| Approach: | They propose a pipeline method that makes the most of syntactic structures based on Universal Dependencies. |
| Outcome: | The proposed method achieves high precision in sentiment detection for 17 languages . it avoids machine-learning approaches that may cause obstacles to its use cases . |
Evaluating the Evaluation of Diversity in Natural Language Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for controlling diversity by tuning a “decoding parameter” affect form but not meaning. |
| Approach: | They propose a framework that measures correlation between a diversity metric and a parameter that controls some aspect of diversity in generated text. |
| Outcome: | The proposed framework outperforms existing methods in estimating diversity . it shows that humans outperformed existing methods but affect form but not meaning . |
Typological Features for Multilingual Delexicalised Dependency Parsing (N19-1)
Copied to clipboard
| Challenge: | Existing universal models to describe the syntax of languages are debated for decades . a new study examines the plausibility of universal grammars in dependency parsing . |
| Approach: | They propose to use typological features to describe the syntax of languages to train a multilingual dependency parser. |
| Outcome: | The proposed model can be trained on 40 languages with the help of typological features. |
Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent efforts on cross-lingual relation extraction (XRE) leverage language-consistent structural features from the universal dependency resource. |
| Approach: | They propose to construct a type of code-mixed UD forest that combines UD and source-/target-side UD structures to achieve unbiased transfer. |
| Outcome: | The proposed UD forest achieves significant performance gains on ACE XRE benchmark datasets. |
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)
Copied to clipboard
| Challenge: | BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese . |
| Approach: | They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages . |
| Outcome: | The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese . |
We Need to Measure Data Diversity in NLP — Better and Broader (2025.emnlp-main)
Copied to clipboard
| Challenge: | Language models exhibit remarkable natural language understanding and generation capabilities, but they have serious flaws, such as societal biases and spurious correlations. |
| Approach: | They argue that interdisciplinary perspectives are essential for developing more fine-grained and valid measures of data diversity. |
| Outcome: | The proposed measures are based on interdisciplinary perspectives and include a variety of datasets. |