| Challenge: | Using morphological features does improve error prediction across tasks, but is less pronounced in morphology-complex languages. |
| Approach: | They propose to use morphological features to improve error prediction across four different tasks and up to 57 languages to test their hypothesis. |
| Outcome: | The proposed model is more discriminative in morphologically simple languages than in simple ones. |
Similar Papers
A Morphology-Based Investigation of Positional Encodings (2024.emnlp-main)
Copied to clipboard
| Challenge: | Contemporary deep learning models handle languages with diverse morphology . morphological complexity of languages is closely linked with positional encodings . |
| Approach: | They propose to use positional encodings to integrate morphological complexity into deep learning models. |
| Outcome: | The proposed model improves on 22 languages and 5 downstream tasks. |
Morphological Inflection: A Reality Check (2023.acl-long)
Copied to clipboard
| Challenge: | Morphological inflection is a popular task in sub-word NLP with practical and cognitive applications. |
| Approach: | They propose new methods to analyze data sets and evaluate their generalization abilities to better reflect likely use-cases. |
| Outcome: | The proposed methods improve generalizability and reliability of results and improve generalization abilities. |
Confounding Factors in Relating Model Performance to Morphology (2025.emnlp-main)
Copied to clipboard
| Challenge: | morphological differences between languages are unclear, but are often considered unimportant . confounding factors make it hard to compare results and draw conclusions, authors argue . |
| Approach: | They propose to use token bigram metrics to predict difficulty of causal language modeling . they argue that confounding factors are contributing to the conflicting evidence . |
| Outcome: | The proposed metrics better capture the relation between morphology and tokenization compared to word-based models. |
Morphology Matters: A Multilingual Language Modeling Analysis (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing studies on inflectional morphology disagree on whether or not it makes languages harder to model. |
| Approach: | They propose to use a corpus of 145 Bible translations in 92 languages to investigate whether inflectional morphology makes languages harder to model. |
| Outcome: | The proposed model trains with linguistically motivated subword segmentation strategies and reduces the impact of morphology on language modeling. |
A Framework for Understanding the Role of Morphology in Universal Dependency Parsing (D18-1)
Copied to clipboard
| Challenge: | a measure of morphological complexity is used to characterize syntactic information in word embeddings. |
| Approach: | They propose a measure of morphological complexity in terms of governor-dependent preferential attachment that explains parsing performance. |
| Outcome: | The proposed framework improves parsing performance on morphologically rich languages using morphology as a syntactic marker. |
Why do language models perform worse for morphologically complex languages? (2025.coling-main)
Copied to clipboard
| Challenge: | Language models perform differently across languages, a new study suggests . morphological typology may explain some of the performance differences, authors say . |
| Approach: | They propose to test morphological alignment of tokenizers, tokenization quality and disparities in dataset sizes and measurement to test this hypothesis. |
| Outcome: | The proposed model shows that fusional languages perform better than fusionative languages . the authors suggest that morphological typology may explain some of the performance differences . |
Searching for Search Errors in Neural Morphological Inflection (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural sequence-to-sequence models are the predominant choice for language generation tasks. |
| Approach: | They find that on word-level tasks, the empty string is often the global optimum . they suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill-suitedness of such models for language generation. |
| Outcome: | The results suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill-suitedness of such models for language generation. |
What Kind of Language Is Hard to Language-Model? (P19-1)
Copied to clipboard
| Challenge: | a recent study suggests that language models perform poorly across languages. |
| Approach: | They propose a model that fits a paired-sample multiplicative mixed-effects model to obtain language difficulty coefficients from at least-pairwise parallel corpora. |
| Outcome: | The proposed model is able to handle missing data and is aware of inter-sentence variation. |
What do character-level models learn about morphology? The case of dependency parsing (D18-1)
Copied to clipboard
| Challenge: | morphologically rich languages require character-level input models to learn morphology, but some models are poor at disambiguating some words . authors of this study show that character- level models learn a lot from input input . explicit modeling of morphologies is expensive and expensive, authors say . |
| Approach: | They compare character-level models to an oracle with explicit morphological analysis . they show that explicitly modeling morphology improves their best model . |
| Outcome: | The results show that character-level models learn morphology better than word models . the authors compare character-based models to oracles on 12 languages with morphological typologies . |
Unlike “Likely”, “Unlike” is Unlikely: BPE-based Segmentation hurts Morphological Derivations in LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) use subword vocabularies to process and generate text. |
| Approach: | They find that Large Language Models (LLMs) perform poorly at handling some types of affixations because subwords are marked as initial- or intra-word . |
| Outcome: | The largest models trained on enough data can mitigate this tendency because initial- and intra-word embeddings are aligned; in-context learning also helps when all examples are selected in a consistent way; but only morphological segmentation can achieve a near-perfect accuracy. |