(Un)solving Morphological Inflection: Lemma Overlap Artificially Inflates Models’ Performance (2022.acl-short)
Copied to clipboard
| Challenge: | Inflection tasks have gained a lot of traction in recent years, mostly via SIGMORPHON's shared-tasks. |
| Approach: | They propose to use split-by-lemma to challenge the generalization capacity of morphological inflection models by employing harder train-test splits. |
| Outcome: | The proposed method is based on a split-by-lemma method that challenges the generalization capacity of the models. |
Similar Papers
Lemmas Matter, But Not Like That: Predictors of Lemma-Based Generalization in Morphological Inflection (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent work suggests that lemma overlap drives model performance on morphological inflection tasks, but the impact of lemmm overlap is debated. |
| Approach: | They propose a novel algorithm to investigate predictors of accuracy on seen and unseen lemmas by combining the number of lema in train with the number in train. |
| Outcome: | The proposed algorithm shows that the number of lemmas in train has a stronger effect on accuracy on unseen than seen lemmes. |
Exploring Linguistic Probes for Morphological Inflection (2023.emnlp-main)
Copied to clipboard
| Challenge: | morphological inflection models typically employ language-independent data splitting algorithms. |
| Approach: | They propose language-specific probes to test aspects of morphological generalization . they use three morphology-distinct languages to test their generalization abilities . |
| Outcome: | The proposed language-specific probes are used to test morphological generalization abilities on three distinct languages. |
Morphology Without Borders: Clause-Level Morphology (2022.tacl-1)
Copied to clipboard
| Challenge: | Morphological tasks use large multi-lingual datasets that organize words into inflection tables . lack of a clear linguistic and operational definition of what is a word impairs universality of tasks . |
| Approach: | They propose to view morphology as a clause-level phenomenon, rather than word-level . they propose to use a dataset for clause- level morphological tasks in 4 different languages . |
| Outcome: | The proposed dataset for clause-level morphology covers 4 typologically different languages: English, German, Turkish, and Hebrew. |
Morphological Inflection: A Reality Check (2023.acl-long)
Copied to clipboard
| Challenge: | Morphological inflection is a popular task in sub-word NLP with practical and cognitive applications. |
| Approach: | They propose new methods to analyze data sets and evaluate their generalization abilities to better reflect likely use-cases. |
| Outcome: | The proposed methods improve generalizability and reliability of results and improve generalization abilities. |
OOVs in the Spotlight: How to Inflect Them? (2024.lrec-main)
Copied to clipboard
| Challenge: | Inflection is a process of word formation in which a base word form (lemma) is modified to express grammatical categories. |
| Approach: | They develop a retrograde model and two sequence-to-sequence models based on LSTM and Transformer. |
| Outcome: | The proposed systems outperform the existing systems on 9 out of 16 languages in the OOV evaluation. |
Can a Transformer Pass the Wug Test? Tuning Copying Bias in Neural Morphological Inflection Models (2022.acl-short)
Copied to clipboard
| Challenge: | morphological inflection models have been successful with shared tasks . but they fail at generalizing inflation patterns when trained on a limited number of lemmata . |
| Approach: | They find that standard models fail at generalizing inflection patterns when trained on a limited number of lemmata and asked to inflect previously unseen lemma. |
| Outcome: | The proposed model can perform well on morphological inflection tasks if training data covers a diversity of lemmata or some variant of the input lemma has been witnessed during training. |
Searching for Search Errors in Neural Morphological Inflection (2021.eacl-main)
Copied to clipboard
| Challenge: | Neural sequence-to-sequence models are the predominant choice for language generation tasks. |
| Approach: | They find that on word-level tasks, the empty string is often the global optimum . they suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill-suitedness of such models for language generation. |
| Outcome: | The results suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill-suitedness of such models for language generation. |
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)
Copied to clipboard
| Challenge: | False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma. |
| Approach: | They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
| Outcome: | The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
Contextualization of Morphological Inflection (N19-1)
Copied to clipboard
| Challenge: | In this paper, we isolate the task of predicting a fully inflected sentence from its partially lemmatized version. |
| Approach: | They propose a task that requires morphological features to be inferred from sentential context . they propose morphology-based models that explicitly reconstruct morphologic features before predicting inflected forms . |
| Outcome: | The proposed model is able to predict inflected sentences without relying on morphological annotations. |
Pushing the Limits of Low-Resource Morphological Inflection (D19-1)
Copied to clipboard
| Challenge: | Recent advances in morphological inflection generation have limited resources . antonisa and colleagues present a battery of improvements to improve performance under low-resource conditions . |
| Approach: | They propose a two-step attention architecture for the inflection decoder that uses two-segments attention and a multi-single-syllabic attention architecture. |
| Outcome: | The proposed model outperforms the state-of-the-art in low-resource languages by 15 percentage points . the proposed model also shows that it can be used to model monolingual data hallucinations . |