Evaluating Shortest Edit Script Methods for Contextual Lemmatization (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern contextual lemmatizers often rely on automatically induced Shortest Edit Scripts (SES) supervised contextual methods are used to perform lemma classification tasks. |
| Approach: | They propose to use masked language encoders to compute shortest edit Scripts (SES) SES is the number of edit operations to transform a word form into its lemma . |
| Outcome: | The proposed model outperforms language-specific models in all evaluation settings with seven languages of different morphological complexity. |
Similar Papers
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)
Copied to clipboard
| Challenge: | False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma. |
| Approach: | They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
| Outcome: | The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
Lemma Dilemma: On Lemma Generation Without Domain- or Language-Specific Training Data (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) can generate lemmas in context without prior fine-tuning. |
| Approach: | They compare in-context lemma generation with traditional fully supervised approaches . they use encoder-only supervised methods and cross-lingual methods . |
| Outcome: | The proposed model outperforms the traditional fully supervised approach in the context of lemmatization tasks. |
Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text (N19-1)
Copied to clipboard
| Challenge: | Using context-sensitive approaches to lemmatization can improve accuracy on unseen and unseense words. |
| Approach: | They propose to use inflection tables and Wikipedia sentences to train a lemmatizer with little or no labeled corpus data to combine type-based learning with context. |
| Outcome: | The proposed model generalizes from unambiguous examples, improving overall and especially on unseen words. |
Context Sensitive Neural Lemmatization with Lematus (N18-1)
Copied to clipboard
| Challenge: | a new contextsensitive lemmatizer is designed to improve performance on unseen and ambiguous words. |
| Approach: | They propose a context-sensitive lemmatizer which incorporates character-level sentence context. |
| Outcome: | The proposed model outperforms the best competitor in a data setting and lower-resource setting . the model includes context for ambiguous words, but the latter has a greater effect on performance . |
LemmaTag: Jointly Tagging and Lemmatizing for Morphologically Rich Languages with BRNNs (D18-1)
Copied to clipboard
| Challenge: | We compare morphologically rich languages with analytical languages like English due to the large vocabulary size and data sparsity. |
| Approach: | They propose a featureless neural network architecture that generates part-of-speech tags and lemmas for sentences by using bidirectional RNNs with character-level and word-level embeddings. |
| Outcome: | The proposed model outperforms state-of-the-art models in Czech, German, and Arabic. |
How low is too low? A monolingual take on lemmatisation in Indian languages (2021.naacl-main)
Copied to clipboard
| Challenge: | Prior work on ML based lemmatization focused on high resource languages, where data sets (word forms) are readily available. |
| Approach: | They propose to use neural methods to relate inflected forms of words to their dictionary form to reduce the sparse data problem. |
| Outcome: | The proposed methods can give competitive accuracy even in low resource setting. |
AGILe: The First Lemmatizer for Ancient Greek Inscriptions (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing models for ancient Greek inscriptions are not performant on epigraphic data due to language differences . a lemmatizer for ancient inscription data can enable meaningful generalizations, we show . |
| Approach: | They propose to train an automatic lemmatizer for ancient Greek inscriptions with 80% accuracy . they also show that existing models are not performant on epigraphic data . |
| Outcome: | The proposed model achieves above 80% accuracy on epigraphic data, and makes it available to the community. |
Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources (2021.eacl-main)
Copied to clipboard
| Challenge: | a hybrid approach to lemmatization enhances the seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system. |
| Approach: | They propose a hybrid approach that enhances a seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system. |
| Outcome: | The proposed model achieves statistically significant improvements on 23 UD languages, compared to baseline models not utilizing additional lemma information. |
Small and Practical BERT Models for Sequence Labeling (D19-1)
Copied to clipboard
| Challenge: | Existing models for morphosyntactic tagging have focused on building separate models for each language or for a small group of related languages. |
| Approach: | They propose a scheme to train a single multilingual sequence labeling model that is small and fast enough to run on a CPU. |
| Outcome: | The proposed model outperforms state-of-the-art models on low-resource languages and low-level models on codemixed inputs. |
Lemmatization as a Classification Task: Results from Arabic across Multiple Genres (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing tools for lemmatization in morphologically rich languages with ambiguous orthography face inconsistent standards and limited genre coverage. |
| Approach: | They propose two new approaches that frame lemmatization as classification into a Lemma-POS-Gloss tagset, leveraging machine translation and semantic clustering. |
| Outcome: | The proposed models perform better than existing models and are more interpretable, the authors show. |