Improving Lemmatization of Non-Standard Languages with Joint Learning (N19-1)

Copied to clipboard

Challenge: Lemmatization is a task of mapping a token to its corresponding dictionary head-form to abstract away from orthographic and inflectional variation.
Approach: They propose to improve lemmatization performance on non-standard historical languages . they propose an Encoder-Decoder architecture which enriches with sentence information .
Outcome: The proposed model does not require POS or morphological annotations, which are not always available for historical corpora.

Similar Papers

Lemma Dilemma: On Lemma Generation Without Domain- or Language-Specific Training Data (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) can generate lemmas in context without prior fine-tuning.
Approach: They compare in-context lemma generation with traditional fully supervised approaches . they use encoder-only supervised methods and cross-lingual methods .
Outcome: The proposed model outperforms the traditional fully supervised approach in the context of lemmatization tasks.
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)

Copied to clipboard

Challenge: False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma.
Approach: They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora.
Outcome: The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora.
LemmaTag: Jointly Tagging and Lemmatizing for Morphologically Rich Languages with BRNNs (D18-1)

Copied to clipboard

Challenge: We compare morphologically rich languages with analytical languages like English due to the large vocabulary size and data sparsity.
Approach: They propose a featureless neural network architecture that generates part-of-speech tags and lemmas for sentences by using bidirectional RNNs with character-level and word-level embeddings.
Outcome: The proposed model outperforms state-of-the-art models in Czech, German, and Arabic.
Lemmatization as a Classification Task: Results from Arabic across Multiple Genres (2025.emnlp-main)

Copied to clipboard

Challenge: Existing tools for lemmatization in morphologically rich languages with ambiguous orthography face inconsistent standards and limited genre coverage.
Approach: They propose two new approaches that frame lemmatization as classification into a Lemma-POS-Gloss tagset, leveraging machine translation and semantic clustering.
Outcome: The proposed models perform better than existing models and are more interpretable, the authors show.
Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological Tagging (2020.acl-main)

Copied to clipboard

Challenge: a word can have multiple interpretations and is one of many inflected forms of the same concept or lemma.
Approach: They propose to model morphological features jointly, whether lexicalized or non-lexicalised . their results are compared to Arabic and Egyptian Arabic .
Outcome: The proposed model achieves 20% relative error reduction in Arabic and 11% in Egyptian Arabic.
Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources (2021.eacl-main)

Copied to clipboard

Challenge: a hybrid approach to lemmatization enhances the seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system.
Approach: They propose a hybrid approach that enhances a seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system.
Outcome: The proposed model achieves statistically significant improvements on 23 UD languages, compared to baseline models not utilizing additional lemma information.
Lemmatisation & Morphological Analysis of Unedited Greek: Do Simple Tasks Need Complex Solutions? (2025.findings-acl)

Copied to clipboard

Challenge: Existing systems for part-of-speech tagging of unedited Greek text have outperformed traditional methods for morphological analysis and lemmatisation.
Approach: They propose to combine nominal features into a single label and combine the three most distinctive features of verbs into another unified label.
Outcome: The proposed models outperform traditional models in lemmatisation and morphological analysis and show that multi-task learning improves performance by transferring parameters.
Analysing cross-lingual transfer in lemmatisation for Indian languages (2020.coling-main)

Copied to clipboard

Challenge: Inference-based scripts such as Abjad are difficult for cross-lingual models to learn in extremely low resource scenarios.
Approach: They evaluate cross-lingual approaches for low resource languages and compare their performance against other models using different linguistic factors.
Outcome: The proposed model on six low resource languages from two different families is compared with monolingual models on morphologically rich Indian languages.
AGILe: The First Lemmatizer for Ancient Greek Inscriptions (2022.lrec-1)

Copied to clipboard

Challenge: Existing models for ancient Greek inscriptions are not performant on epigraphic data due to language differences . a lemmatizer for ancient inscription data can enable meaningful generalizations, we show .
Approach: They propose to train an automatic lemmatizer for ancient Greek inscriptions with 80% accuracy . they also show that existing models are not performant on epigraphic data .
Outcome: The proposed model achieves above 80% accuracy on epigraphic data, and makes it available to the community.
Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text (N19-1)

Copied to clipboard

Challenge: Using context-sensitive approaches to lemmatization can improve accuracy on unseen and unseense words.
Approach: They propose to use inflection tables and Wikipedia sentences to train a lemmatizer with little or no labeled corpus data to combine type-based learning with context.
Outcome: The proposed model generalizes from unambiguous examples, improving overall and especially on unseen words.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations