Lemma Dilemma: On Lemma Generation Without Domain- or Language-Specific Training Data (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) can generate lemmas in context without prior fine-tuning. |
| Approach: | They compare in-context lemma generation with traditional fully supervised approaches . they use encoder-only supervised methods and cross-lingual methods . |
| Outcome: | The proposed model outperforms the traditional fully supervised approach in the context of lemmatization tasks. |
Similar Papers
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)
Copied to clipboard
| Challenge: | False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma. |
| Approach: | They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
| Outcome: | The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text (N19-1)
Copied to clipboard
| Challenge: | Using context-sensitive approaches to lemmatization can improve accuracy on unseen and unseense words. |
| Approach: | They propose to use inflection tables and Wikipedia sentences to train a lemmatizer with little or no labeled corpus data to combine type-based learning with context. |
| Outcome: | The proposed model generalizes from unambiguous examples, improving overall and especially on unseen words. |
Improving Lemmatization of Non-Standard Languages with Joint Learning (N19-1)
Copied to clipboard
| Challenge: | Lemmatization is a task of mapping a token to its corresponding dictionary head-form to abstract away from orthographic and inflectional variation. |
| Approach: | They propose to improve lemmatization performance on non-standard historical languages . they propose an Encoder-Decoder architecture which enriches with sentence information . |
| Outcome: | The proposed model does not require POS or morphological annotations, which are not always available for historical corpora. |
Evaluating Shortest Edit Script Methods for Contextual Lemmatization (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern contextual lemmatizers often rely on automatically induced Shortest Edit Scripts (SES) supervised contextual methods are used to perform lemma classification tasks. |
| Approach: | They propose to use masked language encoders to compute shortest edit Scripts (SES) SES is the number of edit operations to transform a word form into its lemma . |
| Outcome: | The proposed model outperforms language-specific models in all evaluation settings with seven languages of different morphological complexity. |
Context Sensitive Neural Lemmatization with Lematus (N18-1)
Copied to clipboard
| Challenge: | a new contextsensitive lemmatizer is designed to improve performance on unseen and ambiguous words. |
| Approach: | They propose a context-sensitive lemmatizer which incorporates character-level sentence context. |
| Outcome: | The proposed model outperforms the best competitor in a data setting and lower-resource setting . the model includes context for ambiguous words, but the latter has a greater effect on performance . |
How low is too low? A monolingual take on lemmatisation in Indian languages (2021.naacl-main)
Copied to clipboard
| Challenge: | Prior work on ML based lemmatization focused on high resource languages, where data sets (word forms) are readily available. |
| Approach: | They propose to use neural methods to relate inflected forms of words to their dictionary form to reduce the sparse data problem. |
| Outcome: | The proposed methods can give competitive accuracy even in low resource setting. |
Lemmatization as a Classification Task: Results from Arabic across Multiple Genres (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing tools for lemmatization in morphologically rich languages with ambiguous orthography face inconsistent standards and limited genre coverage. |
| Approach: | They propose two new approaches that frame lemmatization as classification into a Lemma-POS-Gloss tagset, leveraging machine translation and semantic clustering. |
| Outcome: | The proposed models perform better than existing models and are more interpretable, the authors show. |
Analysing cross-lingual transfer in lemmatisation for Indian languages (2020.coling-main)
Copied to clipboard
| Challenge: | Inference-based scripts such as Abjad are difficult for cross-lingual models to learn in extremely low resource scenarios. |
| Approach: | They evaluate cross-lingual approaches for low resource languages and compare their performance against other models using different linguistic factors. |
| Outcome: | The proposed model on six low resource languages from two different families is compared with monolingual models on morphologically rich Indian languages. |
LLMaAA: Making Large Language Models as Active Annotators (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing supervised learning methods in natural language processing require large amounts of data. |
| Approach: | They propose an active learning loop that takes LLMs as annotators and puts them into an active loop to determine what to annotate efficiently. |
| Outcome: | The proposed model outperforms existing models with few-shot performance in two NLP tasks. |
Language Models Struggle to Use Representations Learned In-Context (2026.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that large language models are capable of inducing rich representations of data that are seen in-context . a novel task, adaptive world modeling, shows that even the most performant LLMs cannot reliably leverage novel semantics defined in-constitut. |
| Approach: | They propose to use in-context representations to induce rich representations of data . they also propose to probe models using a novel task to enable flexible deployment . |
| Outcome: | The proposed model can use in-context representations to complete simple downstream tasks. |