Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text (N19-1)
Copied to clipboard
| Challenge: | Using context-sensitive approaches to lemmatization can improve accuracy on unseen and unseense words. |
| Approach: | They propose to use inflection tables and Wikipedia sentences to train a lemmatizer with little or no labeled corpus data to combine type-based learning with context. |
| Outcome: | The proposed model generalizes from unambiguous examples, improving overall and especially on unseen words. |
Similar Papers
Context Sensitive Neural Lemmatization with Lematus (N18-1)
Copied to clipboard
| Challenge: | a new contextsensitive lemmatizer is designed to improve performance on unseen and ambiguous words. |
| Approach: | They propose a context-sensitive lemmatizer which incorporates character-level sentence context. |
| Outcome: | The proposed model outperforms the best competitor in a data setting and lower-resource setting . the model includes context for ambiguous words, but the latter has a greater effect on performance . |
Lemma Dilemma: On Lemma Generation Without Domain- or Language-Specific Training Data (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) can generate lemmas in context without prior fine-tuning. |
| Approach: | They compare in-context lemma generation with traditional fully supervised approaches . they use encoder-only supervised methods and cross-lingual methods . |
| Outcome: | The proposed model outperforms the traditional fully supervised approach in the context of lemmatization tasks. |
How low is too low? A monolingual take on lemmatisation in Indian languages (2021.naacl-main)
Copied to clipboard
| Challenge: | Prior work on ML based lemmatization focused on high resource languages, where data sets (word forms) are readily available. |
| Approach: | They propose to use neural methods to relate inflected forms of words to their dictionary form to reduce the sparse data problem. |
| Outcome: | The proposed methods can give competitive accuracy even in low resource setting. |
Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources (2021.eacl-main)
Copied to clipboard
| Challenge: | a hybrid approach to lemmatization enhances the seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system. |
| Approach: | They propose a hybrid approach that enhances a seq2seq neural model with additional lemmas extracted from an external lexicon or a rule-based system. |
| Outcome: | The proposed model achieves statistically significant improvements on 23 UD languages, compared to baseline models not utilizing additional lemma information. |
Contextualization of Morphological Inflection (N19-1)
Copied to clipboard
| Challenge: | In this paper, we isolate the task of predicting a fully inflected sentence from its partially lemmatized version. |
| Approach: | They propose a task that requires morphological features to be inferred from sentential context . they propose morphology-based models that explicitly reconstruct morphologic features before predicting inflected forms . |
| Outcome: | The proposed model is able to predict inflected sentences without relying on morphological annotations. |
Evaluating Shortest Edit Script Methods for Contextual Lemmatization (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern contextual lemmatizers often rely on automatically induced Shortest Edit Scripts (SES) supervised contextual methods are used to perform lemma classification tasks. |
| Approach: | They propose to use masked language encoders to compute shortest edit Scripts (SES) SES is the number of edit operations to transform a word form into its lemma . |
| Outcome: | The proposed model outperforms language-specific models in all evaluation settings with seven languages of different morphological complexity. |
Data augmentation using back-translation for context-aware neural machine translation (D19-65)
Copied to clipboard
| Challenge: | A single sentence does not always convey information that is enough to translate it into other languages. |
| Approach: | They obtain large-scale pseudo parallel corpora by back-translating monolingual data and examine their impact on translation accuracy. |
| Outcome: | The large-scale pseudo parallel corpora obtained by back-translating monolingual data showed that the model trained with small parallel corporeals and large-sized pseudo parallels improved translation accuracy. |
Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relations (N18-2)
Copied to clipboard
| Challenge: | Neural network-based models for NLP have been growing with state-of-the-art results in various tasks. |
| Approach: | They propose a data augmentation method for labeled sentences called contextual augmentation. |
| Outcome: | The proposed method improves classifiers based on convolutional or recurrent neural networks. |
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)
Copied to clipboard
| Challenge: | False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma. |
| Approach: | They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
| Outcome: | The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
Improving Lemmatization of Non-Standard Languages with Joint Learning (N19-1)
Copied to clipboard
| Challenge: | Lemmatization is a task of mapping a token to its corresponding dictionary head-form to abstract away from orthographic and inflectional variation. |
| Approach: | They propose to improve lemmatization performance on non-standard historical languages . they propose an Encoder-Decoder architecture which enriches with sentence information . |
| Outcome: | The proposed model does not require POS or morphological annotations, which are not always available for historical corpora. |