| Challenge: | In this work, we focus on producing morphologically enhanced word embeddings for Tamil, a highly agglutinative South Indian language with rich morphology that remains low-resource with regards to NLP tasks. |
| Approach: | They present a first-ever word analogy dataset for Tamil using a rules-based segmenter and meta-embedding techniques. |
| Outcome: | The proposed embeddings outperform baselines on the word analogy task by 16% and appear to mitigate a trade-off between semantic and morphological accuracy. |
Similar Papers
Incorporating Latent Meanings of Morphological Compositions to Enhance Word Embeddings (P18-1)
Copied to clipboard
| Challenge: | Existing word embedding methods learn semantic information at word level while neglecting meaningful inner structures of words like morphemes. |
| Approach: | They propose to use latent meanings of morphological compositions of words to train word embeddings. |
| Outcome: | The proposed models outperform baseline models on word similarity, syntactic analogy and text classification tasks. |
Exploring morphology-aware tokenization: A case study on Spanish language modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | a recent study shows that subword tokenization improves performance of neural language models. |
| Approach: | They propose a linguistically grounded approach to train a tokenizer on morphologically segmented data. |
| Outcome: | The proposed tokenizer improves on a Spanish language model with morphological information. |
Morphology-rich Alphasyllabary Embeddings (2020.lrec-1)
Copied to clipboard
| Challenge: | Word embeddings have been successfully trained in many languages, but evaluations in lesser-resourced languages have been cursory and highly variable. |
| Approach: | They propose to build a word embedding model suitable for the Semitic language of Amharic (Ethiopia) it is morphologically rich and written as an alphasyllabary rather than an alphabet . |
| Outcome: | The proposed model performs on word analogy tasks on the Semitic language of Amharic (Ethiopia) it is morphologically rich and written as an alphasyllabary rather than an alphabet . |
Morphology Without Borders: Clause-Level Morphology (2022.tacl-1)
Copied to clipboard
| Challenge: | Morphological tasks use large multi-lingual datasets that organize words into inflection tables . lack of a clear linguistic and operational definition of what is a word impairs universality of tasks . |
| Approach: | They propose to view morphology as a clause-level phenomenon, rather than word-level . they propose to use a dataset for clause- level morphological tasks in 4 different languages . |
| Outcome: | The proposed dataset for clause-level morphology covers 4 typologically different languages: English, German, Turkish, and Hebrew. |
How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology? (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Data-driven subword segmentation is the default strategy for open-vocabulary machine translation but may not be sufficiently generic for learning non-concatenative morphology. |
| Approach: | They propose to test data-driven subword segmentation on non-concatenative morphological phenomena in a controlled, semi-synthetic setting. |
| Outcome: | The proposed model can translate non-concatenative morphological phenomena in a controlled, semi-synthetic setting. |
Using Morphological Knowledge in Open-Vocabulary Neural Language Models (N18-1)
Copied to clipboard
| Challenge: | Existing models that generate words from a fixed vocabulary are linguistically nave . authors present an open-vocabulary language model that incorporates morphological knowledge into a neural framework . |
| Approach: | They propose a model that incorporates morphological knowledge into a neural model by generating words as a sequence of characters, generating full word forms and combining them with a hand-written morphology analyzer. |
| Outcome: | The proposed model outperforms character-based models on Finnish, Turkish, and Russian on three languages. |
BioReddit: Word Embeddings for User-Generated Biomedical NLP (D19-62)
Copied to clipboard
| Challenge: | a corpus of medical-themed posts was scrapped from Reddit to train word embeddings on downstream tasks. |
| Approach: | They propose to train word embeddings from a corpus of medical forums from reddit scrapping posts from medical-themed subreddits. |
| Outcome: | The proposed system outperforms embeddings trained on general purpose data or on scientific papers when applied on user-generated content. |
Leveraging Meta-Embeddings for Bilingual Lexicon Extraction from Specialized Comparable Corpora (C18-1)
Copied to clipboard
| Challenge: | Recent studies on bilingual lexicon extraction from specialized comparable corpora show differences in performance . lack of large specialized corporan to build efficient representations can be partially explained . |
| Approach: | They propose to use character-based embedding models to combine different embeddable models . they emphasize how character-driven embeddance models outperform other models on quality . |
| Outcome: | The proposed model outperforms other models on quality of extracted bilingual lexicons . comparable corpora are an interesting and practical alternative to parallel corporation . |
LLMSegm: Surface-level Morphological Segmentation Using Large Language Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to morphological segmentation split word into its morphemes . LLMSegm is applicable in low-data settings and low-resourced languages . |
| Approach: | They propose a novel approach to surface-level morphological segmentation leveraging large language models. |
| Outcome: | The proposed method is applicable in low-data settings and low-resource languages. |
Wiktionary Normalization of Translations and Morphological Information (2020.coling-main)
Copied to clipboard
| Challenge: | We extend the Yawipa Wiktionary Parser to extract and normalize translations from etymology glosses and morphological form-of relations. |
| Approach: | They extend Yawipa to extract and normalize translations from etymology glosses . they propose a method to identify typos in translation annotations based on extracted morphological data . |
| Outcome: | The proposed method improves on a standard attention baseline by using copy attention. |