Free as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskrit (D18-1)
Copied to clipboard
Amrith Krishna, Bishal Santra, Sasi Prasanth Bandaru, Gaurav Sahu, Vishnu Dutt Sharma, Pavankumar Satuluri, Pawan Goyal
| Challenge: | a structured prediction framework is proposed to solve word segmentation and morphological tagging tasks in a free word order language. |
| Approach: | They propose a structured prediction framework that jointly solves word segmentation and morphological tagging tasks in Sanskrit. |
| Outcome: | The proposed model outperforms the state of the art with an F-Score of 96.92 (percentage improvement of 7.06%) while using less than one tenth of the task-specific training data. |
Similar Papers
Keep it Surprisingly Simple: A Simple First Order Graph Based Parsing Model for Joint Morphosyntactic Parsing in Sanskrit (2020.emnlp-main)
Copied to clipboard
| Challenge: | Morphologically rich languages benefit from joint processing of morphology and syntax, as compared to pipeline architectures. |
| Approach: | They propose a graph-based model for joint morphological parsing and dependency parser in Sanskrit using the Energy based model framework. |
| Outcome: | The proposed model outperforms standalone morphological parsers in morphology and syntax parsing, and in dependency parser. |
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Morphologically rich languages are notoriously challenging to process for downstream NLP applications. |
| Approach: | They propose a pretrained model for NLP applications involving the morphologically rich language Sanskrit that outperforms previous models by a considerable margin. |
| Outcome: | The proposed model outperforms tokenized models on established Sanskrit word segmentation tasks and matches the current best lexicon-based model. |
Sanskrit Word Segmentation Using Character-level Recurrent and Convolutional Neural Networks (D18-1)
Copied to clipboard
| Challenge: | Using end-to-end neural network models, Sanskrit is tokenized by splitting compounds and resolving phonetic merges. |
| Approach: | They propose end-to-end neural network models that tokenize Sanskrit by jointly splitting compounds and resolving phonetic merges. |
| Outcome: | The proposed models outperform the state-of-the-art for the task of splitting compounds and resolving phonetic merges. |
Building a Word Segmenter for Sanskrit Overnight (L18-1)
Copied to clipboard
| Challenge: | Sanskrit word segmentation is challenging due to the issue of Sandhi . digitisation efforts have made the manuscripts available in the public domain . |
| Approach: | They propose a deep sequence to sequence model that takes only the sandhied string as input and predicts the unsandhized string. |
| Outcome: | The proposed model improves on the current state of the art by 16.79% . the system can be trained "overnight" and be used for production . |
CSSL: Contrastive Self-Supervised Learning for Dependency Parsing on Relatively Free Word Ordered and Morphologically Rich Low Resource Languages (2024.emnlp-main)
Copied to clipboard
| Challenge: | Neural dependency parsing has achieved remarkable performance for low resource morphologically rich languages. |
| Approach: | They propose a self-supervised learning method to make the model robust to word order variations. |
| Outcome: | The proposed model shows a substantial gain of 3.03/2.95 points in 7 relatively free word order languages when compared to the best performing baseline. |
SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposes (2023.acl-demo)
Copied to clipboard
| Challenge: | SanskritShala is a neural-based Sanskrit NLP toolkit that is available as a web-based application . |
| Approach: | They propose a neural Sanskrit NLP toolkit that facilitates linguistic analyses for word segmentation, morphological tagging, dependency parsing, and compound type identification. |
| Outcome: | The proposed toolkit reports state-of-the-art performance on benchmark datasets . it is built with easy-to-use interactive data annotation features . |
An Exploration of Arbitrary-Order Sequence Labeling via Energy-Based Inference Networks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows that conditional random fields (CRFs) perform well in sequence labeling tasks. |
| Approach: | They propose several high-order energy terms to capture dependencies among labels in sequence labeling . they use convolutional, recurrent, and self-attention networks to construct these energy terms . |
| Outcome: | The proposed approach improves on four sequence labeling tasks while having the same decoding speed as simple classifiers. |
Poetry to Prose Conversion in Sanskrit as a Linearisation Task: A Case for Low-Resource Languages (P19-1)
Copied to clipboard
| Challenge: | Obtaining the proper word ordering, called as the prose ordering, from a verse is often considered a task which requires linguistic expertise. |
| Approach: | They propose a word ordering (linearisation) task that ignores the word arrangement at the verse side. |
| Outcome: | The proposed model outperforms current models in word ordering for the translation task in Sanskrit. |
Neural Factor Graph Models for Cross-lingual Morphological Tagging (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to morphological tagging are limited by the assumption that tag sets overlap . a limited amount of data is available for most languages to learn these morphology taggers. |
| Approach: | They propose a method for cross-lingual morphological tagging that relaxes this assumption . they use factorial conditional random fields with neural network potentials to smooth over superficial differences in the surface forms . |
| Outcome: | The proposed model can smooth over superficial differences in the surface forms and generate unseen or rare tag sets. |
A Simple Joint Model for Improved Contextual Neural Lemmatization (N19-1)
Copied to clipboard
| Challenge: | False positive: a core NLP task of lemmatization seeks to map multiple forms of English verbs to a canonical one, known as the lemma. |
| Approach: | They propose a joint neural model for lemmatization and morphological tagging that achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |
| Outcome: | The proposed model achieves state-of-the-art results on 20 languages from the Universal Dependencies corpora. |