Challenge: Thirumurai is a collection of Tamil Shaivite poems dating back to the Hindu revival period . a large dataset containing all the Thirumuru poems is under-resourced .
Approach: They propose to use transformers to classify the Tamil Pann and author of each poem . they propose to train models on petabytes of data, such as the common crawl data .
Outcome: The proposed dataset contains all the Thirumurai poems and classifies the Pann and author of each poem using transformer based architectures.

Similar Papers

IruMozhi: Automatically classifying diglossia in Tamil (2024.findings-naacl)

Copied to clipboard

Challenge: Literary Tamil is highly diglossic, with two very different registers in everyday use . Spoken Tamil is under-studied in modern NLP systems compared to Literary Tamil written in the Tamil script .
Approach: They present a human-translated dataset of parallel text in Literary and Spoken Tamil.
Outcome: The proposed model trains classifiers on the task of identifying which Tamil variety a text belongs to.
Scaling Neural ITN for Numbers and Temporal Expressions in Tamil: Findings for an Agglutinative Low-resource Language (2023.emnlp-industry)

Copied to clipboard

Challenge: Inverse Text Normalisation (ITN) is a textrewriting task that converts verbalized text to written form.
Approach: They propose to use a seq2seq model, a non-autoregressive text editor and a sequence tagger + rules combination to fine-tune three pre-trained neural models.
Outcome: The proposed model improves with bootstrapping and data augmentation, and bootstrap alone shows a percentage improvement of 14.12 %.
BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources (2026.acl-long)

Copied to clipboard

Challenge: Existing reviews focus on a few high-resource languages or embed Indian languages within broad multilingual settings, limiting coverage of low-resourced and culturally diverse varieties.
Approach: They present a unified survey of Indian NLP resources, covering 200+ datasets, 50+ benchmarks, and 100+ models, tools, and systems across text, speech, multimodal, and culturally grounded tasks.
Outcome: The proposed survey covers 200+ datasets, 50+ benchmarks, and 100+ models, tools, and systems across text, speech, multimodal, and culturally grounded tasks.
Morphology-Aware Meta-Embeddings for Tamil (2021.naacl-srw)

Copied to clipboard

Challenge: In this work, we focus on producing morphologically enhanced word embeddings for Tamil, a highly agglutinative South Indian language with rich morphology that remains low-resource with regards to NLP tasks.
Approach: They present a first-ever word analogy dataset for Tamil using a rules-based segmenter and meta-embedding techniques.
Outcome: The proposed embeddings outperform baselines on the word analogy task by 16% and appear to mitigate a trade-off between semantic and morphological accuracy.
Deciphering Emotional Landscapes in the Iliad: A Novel French-Annotated Dataset for Emotion Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Using an emotion-annotated dataset, we aim to provide a resource for the scientific community to study the emotional intricacies of classical literature.
Approach: They propose to provide an emotion-annotated dataset for classical literature and Western mythology using a multivariate time series and a deep learning masked language model.
Outcome: The proposed dataset reveals compelling patterns and phenomena within the Iliad's emotional landscape.
Tafsir Dataset: A Novel Multi-Task Benchmark for Named Entity Recognition and Topic Modeling in Classical Arabic Literature (2022.coling-1)

Copied to clipboard

Challenge: Named entity recognition and topic modeling are crucial for downstream tasks in natural language processing.
Approach: They propose to address named entity recognition and topic modeling on CA literature . they manually annotate the work of Tafsir Al-Tabari with span-based NEs .
Outcome: The results show that the proposed task can perform state-of-the-art on historical topic models.
BanglaBook: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews (2023.findings-acl)

Copied to clipboard

Challenge: Existing literature on Bangla Sentiment Analysis (SA) has limited data and cross-domain adaptability.
Approach: They present a large-scale dataset of Bangla book reviews with 158,065 samples . they employ a range of machine learning models to establish baselines including SVM, LSTM, and Bangla-BERT.
Outcome: The proposed model improves performance over models that rely on manual features.
Lessons Learned from GPT-SW3: Building the First Large-Scale Generative Language Model for Swedish (2022.lrec-1)

Copied to clipboard

Challenge: a prerequisite for building large-scale generative models for other languages is access to large amounts of high-quality text data and powerful computational resources.
Approach: They present a 3.5 billion parameter autoregressive language model, trained on a 100 GB Swedish corpus.
Outcome: The proposed model performs well on a 100 GB Swedish corpus and is competent in comparison with existing models of similar size.
BanglaTLit: A Benchmark Dataset for Back-Transliteration of Romanized Bangla (2024.findings-emnlp)

Copied to clipboard

Challenge: low-resource languages like Bangla are limited by the lack of datasets.
Approach: They propose a large-scale transliteration dataset and a pre-training corpus on romanized Bangla.
Outcome: The proposed datasets show that the proposed methods can enrich romanized Bangla.
Graph Based Semi-Supervised Learning Approach for Tamil POS tagging (L18-1)

Copied to clipboard

Challenge: Parts of Speech (POS) tagging is challenging for low resourced languages such as Tamil . low resource Tamil does not have large POS annotated corpus to build good quality POS taggers using supervised machine learning techniques.
Approach: They propose a graph-based semi-supervised learning approach to classify unlabelled data using a small POS labelled data set.
Outcome: The proposed method achieves 0.8743 over 0.7333 produced by a CRF tagger for the same limited size corpus.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations