Papers by Tahsin Reasat
Unicode Normalization and Grapheme Parsing of Indic Languages (2024.lrec-main)
Copied to clipboard
Nazmuddoha Ansary, Quazi Adibur Rahman Adib, Tahsin Reasat, Asif Shahriyar Sushmit, Ahmed Imtiaz Humayun, Sazia Mehnaz, Kanij Fatema, Mohammad Mamun Or Rashid, Farig Sadeque
| Challenge: | Indic writing systems encode words as linear sequences of Unicode characters . authors propose a grapheme parser for Abugida text to normalize inconsistencies . |
| Approach: | They propose a normalizer for normalizing inconsistencies caused by Unicode encoding schemes . grapheme parser for Abugida deconstructs words into visually distinct orthographic syllables . |
| Outcome: | The proposed library is more efficient than the previously used IndicNLP normalizer . it deconstructs words into visually distinct orthographic syllables or complex graphemes . |