| Challenge: | Modern Hawaiian orthography includes characters for long vowels and glottal stops . manual transliteration is laborious when performed manually . |
| Approach: | They propose two methods to help transliterate Hawaiian between older and newer texts automatically using finite state transducers and a recurrent neural network language model. |
| Outcome: | The proposed method solves the transliteration problem automatically using finite state transducers and a neural network language model. |
Similar Papers
Statistical and Neural Methods for Hawaiian Orthography Modernization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hawaiian orthography employs two distinct spelling systems, both of which are used by communities of speakers today. |
| Approach: | They develop models that convert between the ‘okina letter and kahak diacritic, which represent glottal stops and long vowels, respectively. |
| Outcome: | The proposed models outperform neural seq2seq models and LLMs in a low-resource setting, highlighting the potential for traditional machine learning approaches in . low-cost environments. |
Restoring ancient text using deep learning: a case study on Greek epigraphy (D19-1)
Copied to clipboard
| Challenge: | illegible parts of ancient texts must be restored by specialists, known as epigraphists, using deep neural networks to recover missing characters from text input. |
| Approach: | They propose a model that recovers missing characters from a damaged text input using deep neural networks. |
| Outcome: | The proposed model achieves a 30.1% character error rate, compared to the 57.3% of human epigraphists. |
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a new text-to-text transformer is suitable for multilingual inputs . many of the current models are English-only, making them inapplicable to other languages. |
| Approach: | They propose to extend a multilingual text-to-text transformer to handle long inputs . they use the mC4 dataset to pretrain the model to handle multilingual data . |
| Outcome: | The proposed model performs well on multilingual summarization and question-answering tasks. |
Neural OCR Post-Hoc Correction of Historical Corpora (2021.tacl-1)
Copied to clipboard
| Challenge: | Optical character recognition (OCR) is crucial for a deeper access to historical collections. |
| Approach: | They propose a neural approach based on a combination of recurrent (RNN) and deep convolutional network (ConvNet) to correct OCR transcription errors. |
| Outcome: | The proposed model reduces the word error rate of 32.3% by more than 89% on a historical book corpus in German language. |
Simplified Abugidas (P18-2)
Copied to clipboard
| Challenge: | Abugidas are writing systems where consonant letters represent syllables with a default vowel and other vowels are denoted by diacritics. |
| Approach: | They investigated the feasibility of recovering the original text written in an abugida after omitting subordinate diacritics and merging consonant letters with similar phonetic values. |
| Outcome: | The proposed method recovers the original text written in an abugida with 94% - 97% accuracy at the top-1 level and 98% - 99% at the bottom-4 level even after omitting most diacritics and merging the remaining 30 - 50 characters into 21 graphemes. |
Embible: Reconstruction of Ancient Hebrew and Aramaic Texts Using Transformers (2024.findings-eacl)
Copied to clipboard
| Challenge: | inscriptions are damaged over time due to earthquakes, fires, political conflicts, and other natural and human-related causes. |
| Approach: | They evaluate masked language modeling approach to reconstruct illegible inscriptions . they use transformer-based models to fine-tune models on Biblical texts . |
| Outcome: | The proposed model achieves the highest text completion accuracy on masked parts of the Biblical texts. |
HisDoc-OCR: Restoring Visual Grounding in MLLMs for Chinese Historical Document OCR (2026.findings-acl)
Copied to clipboard
| Challenge: | Despite multimodal large language models' strong performance on modern document OCR, their application to historical Chinese texts suffers from severe hallucinations, character fabrication, uncontrolled repetition, and semantic drift. |
| Approach: | They propose a multimodal large language model which restores visual grounding through three synergistic strategies: Layout Injection, First-Occurrence Boost, Self-Distilled Attention Focusing and HisDoc-OCR. |
| Outcome: | The proposed model outperforms general-purpose and OCR-specific models on Chinese historical documents. |
Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLP (2026.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual transfer is often hindered by the "script barrier" where differences in writing systems inhibit transfer learning . transliteration is a powerful technique to bridge this gap by increasing lexical overlap . authors present a taxonomy of key motivations to utilize transliterations in language models . |
| Approach: | They propose a taxonomy of key motivations to utilize transliterations in NLP . they analyze the evolution and effectiveness of these methods and discuss trade-offs . |
| Outcome: | The proposed transliteration technique is effective in cross-lingual NLP, the authors argue . the proposed translliteration method is a powerful tool to overcome the "script barrier" |
OCR Post Correction for Endangered Language Texts (2020.emnlp-main)
Copied to clipboard
| Challenge: | Currently, there is little to no data available to build natural language processing models for endangered languages. |
| Approach: | They propose a benchmark dataset of transcriptions for scanned books in three critically endangered languages and a method to improve OCR in these data-scarce settings. |
| Outcome: | The proposed method reduces the recognition error rate by 34% across the three endangered languages. |
Code-Switching and Back-Transliteration Using a Bilingual Model (2024.findings-eacl)
Copied to clipboard
| Challenge: | a wealth of Judeo-Arabic texts is available on the internet, but most speakers of Arabic are unfamiliar with the Hebrew script. |
| Approach: | They propose two machine-learning models for transliterating Judeo-Arabic into Arabic . they also propose a model for identifying non-Arabian words, predominantly Hebrew and Aramaic . |
| Outcome: | The proposed models outperform previous solutions for transliterating Judeo-Arabic into Arabic and identifying non-Arabian words, mainly Hebrew and Aramaic. |