Beyond Atomic Characters: Glyph-Aware Sub-character Alignment for Low-Resource Multilingual OCR (2026.acl-long)
Copied to clipboard
| Challenge: | Low-resource multilingual OCR models struggle with complex script structures and data scarcity. |
| Approach: | They propose a framework for multilingual character recognition that integrates visual and linguistic backbones with a novel glyph-aware interface. |
| Outcome: | The proposed framework improves on high-resolution visual and language backbones with glyph-aware interface. |
Similar Papers
Meeting the Needs of Low-Resource Languages: The Value of Automatic Alignments via Pretrained Models (2023.eacl-main)
Copied to clipboard
Abteen Ebrahimi, Arya D. McCarthy, Arturo Oncevay, John E. Ortega, Luis Chiruzzo, Gustavo Giménez-Lugo, Rolando Coto-Solano, Katharina Kann
| Challenge: | Large multilingual models have inspired a new class of word alignment methods, which work well for pretraining languages. |
| Approach: | They propose to use transformer-based word alignment methods to extract alignments from massive pretrained models. |
| Outcome: | The proposed methods outperform traditional methods for languages unseen to pretraining models, and are competitive with each other. |
OCR Improves Machine Translation for Low-Resource Languages (2022.findings-acl)
Copied to clipboard
| Challenge: | Despite many recent successes, Machine Translation still lacks support or fails to achieve good performance for most low-resource languages. |
| Approach: | They propose a benchmark to evaluate OCR systems on low-resource languages and low- resource scripts. |
| Outcome: | The proposed benchmark evaluates state-of-the-art OCR systems on low-resource languages and low-rural scripts. |
Low-resource Neural Machine Translation with Cross-modal Alignment (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing neural machine translation techniques rely on large monolingual corpus, which is costly for some low-resource languages. |
| Approach: | They propose a cross-modal contrastive learning method to learn a shared space for all languages by additional visual modality. |
| Outcome: | The proposed method can learn cross-modal and cross-lingual alignment with small amount of image-text pairs and achieves significant improvements over the text-only baseline. |
Let’s Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Robust and Instruction-Aware ASR and OCR (2025.findings-acl)
Copied to clipboard
| Challenge: | Various fusion strategies have been explored for integration of large language models into multi-modal systems. |
| Approach: | They propose a framework for deep fusion decoding that integrates large language models into cross-modal text recognition systems. |
| Outcome: | The proposed framework surpasses cascaded methods in English and Mandarin, and significantly reduces WERs by 17.7%. |
Low-Resource Sequence Labeling via Unsupervised Multilingual Contextualized Representations (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual sequence labeling require bilingual resources and require linguistic knowledge. |
| Approach: | They propose a multilingual language model with deep semantic Alignment to generate language-independent representations for cross-lingual sequence labeling. |
| Outcome: | The proposed model achieves state-of-the-art NER and POS performance across European languages and on distant language pairs such as English and Chinese. |
VOLTAGE: A Versatile Contrastive Learning based OCR Methodology for ultra low-resource scripts through Auto Glyph Feature Extraction (2024.eacl-long)
Copied to clipboard
| Challenge: | UNESCO has classified 2500 out of 7000 languages spoken worldwide as endangered . low resource languages are at a greater risk of extinction due to lack of unsupervised OCR methodologies for low resource . |
| Approach: | They propose a contrastive learning based OCR methodology that leverages auto-glyph feature recommendation for cluster-based labelling. |
| Outcome: | The proposed method achieves 95% accuracy for machine printed and 87% for handwritten samples on Takri script. |
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality. |
| Approach: | They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model. |
| Outcome: | The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs. |
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts (2021.emnlp-main)
Copied to clipboard
| Challenge: | Massively multilingual language models offer state-of-the-art cross-lingual transfer performance on a range of NLP tasks, but there is a profound performance gap between resource-rich and resource-poor target languages. |
| Approach: | They propose a series of data-efficient methods that enable quick and effective adaptation of pretrained multilingual models to low-resource languages and unseen scripts. |
| Outcome: | The proposed methods improve learning of the new dedicated embedding matrix in the target language and for low-resource languages written in unseen scripts. |
Unsupervised Cross-Lingual Representation Learning (P19-4)
Copied to clipboard
| Challenge: | a comprehensive survey of cutting-edge weakly-supervised and unsupervised cross-lingual word representations is presented . |
| Approach: | This tutorial provides a comprehensive survey of recent work on weakly-supervised and unsupervised cross-lingual word representations. |
| Outcome: | This tutorial provides a comprehensive survey of cutting-edge weakly-supervised and unsupervised word representations. |
MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning (2026.eacl-long)
Copied to clipboard
Kosei Uemura, David Guzmán, Quang Phuoc Nguyen, Jesujoba Oluwadara Alabi, En-Shiun Annie Lee, David Ifeoluwa Adelani
| Challenge: | Existing methods to align large language models with multilingual encoders raise accuracy for low-resource languages (LRLs) but performance of LLMs in low- and high-resourced languages remains a problem. |
| Approach: | They propose a model-stacking framework that iteratively refines in 2-stages based on a curriculum strategy and adapts only a small set of DoRA weights. |
| Outcome: | The proposed framework improves exact-match accuracy by +12.9 pp over MindMerger and outperforms GPT-4o-mini by 15.2 pp on the AfriMGSM benchmark. |