Evaluating Transformers for OCR Post-Correction in Early Modern Dutch Theatre (2025.coling-main)
Copied to clipboard
| Challenge: | a new study examines the effectiveness of two types of transformer models for OCR post-correction in early modern Dutch plays. |
| Approach: | They propose to use large generative models and sequence-to-sequence models for OCR post-correction in early modern Dutch plays. |
| Outcome: | The proposed model outperforms generative models on the OCR post-correction task . the model outpersforms the model with the lowest error rate on the historical English dataset . |
Similar Papers
Advancing Post-OCR Correction: A Comparative Study of Synthetic Data (2024.findings-acl)
Copied to clipboard
| Challenge: | Optical Character Recognition (OCR) is a useful tool for preserving cultural heritage and supporting downstream tasks. |
| Approach: | They propose an algorithm that leverages computer vision feature detection algorithms to calculate glyph similarity for constructing post-OCR synthetic data. |
| Outcome: | The proposed method significantly reduces CERs in low-resource languages without manually annotating data. |
Best of Both Worlds: Making High Accuracy Non-incremental Transformer-based Disfluency Detection Incremental (2021.acl-long)
Copied to clipboard
| Challenge: | Currently, Transformer-based text classifiers are not suitable for live incremental processing, operating only on the level of complete sentence inputs. |
| Approach: | They propose to introduce a method for word-by-word left-to-right incremental processing to Transformers such as BERT, models without an intrinsic sense of linear order. |
| Outcome: | The proposed method maintains high non-incremental performance while operating strictly incrementally. |
Unsupervised Multi-View Post-OCR Error Correction With Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior work used text generation techniques or redundancy in similar passages for OCR error correction, which is not appropriate in cases of low corpus redundancies or weak document contextual information. |
| Approach: | They propose to use a pretrained language model to reconcile different OCR views in unsupervised way so that their combination contains fewer errors than each individual view. |
| Outcome: | The proposed model can reconcile multiple OCR views so that their combined version contains fewer errors than the best OCR view. |
Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work attempts to apply incremental processing to NLUs but this is computationally expensive and does not scale efficiently for long sequences. |
| Approach: | They propose to apply Transformers incrementally via restart-incrementality by repeatedly feeding, to an unchanged model, increasingly longer input prefixes to produce partial outputs. |
| Outcome: | The proposed model has better incremental performance and faster inference speed compared to the standard Transformer and LT with restart-incrementality, at the cost of part of the non-incremental quality. |
Low-resource Post Processing of Noisy OCR Output for Historical Corpus Digitisation (L18-1)
Copied to clipboard
| Challenge: | 7.6% of the words in the original OCR text contain an error; fully manual correction would take thousands of hours due to the size of the corpus. |
| Approach: | They propose a post-processing system to efficiently correct OCR errors in a 2.7 million word Faroese corpus. |
| Outcome: | The proposed method reduces the word error rate to 1.3% with around 65 hours of human annotator work. |
New Datasets and Controllable Iterative Data Augmentation Method for Code-switching ASR Error Correction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In bilingual or multilingual settings, code-switching ASR has greater challenges and research value. |
| Approach: | They propose a controllable iterative method for improving the performance of mainstream automatic speech recognition systems by using Chinese-English code-switching dialogues. |
| Outcome: | The proposed method achieves the best performance compared with the rule-based, back-translation-based data augmentation methods and large language model ChatGPT. |
Let’s Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Robust and Instruction-Aware ASR and OCR (2025.findings-acl)
Copied to clipboard
| Challenge: | Various fusion strategies have been explored for integration of large language models into multi-modal systems. |
| Approach: | They propose a framework for deep fusion decoding that integrates large language models into cross-modal text recognition systems. |
| Outcome: | The proposed framework surpasses cascaded methods in English and Mandarin, and significantly reduces WERs by 17.7%. |
Gated Transformer for Robust De-noised Sequence-to-Sequence Modelling (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Noisy texts are common in user-generated texts that appear abundant in social media platforms like SMS, online chat, email, blogs, wikis etc. |
| Approach: | They propose a sequence-to-sequence architecture that uses a gating mechanism to detect types of corrections required from English texts. |
| Outcome: | The proposed architecture performs better than non-gated models on machine translation and Summarization tasks. |
Applying the Transformer to Character-level Transduction (2021.eacl-main)
Copied to clipboard
| Challenge: | morphological inflection generation and historical text normalization tasks are character-level tasks that outperform recurrent models. |
| Approach: | They propose a technique to handle feature-guided character-level transduction that further improves performance. |
| Outcome: | The transformer outperforms recurrent models on morphological inflection and historical text normalization tasks. |
Efficient OCR for Building a Diverse Digital History (2024.acl-long)
Copied to clipboard
| Challenge: | Current optical character recognition (OCR) systems are poorly extensible to low-resource document collections, as learning a language-vision model requires extensive labeled sequences and compute. |
| Approach: | They propose to model optical character recognition as a character level image retrieval problem using a contrastively trained vision encoder. |
| Outcome: | The proposed model is more sample efficient and extensible than existing architectures, enabling accurate OCR in settings where existing solutions fail. |