Low-resource Post Processing of Noisy OCR Output for Historical Corpus Digitisation (L18-1)
Copied to clipboard
| Challenge: | 7.6% of the words in the original OCR text contain an error; fully manual correction would take thousands of hours due to the size of the corpus. |
| Approach: | They propose a post-processing system to efficiently correct OCR errors in a 2.7 million word Faroese corpus. |
| Outcome: | The proposed method reduces the word error rate to 1.3% with around 65 hours of human annotator work. |
Similar Papers
OCR Improves Machine Translation for Low-Resource Languages (2022.findings-acl)
Copied to clipboard
| Challenge: | Despite many recent successes, Machine Translation still lacks support or fails to achieve good performance for most low-resource languages. |
| Approach: | They propose a benchmark to evaluate OCR systems on low-resource languages and low- resource scripts. |
| Outcome: | The proposed benchmark evaluates state-of-the-art OCR systems on low-resource languages and low-rural scripts. |
OCR Post Correction for Endangered Language Texts (2020.emnlp-main)
Copied to clipboard
| Challenge: | Currently, there is little to no data available to build natural language processing models for endangered languages. |
| Approach: | They propose a benchmark dataset of transcriptions for scanned books in three critically endangered languages and a method to improve OCR in these data-scarce settings. |
| Outcome: | The proposed method reduces the recognition error rate by 34% across the three endangered languages. |
A Lightweight Approach to a Giga-Corpus of Historical Periodicals: The Story of a Slovenian Historical Newspaper Collection (2024.lrec-main)
Copied to clipboard
| Challenge: | a curated corpus of Slovenian historical newspapers is a complex undertaking requiring multiple steps to prepare . a shoestring budget is required to produce a corpus that is billion-words in size . |
| Approach: | They propose a lightweight approach to producing high-quality corpora using OCR . they use noisy OCR-ed data from the National and University Library of Slovenia . |
| Outcome: | The proposed method produces a billion-word giga-corpus of Slovenian historical newspapers from the 18th, 19th and 20th centuries on a shoestring budget. |
Cleaning Dirty Books: Post-OCR Processing for Previously Scanned Texts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a large amount of work is required to clean digitized books for NLP analysis because of errors in the scanned text and duplicate volumes in the corpora. |
| Approach: | They propose methods to handle optical character recognition errors in scanned texts . they identify the canonical version for each of 17,136 repeatedly-scanned books . |
| Outcome: | The proposed method corrects over six times as many errors as it introduces, the authors show . the authors evaluate a collection of 19,347 texts from the Gutenberg dataset and 96,635 from the HathiTrust Library . |
Unsupervised Multi-View Post-OCR Error Correction With Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior work used text generation techniques or redundancy in similar passages for OCR error correction, which is not appropriate in cases of low corpus redundancies or weak document contextual information. |
| Approach: | They propose to use a pretrained language model to reconcile different OCR views in unsupervised way so that their combination contains fewer errors than each individual view. |
| Outcome: | The proposed model can reconcile multiple OCR views so that their combined version contains fewer errors than the best OCR view. |
Neural OCR Post-Hoc Correction of Historical Corpora (2021.tacl-1)
Copied to clipboard
| Challenge: | Optical character recognition (OCR) is crucial for a deeper access to historical collections. |
| Approach: | They propose a neural approach based on a combination of recurrent (RNN) and deep convolutional network (ConvNet) to correct OCR transcription errors. |
| Outcome: | The proposed model reduces the word error rate of 32.3% by more than 89% on a historical book corpus in German language. |
EfficientOCR: An Extensible, Open-Source Package for Efficiently Digitizing World Knowledge (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Existing OCR engines fail to provide accurate, cost-effective and sample-efficient character recognition for public domain documents. |
| Approach: | EffOCR is an open-source optical character recognition package that is accurate, cheap to deploy and sample efficient to customize to novel collections, languages, and character sets. |
| Outcome: | EffOCR model trains character retrieval problem and scales to novel collections, languages, and character sets. |
Effective Synthetic Data and Test-Time Adaptation for OCR Correction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has framed the post-OCR task as a Seq2Seq Neural Machine Translation (NMT) task. |
| Approach: | They propose a method for constructing post-OCR synthetic data with different noise levels using weak supervision. |
| Outcome: | The proposed method reduces CER by 68.67% without relying on manual annotations. |
Noisy Parallel Data Alignment (2023.findings-eacl)
Copied to clipboard
| Challenge: | Optical character recognition (OCR) is used to convert endangered language documents into machine-readable data, but its noisy outputs are a challenge for many under-resourced languages. |
| Approach: | They propose to use optical character recognition (OCR) to convert endangered language documents into machine-readable data by using noisy alignment models. |
| Outcome: | The proposed model reduces alignment error rate on a state-of-the-art neural-based alignment model up to 59.6%. |
Cheap Character Noise for OCR-Robust Multilingual Embeddings (2025.findings-acl)
Copied to clipboard
| Challenge: | Optical character recognition (OCR) is a key component of the digitization of historical documents. |
| Approach: | They propose a method that fine-tunes existing multilingual models using noisy texts and a contrastive loss. |
| Outcome: | The proposed model improves on the training data of existing models using noisy texts and a contrastive loss. |