EfficientOCR: An Extensible, Open-Source Package for Efficiently Digitizing World Knowledge (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Existing OCR engines fail to provide accurate, cost-effective and sample-efficient character recognition for public domain documents. |
| Approach: | EffOCR is an open-source optical character recognition package that is accurate, cheap to deploy and sample efficient to customize to novel collections, languages, and character sets. |
| Outcome: | EffOCR model trains character retrieval problem and scales to novel collections, languages, and character sets. |
Similar Papers
Efficient OCR for Building a Diverse Digital History (2024.acl-long)
Copied to clipboard
| Challenge: | Current optical character recognition (OCR) systems are poorly extensible to low-resource document collections, as learning a language-vision model requires extensive labeled sequences and compute. |
| Approach: | They propose to model optical character recognition as a character level image retrieval problem using a contrastively trained vision encoder. |
| Outcome: | The proposed model is more sample efficient and extensible than existing architectures, enabling accurate OCR in settings where existing solutions fail. |
TexOCR: Advancing Document OCR Models for Compilable Page-to-LaTeX Reconstruction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing document OCR largely targets plain text or Markdown, discarding structural and executable properties that make LaTeX essential for scientific publishing. |
| Approach: | They propose a benchmark and a training corpus for document reconstruction . they train a 2B-parameter model using supervised fine-tuning and reinforcement learning . |
| Outcome: | The proposed model improves on existing models using supervised fine-tuning and reinforcement learning with verifiable rewards. |
Low-resource Post Processing of Noisy OCR Output for Historical Corpus Digitisation (L18-1)
Copied to clipboard
| Challenge: | 7.6% of the words in the original OCR text contain an error; fully manual correction would take thousands of hours due to the size of the corpus. |
| Approach: | They propose a post-processing system to efficiently correct OCR errors in a 2.7 million word Faroese corpus. |
| Outcome: | The proposed method reduces the word error rate to 1.3% with around 65 hours of human annotator work. |
Scalable Construction and Reasoning of Massive Knowledge Bases (N18-6)
Copied to clipboard
| Challenge: | Existing knowledge mining systems assume abundant human annotations for training high quality machine learning models, which is impractical when trying to deploy IE systems to a broad range of domains, settings and languages. |
| Approach: | They introduce how to extract structured facts from text corpora to construct knowledge bases. |
| Outcome: | The proposed methods are weakly-supervised and domain-independent for knowledge base construction across various domains. |
Making Large Language Models Efficient Dense Retrievers (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that fine-tuning large language models for dense retrieval yields strong performance, but their substantial parameter counts make them computationally inefficient. |
| Approach: | They propose a framework for developing efficient retrievers that performs coarse-to-fine compression through a coarse-grained coarse-tuning strategy. |
| Outcome: | The proposed framework reduces model size and inference cost while preserving performance of full-size models. |
A Lightweight Approach to a Giga-Corpus of Historical Periodicals: The Story of a Slovenian Historical Newspaper Collection (2024.lrec-main)
Copied to clipboard
| Challenge: | a curated corpus of Slovenian historical newspapers is a complex undertaking requiring multiple steps to prepare . a shoestring budget is required to produce a corpus that is billion-words in size . |
| Approach: | They propose a lightweight approach to producing high-quality corpora using OCR . they use noisy OCR-ed data from the National and University Library of Slovenia . |
| Outcome: | The proposed method produces a billion-word giga-corpus of Slovenian historical newspapers from the 18th, 19th and 20th centuries on a shoestring budget. |
IEPile: Unearthing Large Scale Schema-Conditioned Information Extraction Corpus (2024.acl-short)
Copied to clipboard
| Challenge: | Large Language Models exhibit a significant performance gap in Information Extraction (IE) high-quality instruction data is the vital key for enhancing LLMs' specific capabilities . |
| Approach: | They propose a bilingual (English and Chinese) IE instruction corpus that contains 0.32B tokens. |
| Outcome: | The proposed model improves the performance of LLMs for IE with zero-shot generalization. |
EfficientLLM: Unified Pruning-Aware Pretraining for Auto-Designed Compact Language Models (2026.acl-long)
Copied to clipboard
Xingrun Xing, Zheng Liu, Shitao Xiao, Boyan Gao, Yiming Liang, Haokun Lin, Xianlin Zeng, Guoqi Li, Jiajun Zhang
| Challenge: | Large language models (LLMs) driven by scaling laws can be developed in large model sizes. |
| Approach: | They propose a pruning-aware pretraining approach that decouples LLM pruning from direct pretraining. |
| Outcome: | The proposed model outperforms pretraining models with 100M 1B parameters in commen sense benchmarks. |
OCR Post Correction for Endangered Language Texts (2020.emnlp-main)
Copied to clipboard
| Challenge: | Currently, there is little to no data available to build natural language processing models for endangered languages. |
| Approach: | They propose a benchmark dataset of transcriptions for scanned books in three critically endangered languages and a method to improve OCR in these data-scarce settings. |
| Outcome: | The proposed method reduces the recognition error rate by 34% across the three endangered languages. |
LSOIE: A Large-Scale Dataset for Supervised Open Information Extraction (2021.eacl-main)
Copied to clipboard
| Challenge: | Open Information Extraction (OIE) systems extract factual propositions into n-ary tuples . current datasets are limited in size and diversity . |
| Approach: | They propose to convert QA-SRL 2.0 dataset to large-scale OIE dataset LSOIE. |
| Outcome: | The proposed dataset is 20 times larger than the next largest human-annotated OIE dataset. |