Challenge: Existing supervised fine-tuning methods struggle to generalize across document types, leading to poor performance.
Approach: They propose layoutRL, a reinforcement learning framework that optimizes layout understanding through composite rewards integrating normalized edit distance, paragraph count accuracy, and reading order preservation.
Outcome: The proposed model outperforms specialized document parsing systems and general-purpose vision-language models on a broad range of document types, languages, and structural complexities.

Similar Papers

Intelligent Document Parsing: Towards End-to-end Document Parsing via Decoupled Content Parsing and Layout Grounding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods fragment document parsing into pipeline of separated subtasks, resulting in incomplete semantics and error propagation.
Approach: They propose an end-to-end document parsing framework that leverages vision-language priors of MLLMs.
Outcome: The proposed method surpasses existing methods significantly in document parsing . it leverages the vision-language priors of MLLMs to decouple parse and layout grounding based on visual information.
DocFusion: A Unified Framework for Document Parsing Tasks (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for document parsing often employ multiple models, limiting performance . Existing models often employ discrete tokens, whereas recognition relies on continuous coordinates .
Approach: They propose a Gaussian-Kernel Cross-Entropy Loss (GK-CEL) that unifies detection and recognition by enabling generative frameworks to handle both tasks simultaneously.
Outcome: The proposed model performs competitively across four core document parsing tasks.
DocHieNet: A Large and Diverse Dataset for Document Hierarchy Parsing (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for document hierarchy parsing are limited due to the small scale and inconsistency of datasets.
Approach: They propose a document hierarchy parsing dataset to compensate for the data scarcity problem and propose 'dHP' framework to grasp fine-grained text content and coarse-grounded pattern at layout element level.
Outcome: The proposed framework grasps both fine-grained text content and coarse-grounded pattern at layout element level, enhancing the capacity of pre-trained text-layout models in handling multi-page and multi-level challenges.
LayoutLLM: Large Language Model Instruction Tuning for Visually Rich Document Understanding (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to enhance document comprehension require fine-tuning for each task and dataset, and are expensive to train and operate.
Approach: They propose a more flexible document analysis method that integrates visual-rich document understanding with large-scale language models (LLMs) by leveraging existing research in document image understanding and LLMs’ superior language understanding capabilities, the proposed model performs an understanding of document images in a single model.
Outcome: The proposed model improves on the baseline model in document image understanding tasks.
TexOCR: Advancing Document OCR Models for Compilable Page-to-LaTeX Reconstruction (2026.acl-long)

Copied to clipboard

Challenge: Existing document OCR largely targets plain text or Markdown, discarding structural and executable properties that make LaTeX essential for scientific publishing.
Approach: They propose a benchmark and a training corpus for document reconstruction . they train a 2B-parameter model using supervised fine-tuning and reinforcement learning .
Outcome: The proposed model improves on existing models using supervised fine-tuning and reinforcement learning with verifiable rewards.
Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: a new open-source layout-aware IE test suite is available for download at https://github.com/gayecolakoglu/layIE-LLM.
Approach: They propose an open-source layout-aware IE test suite that provides a layout-based IE pipeline.
Outcome: The proposed method achieves 13.3–37.5 F1 points more than a baseline configuration using the same LLM.
DocBank: A Benchmark Dataset for Document Layout Analysis (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches for document layout analysis are based on rule-based or machine learning methods that ignore textual information.
Approach: They present a benchmark document layout analysis dataset using a computer vision model . they build strong baselines and manually split train/dev/test sets for evaluation .
Outcome: The proposed model trains on DocBank accurately recognize layout information for a variety of documents.
How Helpful is Inverse Reinforcement Learning for Table-to-Text Generation? (2021.acl-short)

Copied to clipboard

Challenge: Existing approaches to Table-to-Text generation suffer from issues such as missing information, repetition and repetition.
Approach: They propose to use Inverse Reinforcement Learning (IRL) to solve the Table-to-Text task . they use multiple interpretable unsupervised reward components that are combined linearly to form a composite reward function.
Outcome: The proposed task outperforms strong RL baselines marginally in the Table-to-Text task.
Beyond Layout Embedding: Layout Attention with Gaussian Biases for Structured Document Understanding (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for encoding layout information rely on millions of learnable parameters . polar coordinates provide superior choice for layout modeling, study finds .
Approach: They propose to model layout attention with Gaussian biases by feeding polar coordinates into 2-D Gausssian kernels.
Outcome: The proposed model improves on three widely used benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations