Papers with VIE
LayoutPointer: A Spatial-Context Adaptive Pointer Network for Visual Information Extraction (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models inadequately utilize spatial information of entities, causing incorrectly linking spatially distant entities. |
| Approach: | They propose a Spatial-Context Adaptive Pointer Network to restore semantic order among entities . they propose XFUND-based tail-to-head pointer to restore the semantic order . |
| Outcome: | The proposed method outperforms existing state-of-the-art methods in F1 scores for RE tasks. |
PPTSER: A Plug-and-Play Tag-guided Method for Few-shot Semantic Entity Recognition on Visually-rich Documents (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visually-rich document information extraction are limited . Xu et al., 2020: visually rich document information is a vital aspect of document understanding . |
| Approach: | They propose a plug-and-play Tag-guided method for few-shot Semantic Entity Recognition (PPTSER) on visually-rich documents. |
| Outcome: | The proposed method outperforms fine-tuning and few-shot methods on visual-rich documents. |
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models for visual information extraction suffer from limitations in scale and realism . ReceiptBench is a large-scale, human-annotated benchmark for receipts . |
| Approach: | They propose a large-scale, human-annotated benchmark for visual information extraction . the method organizes information extraction into four hierarchical sub-tasks . |
| Outcome: | The proposed method surpasses proprietary models on complex reasoning tasks. |