Papers with CORD
Cooperative Denoising for Distantly Supervised Relation Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from noisy labeling problem, which can severely degrade its performance. |
| Approach: | They propose a framework for distantly supervised relation extraction that leverages text corpus and knowledge graph and a cooperative module involving their mutual learning. |
| Outcome: | The proposed method reduces the noisy labels and achieves substantial improvement over the state-of-the-art methods. |
DUBLIN: Visual Document Understanding By Language-Image Network (2023.emnlp-industry)
Copied to clipboard
Kriti Aggarwal, Aditi Khandelwal, Kumar Tanmay, Owais Khan Mohammed, Qiang Liu, Monojit Choudhury, Hardik Chauhan, Subhojit Som, Vishrav Chaudhary, Saurabh Tiwary
| Challenge: | DUBLIN is a pixel-based visual document understanding model that does not rely on OCR. |
| Approach: | They propose a pixel-based visual document understanding model that does not rely on OCR. |
| Outcome: | The proposed model performs on extractive tasks such as DocVQA, InfoVQA and AI2D, and strong performance on abstraction datasets such as VisualMRC and text captioning. |
CORD: Balancing COnsistency and Rank Distillation for Robust Retrieval-Augmented Generation (2025.naacl-short)
Copied to clipboard
| Challenge: | Existing methods to ground large language models fail to adequately attend to all contexts . position bias is hindered by retrieval-augmented generation, which requires constant attention . |
| Approach: | They propose to augment and distill training instances with their perturbed positions to encourage consistent predictions . they also propose to balance COnsistency and Rank Distillation by combining noise-controlled perturbations with augmentation and distillation. |
| Outcome: | The proposed method outperforms existing methods in diverse RAG benchmarks. |
Hypergraph based Understanding for Document Semantic Entity Recognition (2024.acl-long)
Copied to clipboard
| Challenge: | Existing document understanding models focus on entity categories while ignoring the extraction of entity boundaries. |
| Approach: | They propose a hypergraph attention document semantic entity recognition framework which uses hypergraph focus to focus on entity boundaries and entity categories at the same time. |
| Outcome: | The proposed framework can improve the performance of existing models on FUNSD, CORD, XFUND and SROIE. |
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding (2021.acl-long)
Copied to clipboard
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
| Challenge: | Existing pre-training tasks for text and layout are effective in visually-rich document understanding tasks. |
| Approach: | They propose to combine pre-training tasks with a multi-modal model to model interaction between text, layout and image in a single multi-module framework. |
| Outcome: | The proposed model outperforms LayoutLM by a large margin on visual-rich document understanding tasks. |
FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction (2022.acl-long)
Copied to clipboard
Chen-Yu Lee, Chun-Liang Li, Timothy Dozat, Vincent Perot, Guolong Su, Nan Hua, Joshua Ainslie, Renshen Wang, Yasuhisa Fujii, Tomas Pfister
| Challenge: | Form-like document understanding is a surging research topic due to its practical applications . form documents have unique challenges stemming from their structural characteristics . |
| Approach: | They propose a structure-aware sequence model that leverages spatial relationships between tokens in a form for more precise attention score calculation. |
| Outcome: | The proposed model outperforms existing methods with a more compact model size and less pre-training data. |
FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extraction (2023.acl-long)
Copied to clipboard
Chen-Yu Lee, Chun-Liang Li, Hao Zhang, Timothy Dozat, Vincent Perot, Guolong Su, Xiang Zhang, Kihyuk Sohn, Nikolay Glushnev, Renshen Wang, Joshua Ainslie, Shangbang Long, Siyang Qin, Yasuhisa Fujii, Nan Hua, Tomas Pfister
| Challenge: | Existing approaches that extend the mask language modeling to other modalities require careful multi-task tuning, complex reconstruction target designs, or additional pre-training data. |
| Approach: | They propose a centralized multimodal graph contrastive learning strategy to unify self-supervised pre-training for all modalities in one loss. |
| Outcome: | The proposed model achieves state-of-the-art performance on FUNSD, CORD, SROIE and Payment benchmarks with a more compact model size. |
P²Net: Parallel Pointer-based Network for Key Information Extraction with Complex Layouts (2025.findings-acl)
Copied to clipboard
Kaiwen Wei, Jie Yao, Jiang Zhong, Yangyang Kang, Jingyuan Zhang, Changlong Sun, Xin Zhang, Fengmao Lv, Li Jin
| Challenge: | Existing methods for key information extraction are based on a limited set of entity categories and fixed layouts. |
| Approach: | They propose a large-scale, human-annotated dataset for key information extraction . it is based on a human-annotated layout and 1,162 entity categories . they propose 'parallel pointer-based network' that leverages implicit relationships . |
| Outcome: | Experiments on widely-used datasets show that the proposed model outperforms state-of-the-art methods while maintaining fast inference speeds. |
CORD: Bridging the Audio–Text Reasoning Gap via Weighted On-policy Cross-modal Distillation (2026.findings-acl)
Copied to clipboard
Hu Jing, Danxiang Zhu, Xianlong Luo, Dan Zhang, Shuwei He, Yishu Lei, Shikun Feng, Hai-Tao Zheng, Jingzhou HE, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Large Audio Language Models (LALMs) exhibit a degradation in knowledge and reasoning capabilities . empirical results show that CORD significantly bridges the audio–text performance gap . |
| Approach: | They propose a framework that performs online cross-modal self-distillation to bridge the acoustic-semantic gap between LALMs and text-based models. |
| Outcome: | The proposed framework bridges the acoustic-semantic gap between LALMs and text-based models . it employs on-policy reverse KL divergence with importance-aware weighting . |