Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to extract entities from visually-rich documents ignore the inherent multimodality of VRDs and thus the suboptimal results are achieved. |
| Approach: | They propose a multimodal semantic enhancement method that filters redundant information in the current document and a cross-document information awareness technique to enrich the entity-related context. |
| Outcome: | The proposed method outperforms existing methods on two documents understanding benchmarks covering eight languages. |
Similar Papers
Entity-centered Cross-document Relation Extraction (2022.emnlp-main)
Copied to clipboard
Fengqi Wang, Fei Li, Hao Fei, Jingye Li, Shengqiong Wu, Fangfang Su, Wenxuan Shi, Donghong Ji, Bo Cai
| Challenge: | Existing methods for relation extraction only use text snippets surrounding target entities in multiple documents. |
| Approach: | They propose a relation-extraction model that uses cross-path entity relation attention to detect the semantic relations between entities in a given text. |
| Outcome: | The proposed method outperforms the state-of-the-art methods in the dataset CodRED by 10%. |
Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision Transformer (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing work has focused on what is captured by multi-modal architectures. |
| Approach: | They propose a multi-modal transformer that learns syntactic and semantic representations about entities and relations grounded in objects at the level of masked self-attention and cross-modal attention. |
| Outcome: | The proposed model learns syntactic and semantic representations about objects and relations cross-modally and unimodally. |
Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on relation extraction ignore non-bridge entities, leading to bias during inference. |
| Approach: | They propose a graph-based cross-document Relation Extraction model with non-bridge entity enhancement and prediction debiasing that integrates non-cross entities with target entities and bridge entities. |
| Outcome: | The proposed model outperforms baseline models on open and closed datasets. |
Vision-Enhanced Semantic Entity Recognition in Document Images via Visually-Asymmetric Consistency Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models train a visual encoder with weak cross-modal supervision signals, resulting in a limited capacity to capture non-textual features and suboptimal performance. |
| Approach: | They propose a Visually-Asymmetric coNsistenCy Learning approach that enhances the model’s ability to capture fine-grained visual and layout features through the incorporation of color priors. |
| Outcome: | The proposed approach outperforms the strong LayoutLM series baseline on benchmark datasets and provides insights for optimizing model performance. |
CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing relation extraction methods focus on extracting relational facts between entity pairs within single sentences or documents. |
| Approach: | They present a problem of cross-document relation extraction (CRE) using human annotations. |
| Outcome: | The proposed dataset is the first human-annotated cross-document RE dataset . it shows that it is challenging to existing RE methods including strong BERT-based models. |
Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Among recent NLP research, multi-document processing is gaining increasing attention due to the need to handle and process an increasing amount of textual data and available documents online. |
| Approach: | They propose to pre-train a generic multi-document model from a cross-document question answering pre-training objective by generating salient sentences from one document and challenging it to recover the sentence from which it was generated. |
| Outcome: | The proposed model outperforms zero-shot GPT-3.5 and GPT-4 in multiple document tasks and generates the correct answer and the salient sentence from a salient document. |
Boosting Entity Linking Performance by Leveraging Unlabeled Documents (P19-1)
Copied to clipboard
| Challenge: | a new approach to entity linking relies on unlabeled documents and Wikipedia . a supervised approach uses only natural information, such as unlabed documents . |
| Approach: | They propose a method which exploits only naturally occurring information . they construct a high recall list of candidate entities for each mention in an unlabeled document . |
| Outcome: | The proposed model outperforms fully-supervised state-of-the-art systems on standard test sets. |
CDLM: Cross-Document Language Modeling (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing language models (LMs) provide powerful representations for internal text structure, but there are important applications for multi-text tasks. |
| Approach: | They propose a pretraining approach that incorporates two key ideas into the masked language modeling objective. |
| Outcome: | The proposed model improves over existing models and sets of long-range transformers and can be easily applied to multiple multi-text tasks. |
Skim-Attention: Learning to Focus via Document Layout (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to document understanding have high computational and memory costs. |
| Approach: | They propose a new attention mechanism that takes advantage of the structure of a document and its layout. |
| Outcome: | The proposed attention mechanism obtains lower perplexity than previous studies while being more computationally efficient. |
Translation as Cross-Domain Knowledge: Attention Augmentation for Unsupervised Cross-Domain Segmenting and Labeling Tasks (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Chinese has no word delimiter or inflection that can indicate segment boundaries or word semantics, increasing the difficulty of segmenting and labeling tasks. |
| Approach: | They propose a paradigm based on attention augmentation to introduce crucial cross-domain knowledge via a translation system into Chinese model. |
| Outcome: | The proposed model significantly advances the state-of-the-art results of Chinese cross-domain segmenting and labeling tasks. |