| Challenge: | Existing methods to predict creation time of documents are based on time-stamp metadata, but none are available. |
| Approach: | They propose an attention-based neural document dating system which utilizes both context and temporal information in documents in a flexible and principled manner. |
| Outcome: | The proposed system outperforms neural and non-neural baselines on multiple real-world datasets. |
Similar Papers
Dating Documents using Graph Convolution Networks (P18-1)
Copied to clipboard
| Challenge: | Existing approaches for document dating assume accurate knowledge of document date, but this is not always available for arbitrary documents from the Web. |
| Approach: | They propose a Graph Convolutional Network (GCN) based document dating approach which exploits syntactic and temporal graph structures of document in a principled way. |
| Outcome: | The proposed approach outperforms state-of-the-art models on real-world datasets by 19% absolute accuracy points. |
Dynamic Global Memory for Document-level Argument Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work on document-level event argument extraction is restricted by sequence length constraints and ignores global context between events. |
| Approach: | They propose to construct a document memory store to extract contextual event information and leverage it to implicitly and explicitly help with decoding of arguments for later events. |
| Outcome: | The proposed framework outperforms prior methods and is more robust to adversarially annotated examples with constrained decoding design. |
Neural Temporality Adaptation for Document Classification: Diachronic Word Embeddings and Domain Adaptation Models (P19-1)
Copied to clipboard
| Challenge: | Recent studies show that document classifiers can become more stable over time when trained in ways that account for temporal variations. |
| Approach: | They propose a method for embedding diachronic word embedds into document classification models . they propose 'time-driven neural classification model' that accounts for temporal variations . |
| Outcome: | The proposed model can be trained on six corpora and make it more robust over time. |
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved. |
| Approach: | They propose to use different types of model architectures to improve extractive summarization systems. |
| Outcome: | The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis. |
Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing document-level neural machine translation systems concatenate several consecutive sentences to form a pseudo-document, and then learn inter-sentential dependencies. |
| Approach: | They propose a document flattening technique that integrates Flat-Batch Attention (FBA) and Neural Context Gate (NCG) into Transformer model to utilize information beyond the pseudo-document boundaries. |
| Outcome: | The proposed method outperforms baselines on BLEU, COMET and accuracy on the contrastive test set. |
Focused Attention Improves Document-Grounded Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Document grounded generation is the task of using the information provided in a document to improve text generation. |
| Approach: | They propose two new document grounded generation tasks that use information provided in a document to improve text generation. |
| Outcome: | The proposed models outperform existing methods on automated and human evaluation for closeness to reference and relevance to the document. |
Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction (P18-2)
Copied to clipboard
| Challenge: | Recent supervised deep learning models have achieved state-of-the-art performance, but there are two other considerations that are important. |
| Approach: | They propose a supervised aspect extraction model using general-purpose embeddings and domain-specific embeddables. |
| Outcome: | The proposed model outperforms state-of-the-art methods without supervision and achieves very good results. |
An Improved Neural Baseline for Temporal Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing datasets are small and/or have low inter-annotator agreements. |
| Approach: | They propose a new neural system that achieves 10% absolute accuracy improvement over the previous best system. |
| Outcome: | The proposed system achieves 10% absolute improvement over the previous best system on two benchmark datasets. |
When and Where Did it Happen? An Encoder-Decoder Model to Identify Scenario Context (2024.findings-emnlp)
Copied to clipboard
Enrique Noriega-Atala, Robert Vacareanu, Salena Ashton, Adarsh Pyarelal, Clayton Morrison, Mihai Surdeanu
| Challenge: | a relatively small fine-tuned encoder-decoder model performs better than out-of-the-box LLMs and semantic role labeling parsers to accurately predict the relevant scenario information. |
| Approach: | They propose a neural architecture finetuned for the task of scenario context generation . they use a curated dataset of time and location annotations to train an encoder-decoder architecture . |
| Outcome: | The proposed model performs better than out-of-the-box LLMs and semantic role labeling parsers to accurately predict the relevant scenario information of a particular entity or event. |
Deep Attentive Sentence Ordering Network (D18-1)
Copied to clipboard
| Challenge: | Existing methods for sentence ordering tasks rely on linguistic knowledge and are domain specific. |
| Approach: | They propose a deep attentive sentence ordering network which integrates self-attention mechanism with LSTMs in the encoding of input sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art models on Sentence Ordering and Order Discrimination tasks and is shown to be highly efficient. |