NUT-RC: Noisy User-generated Text-oriented Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing RC models focus on extractive or generative, but ignore integration of them. |
| Approach: | They propose a noisy user-generated text-oriented RC model that integrates extractive and generative RC models by a multi-task learning mechanism and an answer selection module. |
| Outcome: | The proposed model outperforms state-of-the-art models on Twitter. |
Similar Papers
Active Reading Comprehension: A Dataset for Learning the Question-Answer Relationship Strategy (P19-2)
Copied to clipboard
| Challenge: | Literature in quality learning suggests that task performance should also be evaluated on the undergone process to answer. |
| Approach: | They propose to use the Question-Answer Relationship (QAR) to evaluate a reader's ability to select different sources of information depending on the question type. |
| Outcome: | The proposed model will be used to evaluate reading comprehension with weak supervision. |
Cut to the Chase: A Context Zoom-in Network for Reading Comprehension (D18-1)
Copied to clipboard
| Challenge: | Recent deep-learning based models suffer from reasoning over long documents and do not trivially generalize to cases where the answer is not present as a span. |
| Approach: | They propose a novel context zoom-in network (ConZNet) that can skip through irrelevant parts of a document and generate an answer using only the relevant regions of text. |
| Outcome: | The proposed architecture outperforms state-of-the-art results by 12.62% (ROUGE-L) relative improvement on the recently proposed and challenging RC dataset ‘NarrativeQA’. |
Multi-hop Reading Comprehension through Question Decomposition and Rescoring (P19-1)
Copied to clipboard
| Challenge: | Existing systems for multi-hop reading comprehension decompose compositional questions into simpler sub-questions . authors propose a system that learns to break compositional multi- hop questions into simple singlehop sub-question . |
| Approach: | They propose a system that decomposes a compositional question into simpler sub-questions . they propose recast subquestion generation as a span prediction problem . |
| Outcome: | The proposed system generates as effective as human-authored sub-questions using 400 examples . it also provides explainable evidence for its decision making in the form of sub-questions . |
MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension (P19-1)
Copied to clipboard
| Challenge: | A large number of reading comprehension (RC) datasets have been created, but little research has been done on whether they generalize to one another and the extent to which existing datasets can be leveraged for improving performance on new ones. |
| Approach: | They propose a BERT-based reading comprehension model that can be trained on multiple RC datasets. |
| Outcome: | The proposed model can be trained on multiple RC datasets and improve performance on five RC data. |
Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to multi-hop Reading Comprehension (RC) have greatly improved its explainability, models ability to explain their own answers. |
| Approach: | They propose to generate a question-focused abstractive summary of input paragraphs and feed it to an RC system. |
| Outcome: | The proposed explanation generates more compact explanations than an extractive explainer with limited supervision while maintaining sufficiency. |
R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have revealed that reading comprehension (RC) systems learn to exploit annotation artifacts and other biases in current datasets. |
| Approach: | They propose a task that requires giving answers and derivations to evaluate RC systems' internal reasoning. |
| Outcome: | The proposed framework annotates 4.6k questions with 3 reference derivations and shows that it is reliable and compares with existing benchmarks. |
Generalizing Question Answering System with Pre-trained Language Model Fine-tuning (D19-58)
Copied to clipboard
| Challenge: | Existing methods focus on improving in-domain performance, leaving open the question of how they can generalize to out-of-domain and unseen RC tasks. |
| Approach: | They propose a multi-task learning framework that learns the shared representation across different tasks and builds on a large pre-trained language model and fine-tuned on multiple RC datasets. |
| Outcome: | The proposed framework improves the BERT-Large baseline by 8.39 and 7.22 respectively. |
Synthetic Data for English Lexical Normalization: How Close Can We Get to Manually Annotated Data? (2020.lrec-1)
Copied to clipboard
| Challenge: | Social media data is a valuable data resource for natural language processing tasks. |
| Approach: | They propose to adapt input text to a more standard form, a task also referred to as normalization. |
| Outcome: | The proposed system scores 94.29 accuracy on the test data compared to 95.22 when trained on human-annotated data. |
Bootstrapping Generators from Noisy Data (N18-1)
Copied to clipboard
| Challenge: | Existing methods for data-to-text generation focus on learning correspondences between structured data and associated texts. |
| Approach: | They aim to bootstrap generators from large scale datasets where data and related texts are loosely aligned. |
| Outcome: | The proposed model improves on a vanilla encoder-decoder which relies on soft attention. |
From Chaos to Clarity: Claim Normalization to Empower Fact-Checking (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Social media posts are noisy and pervasive, resulting in difficult to identify precise and prominent claims that require verification. |
| Approach: | They propose a task called Claim Normalization that decomposes complex and noisy social media posts into more straightforward and understandable forms, termed normalized claims. |
| Outcome: | The proposed model outperforms baselines across evaluation measures and errors. |