Papers with NewsQA
Keep Learning: Self-supervised Meta-learning for Learning from Inference (2021.eacl-main)
Copied to clipboard
| Challenge: | A common approach to improve performance of machine learning algorithms involves self-supervised learning on large unlabeled data before fine-tuning on downstream tasks. |
| Approach: | They propose to use model's own class-balanced predictions to back-propagate the loss from the model''s class-balancing predictions (pseudo-labels) this method improves performance of standard backbones such as BERT, Electra, and ResNet-50 on a wide variety of tasks, including question answering on SQuAD and NewsQA . |
| Outcome: | The proposed method outperforms previous approaches on a wide variety of tasks including question answering on SQuAD and NewsQA, benchmark task SuperGLUE, conversation response selection on Ubuntu Dialog corpus v2.0, and image classification on MNIST and ImageNet. |
Beyond Reptile: Meta-Learned Dot-Product Maximization between Gradients for Improved Single-Task Regularization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to improve generalization of neural models use a small component of the gradient for maximizing dot-product between batches. |
| Approach: | They propose to use a finite differences first-order algorithm to calculate a gradient from dot-product of gradients and regularize it. |
| Outcome: | The proposed method outperforms previous approaches of Reptile and MAML when used as a regularization technique. |
Undersensitivity in Neural Reading Comprehension (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models generalise well to in-distribution test sets, yet perform poorly on adversarially selected data. |
| Approach: | They propose an adversarial attack which searches among semantic variations of the question for which a model erroneously predicts the same answer, and with even higher probability. |
| Outcome: | The proposed attack reduces the vulnerability of models trained on SQuAD2.0 and NewsQA, and outperforms a conventional model by as much as 10.9% F1. |
Learning to Generate Questions by Learning to Recover Answer-containing Sentences (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent research has focused on synthetically generating a question from a given context and an annotated answer by training an additional generative model. |
| Approach: | They propose a method that learns to generate contextually rich questions by recovering answer-containing sentences. |
| Outcome: | The proposed approach improves the quality and accuracy of existing models and achieves comparable results to the state-of-the-art on MS MARCO and NewsQA. |
Unsupervised Question Answering via Answer Diversifying (2022.coling-1)
Copied to clipboard
| Challenge: | Existing extractive question answering methods use labeled data to train QA models. |
| Approach: | They propose an unsupervised method by diversifying answers by using data construction, data augmentation and denoising filter. |
| Outcome: | The proposed method outperforms previous models on five benchmark datasets . it shows strong performance in the few-shot learning setting . |
Efficient and Robust Question Answering from Minimal Context over Documents (P18-1)
Copied to clipboard
| Challenge: | Recent work shows that neural QA models are sensitive to adversarial inputs. |
| Approach: | They propose a sentence selector to select the minimal set of sentences to feed into a QA model. |
| Outcome: | The proposed system reduces training time and inference time by up to 13 times . it is comparable to or better than the state-of-the-art on SQuAD, NewsQA, TriviaQA and SQu AD-Open . |
Document Modeling with External Attention for Sentence Extraction (P18-1)
Copied to clipboard
Shashi Narayan, Ronald Cardenas, Nikos Papasarantopoulos, Shay B. Cohen, Mirella Lapata, Jiangsheng Yu, Yi Chang
| Challenge: | Document modeling is essential to a variety of natural language understanding tasks. |
| Approach: | They propose to use external information to improve document modeling for sentence extraction problems. |
| Outcome: | The proposed model outperforms baseline models on document summarization and answer selection tasks and achieves state-of-the-art results on WikiQA and NewsQA. |
Interactive Machine Comprehension with Information Seeking Agents (2020.acl-main)
Copied to clipboard
| Challenge: | Existing machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA). |
| Approach: | They propose a method that reframes existing machine reading comprehension (MRC) datasets as interactive, partially observable environments. |
| Outcome: | The proposed method "occludes" the majority of a document’s text and adds context-sensitive commands that reveal "glimpses" of the hidden text to a model. |
Robust Machine Reading Comprehension by Learning Soft labels (2020.coling-main)
Copied to clipboard
| Challenge: | Neural models have achieved great success on the task of machine reading comprehension, which are typically trained on hard labels. |
| Approach: | They propose a robust training method for machine reading comprehension models to address label sparseness problem by using three strategies to train models on soft labels. |
| Outcome: | The proposed method improves the baseline model performance and achieves state-of-the-art performance on NewsQA and QUOREF. |
Improving Unsupervised Question Answering via Summarization-Informed Question Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Question Generation (QG) is the production of meaningful questions given a set of input passages and corresponding answers. |
| Approach: | They propose a method which uses questions generated heuristically from news summaries as a source of training data for a QG system. |
| Outcome: | The proposed method outperforms previous unsupervised models on three in-domain datasets and three out-of-domain ones. |
Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model (2023.acl-long)
Copied to clipboard
| Challenge: | Existing research on QG focuses on generating single-turn questions, which are formalized as independent interactions. |
| Approach: | They propose a multi-stage knowledge transfer framework to leverage knowledge from single-turn question generation instances. |
| Outcome: | The proposed framework achieves 14.81 BLEU-4 (88.2% absolute improvement compared to T5) in CoQA with knowledge transferred from three single-turn datasets. |
Machine Reading Comprehension using Case-based Reasoning (2023.findings-emnlp)
Copied to clipboard
Dung Thai, Dhruv Agarwal, Mudit Chaudhary, Wenlong Zhao, Rajarshi Das, Jay-Yoon Lee, Hannaneh Hajishirzi, Manzil Zaheer, Andrew McCallum
| Challenge: | Current state-of-the-art machine readers do not support case-based reasoning . |
| Approach: | They propose a method that extracts a set of similar cases from a nonparametric memory and then predicts an answer by selecting the span in the test context that is most similar to the contextualized representations of answers. |
| Outcome: | The proposed method outperforms baselines on NaturalQuestions and NewsQA by 11.5 and 8.4 EM. |
Harvesting and Refining Question-Answer Pairs for Unsupervised QA (2020.acl-main)
Copied to clipboard
| Challenge: | Recent research attempts to extend unsupervised question answering to settings with few or no labeled data available. |
| Approach: | They propose two approaches to improve unsupervised question answering . first, they harvest lexically and syntactically divergent Wikipedia questions to automatically construct a corpus of question-answer pairs . second, they take advantage of the QA model to extract more appropriate answers . |
| Outcome: | The proposed approach outperforms previous unsupervised approaches by a large margin and is competitive with early supervised models. |