Challenge: Question Answering (QA) is a field of increasing demand due to the availability of information online.
Approach: They propose an unsupervised approach to training QA models with generated pseudo-training data by applying a simple template on a related sentence rather than the original context sentence.
Outcome: The proposed approach improves the performance of a QA model on generated pseudo-training data.

Similar Papers

Improving Unsupervised Question Answering via Summarization-Informed Question Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Question Generation (QG) is the production of meaningful questions given a set of input passages and corresponding answers.
Approach: They propose a method which uses questions generated heuristically from news summaries as a source of training data for a QG system.
Outcome: The proposed method outperforms previous unsupervised models on three in-domain datasets and three out-of-domain ones.
Handling Anomalies of Synthetic Questions in Unsupervised Question Answering (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to improve unsupervised Question Answering (UQA) are expensive and require additional datasets.
Approach: They propose an unsupervised QA approach that generates QA training data automatically.
Outcome: The proposed method improves unsupervised QA significantly across a number of QA tasks.
Unsupervised Question Answering by Cloze Translation (P19-1)

Copied to clipboard

Challenge: Existing QA datasets only available for limited domains and languages.
Approach: They propose to generate context, question and answer triples in an unsupervised manner and synthesize extractive QA training data automatically.
Outcome: The proposed approach outperforms existing QA models on a common EQA benchmark dataset.
Harvesting and Refining Question-Answer Pairs for Unsupervised QA (2020.acl-main)

Copied to clipboard

Challenge: Recent research attempts to extend unsupervised question answering to settings with few or no labeled data available.
Approach: They propose two approaches to improve unsupervised question answering . first, they harvest lexically and syntactically divergent Wikipedia questions to automatically construct a corpus of question-answer pairs . second, they take advantage of the QA model to extract more appropriate answers .
Outcome: The proposed approach outperforms previous unsupervised approaches by a large margin and is competitive with early supervised models.
Question Answering Infused Pre-training of General-Purpose Contextualized Representations (2022.findings-acl)

Copied to clipboard

Challenge: Existing pretraining objectives for question answering (QA) are not optimized for being immediately useful without fine-tuning.
Approach: They propose a pre-training objective based on question answering (QA) that is based more directly on context.
Outcome: The proposed model matches predictions of a more accurate cross-encoder model on 80 million synthesized QA pairs and achieves large improvements over previous state-of-the-art models on paraphrase detection and fewshot named entity recognition.
Regularization of Distinct Strategies for Unsupervised Question Generation (2020.findings-emnlp)

Copied to clipboard

Challenge: Unsupervised question answering (UQA) is a task of answering questions from a context that contains the answer.
Approach: They propose a method to generate higher-quality questions with a teacher-student architecture and a regularization module to avoid bias toward a particular question generation strategy.
Outcome: The proposed method generates higher-quality questions across diverse datasets and tasks and can be used to create a model with few-shot learning.
Leveraging QA Datasets to Improve Generative Data Augmentation (2022.emnlp-main)

Copied to clipboard

Challenge: Recent advances in NLP have substantially improved the capability of pretrained language models to generate high-quality text.
Approach: They propose to reformulate data generation as context generation for a given question-answer (QA) pair and leverage QA datasets for training context generators.
Outcome: The proposed approach improves performance for few-shot and zero-shot classification datasets on multiple classification dataset.
Unsupervised Adaptation of Question Answering Systems via Generative Self-training (2020.emnlp-main)

Copied to clipboard

Challenge: Supervised self-training methods have transformed applied machine learning . however, adapting to target data has received little attention .
Approach: They propose a method to generate synthetic QA pairs for unsupervised self adaptation . they use massive amounts of data to simulate self-supervised tasks .
Outcome: The proposed method improves QA systems significantly by using less data and training computation than existing augmentation approaches.
Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering (2023.acl-long)

Copied to clipboard

Challenge: Among recent NLP research, multi-document processing is gaining increasing attention due to the need to handle and process an increasing amount of textual data and available documents online.
Approach: They propose to pre-train a generic multi-document model from a cross-document question answering pre-training objective by generating salient sentences from one document and challenging it to recover the sentence from which it was generated.
Outcome: The proposed model outperforms zero-shot GPT-3.5 and GPT-4 in multiple document tasks and generates the correct answer and the salient sentence from a salient document.
Learning to Generate Questions by Learning to Recover Answer-containing Sentences (2021.findings-acl)

Copied to clipboard

Challenge: Recent research has focused on synthetically generating a question from a given context and an annotated answer by training an additional generative model.
Approach: They propose a method that learns to generate contextually rich questions by recovering answer-containing sentences.
Outcome: The proposed approach improves the quality and accuracy of existing models and achieves comparable results to the state-of-the-art on MS MARCO and NewsQA.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations