Answer Generation for Retrieval-based Question Answering Systems (2021.findings-acl)
Copied to clipboard
| Challenge: | Question Answering systems are a core component of many commercial applications . answer sentence selection (AS2) models are trained to select the best answer sentence . |
| Approach: | They propose to train a sequence to sequence transformer model to generate an answer from a set of candidates. |
| Outcome: | The proposed model improves accuracy by 32 points over the state-of-the-art model on English AS2 datasets. |
Similar Papers
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for answer sentence selection (AS2) are not yet available for AS2 . |
| Approach: | They propose to incorporate paragraph-level semantics within and across documents to improve transformers for AS2 . they propose to use a dataset to predict whether two sentences are extracted from the same paragraph . |
| Outcome: | The proposed model outperforms baseline models on public and industrial datasets on three public and one industrial dataset. |
Double Retrieval and Ranking for Accurate Question Answering (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent work shows that answer verification models can improve the state of the art in Question Answering . despite the fact that the supporting candidates are ranked only according to the relevancy with the question, the model still lacks the support needed for other answer candidates. |
| Approach: | They propose a double reranking model that selects the best support for each target answer . they propose 'second neural retrieval stage' to encode question and answer pair as query . |
| Outcome: | The proposed approach improves the state of the art in Question Answering . the proposed model ranked candidates according to relevancy and not the answer . but the proposed approach fails to provide the best support . |
Context-Aware Transformer Pre-Training for Answer Sentence Selection (2023.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to perform Answer Sentence Selection (AS2) using only the candidate sentence are sub-optimal. |
| Approach: | They propose to use pre-trained transformers to perform contextual AS2 fine-tuning . they propose to apply pre-training objectives to local contextual AS2. |
| Outcome: | The proposed methods improve baseline AS2 accuracy by up to 8% on some datasets. |
Knowledge Transfer from Answer Ranking to Answer Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that Question Answering (QA) based on Answer Sentence Selection (AS2) can be improved by generating an improved answer from the top-k ranked answer sentences. |
| Approach: | They propose to train a GenQA model by transferring knowledge from a trained AS2 model . they use top ranked candidate as the generation target and next k top rated candidates as context . |
| Outcome: | The proposed model outperforms existing models on public and industrial datasets. |
Answer-focused and Position-aware Neural Question Generation (D18-1)
Copied to clipboard
| Challenge: | Recent neural network-based approaches generate interrogative words that do not match the answer type. |
| Approach: | They propose an answer-focused and position-aware neural question generation model to address these issues. |
| Outcome: | The proposed model outperforms the baseline and outperformed the state-of-the-art system. |
Learning to Generate Questions by Learning to Recover Answer-containing Sentences (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent research has focused on synthetically generating a question from a given context and an annotated answer by training an additional generative model. |
| Approach: | They propose a method that learns to generate contextually rich questions by recovering answer-containing sentences. |
| Outcome: | The proposed approach improves the quality and accuracy of existing models and achieves comparable results to the state-of-the-art on MS MARCO and NewsQA. |
A Study on Efficiency, Accuracy and Document Structure for Answer Sentence Selection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to QA re-rank sentences use huge neural models or complex attentive architectures. |
| Approach: | They propose to exploit the intrinsic structure of the original rank with an effective word-relatedness encoder to achieve the highest accuracy among the cost-efficient models. |
| Outcome: | The proposed model takes 9.5 seconds to train on the WikiQA dataset, compared with 18 minutes required by a standard BERT-base fine-tuning. |
ReQA: An Evaluation for End-to-End Answer Retrieval Models (D19-58)
Copied to clipboard
| Challenge: | Popular QA benchmarks like SQuAD have driven progress on identifying answer spans within a specific passage . retrieving relevant answers from a huge corpus of documents is still a challenging problem . |
| Approach: | They propose a benchmark for evaluating large-scale sentence-level answer retrieval models . they establish baselines using both neural encoding models and classical retrieval techniques . |
| Outcome: | The proposed model outperforms human models on identifying answer spans within a specific passage . the proposed model is scalable and can bypass the typical document retrieval step . |
Training Question Answering Models From Synthetic Data (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on question and answer generation aims to improve question answering models given limited amount of labeled data. |
| Approach: | They synthesize questions and answers from a synthetic text corpus generated by an 8.3 billion parameter GPT-2 model and achieve 88.4 Exact Match (EM) and 93.9 F1 score on the SQuAD1.1 dev set. |
| Outcome: | The proposed model achieves higher accuracy than the SQUAD1.1 training set questions using synthetic questions and answers than the training set question. |
Leveraging Context Information for Natural Question Generation (N18-2)
Copied to clipboard
| Challenge: | Existing work for natural question generation ignores the input passage or hard-codes answer positions. |
| Approach: | They propose a model that matches the answer with the passage before generating a question. |
| Outcome: | The proposed model outperforms the state-of-the-art model using rich features. |