| Challenge: | Frequently Asked Questions (FAQ) retrieval requires labeled datasets for training neural models. |
| Approach: | They propose to exploit FAQ pairs to train two BERT models that match user queries to FAQ answers and questions. |
| Outcome: | The proposed model outperforms supervised models on existing datasets and is on par with existing dataset. |
Similar Papers
Harvesting and Refining Question-Answer Pairs for Unsupervised QA (2020.acl-main)
Copied to clipboard
| Challenge: | Recent research attempts to extend unsupervised question answering to settings with few or no labeled data available. |
| Approach: | They propose two approaches to improve unsupervised question answering . first, they harvest lexically and syntactically divergent Wikipedia questions to automatically construct a corpus of question-answer pairs . second, they take advantage of the QA model to extract more appropriate answers . |
| Outcome: | The proposed approach outperforms previous unsupervised approaches by a large margin and is competitive with early supervised models. |
A Recurrent BERT-based Model for Question Generation (D19-58)
Copied to clipboard
| Challenge: | Existing QG models rely on recurrent neural networks (RNNs) but the inherent sequential nature of the RNN models suffers from the problem of handling long sequences. |
| Approach: | They propose to employ a pre-trained BERT language model to tackle question generation tasks. |
| Outcome: | The proposed model outperforms the existing models on the question-answering dataset SQuAD and advances the BLEU 4 score from 16.85 to 22.17. |
Unsupervised Adaptation of Question Answering Systems via Generative Self-training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Supervised self-training methods have transformed applied machine learning . however, adapting to target data has received little attention . |
| Approach: | They propose a method to generate synthetic QA pairs for unsupervised self adaptation . they use massive amounts of data to simulate self-supervised tasks . |
| Outcome: | The proposed method improves QA systems significantly by using less data and training computation than existing augmentation approaches. |
End-to-End Open-Domain Question Answering with BERTserini (N19-4)
Copied to clipboard
| Challenge: | a new open-domain question answering system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles. |
| Approach: | They propose an end-to-end question answering system that integrates BERT with an IR reader. |
| Outcome: | The proposed system improves on a standard benchmark test collection. |
Open Domain Question Answering over Tables via Dense Retrieval (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent advances in open-domain QA focus on retrieving textual passages . a retriever designed to handle tabular context can improve retrieval quality . |
| Approach: | They propose a tabular-based retrieval model that improves retrieval quality over a BERT-based retriever. |
| Outcome: | The proposed retriever improves retrieval quality with mined hard negatives over a BERT-based retriever. |
Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration (2021.emnlp-main)
Copied to clipboard
| Challenge: | Phrase representations derived from pretrained language models often lack lexical similarity to determine semantic relatedness. |
| Approach: | They propose a contrastive fine-tuning objective that enables BERT to produce more powerful phrase embeddings by fine- tuning a dataset of diverse phrasal paraphrases and a large-scale dataset of phrases in context. |
| Outcome: | The proposed model outperforms baseline models across phrase-level similarity tasks while also showing increased lexical diversity between nearest neighbors in the vector space. |
BERT-QE: Contextualized Query Expansion for Document Re-ranking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to expand query use pseudo relevance feedback (PRF) but they are under-equipped to evaluate the relevance of information pieces used for expansion. |
| Approach: | They propose a query expansion model that leverages the BERT model to select relevant document chunks for expansion. |
| Outcome: | The proposed model significantly outperforms existing models on the TREC Robust04 and GOV2 test collections. |
Improving Unsupervised Question Answering via Summarization-Informed Question Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Question Generation (QG) is the production of meaningful questions given a set of input passages and corresponding answers. |
| Approach: | They propose a method which uses questions generated heuristically from news summaries as a source of training data for a QG system. |
| Outcome: | The proposed method outperforms previous unsupervised models on three in-domain datasets and three out-of-domain ones. |
BERTese: Learning to Speak to BERT (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent work shows that pre-trained language models encode large amounts of world knowledge in their parameters. |
| Approach: | They propose a method for automatically rewriting queries into a paraphrase query called "BERTese" they add auxiliary loss functions that encourage the query to correspond to actual language tokens . |
| Outcome: | The proposed method outperforms baselines and provides some insight into the type of language that helps language models perform knowledge extraction. |
Multi-Task Dense Retrieval via Model Uncertainty Fusion for Open-Domain Question Answering (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to multitask dense retrieval are not effective due to corpus inconsistency. |
| Approach: | They propose to train individual dense passage retrievers for different open-domain question-answering tasks and aggregate their predictions during test time. |
| Outcome: | The proposed method achieves state-of-the-art performance on 5 benchmark QA datasets, with up to 10% improvement in top-100 accuracy compared to a joint-training multi-task DPR on SQuAD. |