| Challenge: | Existing query languages for question answering over knowledge bases are not capable of processing queries presented in human language directly. |
| Approach: | They advocate a new model architecture that includes a verification mechanism for checking the correctness of predicted relations. |
| Outcome: | The proposed approach dramatically improves the question answering performance. |
Similar Papers
Large-Scale Relation Learning for Question Answering over Knowledge Bases with Pre-trained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing KBQA methods focus on the natural language but ignore textual information carried by the nodes and edges. |
| Approach: | They propose to perform relation extraction, relation matching, and relation reasoning tasks to align the natural language expressions to the relations in the KB and reason over the missing connections. |
| Outcome: | Experiments on WebQSP show that the proposed model outperforms baselines even when the KB is incomplete. |
Pattern-revising Enhanced Simple Question Answering over Knowledge Bases (C18-1)
Copied to clipboard
| Challenge: | Simple question answering over knowledge bases is one of the most important natural language processing tasks. |
| Approach: | They propose to conduct pattern extraction and entity linking first and put forward pattern revising procedure to mitigate the error propagation problem. |
| Outcome: | The proposed method outperforms the current state-of-the-art in this task by an absolute large margin. |
Double Retrieval and Ranking for Accurate Question Answering (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent work shows that answer verification models can improve the state of the art in Question Answering . despite the fact that the supporting candidates are ranked only according to the relevancy with the question, the model still lacks the support needed for other answer candidates. |
| Approach: | They propose a double reranking model that selects the best support for each target answer . they propose 'second neural retrieval stage' to encode question and answer pair as query . |
| Outcome: | The proposed approach improves the state of the art in Question Answering . the proposed model ranked candidates according to relevancy and not the answer . but the proposed approach fails to provide the best support . |
Knowing More About Questions Can Help: Improving Calibration in Question Answering (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work on calibration focuses on model confidence, such as the max probability of the predicted class. |
| Approach: | They propose a calibration method which estimates whether model correctly predicts answer for each question. |
| Outcome: | The proposed calibration method achieves 5-10% gains on reading comprehension benchmarks. |
Strong Baselines for Simple Question Answering over Knowledge Graphs with and without Neural Networks (N18-2)
Copied to clipboard
| Challenge: | Existing work on simple question answering over knowledge graphs involves increasingly complex NN architectures. |
| Approach: | They propose to decompose the problem into entity detection, entity linking, relation prediction, evidence combination and heuristics. |
| Outcome: | The proposed approach outperforms existing models and benchmarks on a simple QA task. |
AVA: an Automatic eValuation Approach for Question Answering Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | AVA is an automatic evaluation approach for question answering . it uses transformer-based language models to encode question, answer, and reference texts . |
| Approach: | They propose an automatic evaluation approach for Question Answering that uses Transformer-based language models to encode question, answer, and reference texts. |
| Outcome: | AVA can estimate system Accuracy with an error lower than 7% at 95% confidence level . the proposed approach achieves 74.7% F1 score in predicting human judgment for single answers . |
Improving Question Answering with External Knowledge (D19-58)
Copied to clipboard
| Challenge: | ARC-Easy, ARC Challenge, and OpenBookQA use Wikipedia to augment training data . performance degrades when additional instances exhibit higher difficulty than original training data. |
| Approach: | They propose two methods for exploiting external knowledge for QA in science . they enrich the original corpus with relevant text snippets from an open-domain resource . the second method simply increases the amount of training data by appending additional in-domain instances. |
| Outcome: | The proposed methods achieve gains in accuracy of 8.1%, 13.0%, and 12.8% on science QA tasks. |
Improving Knowledge Production Efficiency With Question Answering on Conversation (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing researches on conversation-based QA focus on document-based tasks . current researche focuses on document based tasks, but there is a lack of researche on conversation based qa . |
| Approach: | They propose a multi-span extraction model on conversation-based QA and introduce continual pre-training and multi-task learning schemes to further improve model performance. |
| Outcome: | The proposed model outperforms baseline on two Chinese datasets and will be released for research purposes. |
Robust Question Answering Through Sub-part Alignment (2021.naacl-main)
Copied to clipboard
| Challenge: | Current textual question answering models fail to generalize to out-of-domain settings. |
| Approach: | They propose to decompose question and context into smaller units and align them to find the answer. |
| Outcome: | The proposed model is more robust than the standard BERT QA model on adversarial and out-of-domain datasets. |
Retrieving Support to Rank Answers in Open-Domain Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | a novel question answering architecture retrieves content relevant to the combined pair . previous work on automatic claim verification has shown hallucinations . |
| Approach: | They propose a question-answer architecture that prioritizes supporting evidence . it retrieves paragraphs that directly substantiate the correctness of a with respect to q . |
| Outcome: | The proposed approach can be used by large language models to retrieve explanatory paragraphs that ground their reasoning. |