A Semantic-based Method for Unsupervised Commonsense Question Answering (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to score candidates without labeled task data are difficult to use . e.g., pre-trained language models can be easily affected by irrelevant factors . |
| Approach: | They propose a method that generates plausible answers with generative models and uses them to select the correct answer. |
| Outcome: | The proposed method achieves the best results in unsupervised situations. |
Similar Papers
CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge (N19-1)
Copied to clipboard
| Challenge: | Recent work on question answering relies on factoid questions with little general knowledge. |
| Approach: | They propose a dataset to capture commonsense question answering with prior knowledge . they extract multiple-choice questions that discriminate between the source and target concepts . |
| Outcome: | The proposed dataset captures commonsense reasoning beyond associations . it obtains 56% accuracy, well below human performance, which is 89% . |
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on acquiring relevant knowledge by retrieving external knowledge bases and fine-tuning pre-trained models. |
| Approach: | They propose a two-stage prompt-based unsupervised commonsense question answering framework that leverages implicit knowledge stored in PrLMs to generate knowledge for questions with unlimited types and possible candidate answers independent of specified choices. |
| Outcome: | The proposed framework significantly improves the reasoning ability of language models in unsupervised settings. |
RetinaQA: A Robust Knowledge Base Question Answering Model for both Answerable and Unanswerable Questions (2024.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge base question answering models assume all questions to be answerable. |
| Approach: | They propose a new KBQA model that unifies two key ideas in a single architecture . they propose logical form discrimination and sketch-filling-based construction for unanswerable questions . |
| Outcome: | The proposed model outperforms existing models in handling answerable and unanswerable questions. |
Elaboration-Generating Commonsense Question Answering at Scale (2023.acl-long)
Copied to clipboard
| Challenge: | elaborations are generated using language models that generate background knowledge that helps improve performance . human evaluations show that the quality of the generated ellaborations is high . |
| Approach: | They propose to finetune smaller language models to generate useful intermediate context . they compare a language model with an answer predictor and generate elaborations . human evaluations show that the quality of the generated ellaborations is high . |
| Outcome: | The proposed framework outperforms other models on commonsense questions on four commons sense benchmarks. |
Unsupervised Natural Question Answering with a Small Model (D19-66)
Copied to clipboard
| Challenge: | a recent demonstration of the power of huge language models such as GPT-2 to memorise the answers to factoid questions raises questions about the extent to which knowledge is embedded directly within these large models. |
| Approach: | They propose to use unsupervised learning techniques to add knowledge explicitly without extensive training. |
| Outcome: | The proposed architecture allows for explicit addition of knowledge without extensive training. |
Masked Language Models Know Which are Popular: A Simple Ranking Strategy for Commonsense Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical results show that pre-trained language models can improve the typical answer generation of GLMs. |
| Approach: | They propose a ranking strategy that exploits WordNet to train a ranker that picks out the most popular answers for commonsense questions. |
| Outcome: | The proposed ranking strategy is tested on a commonsense question answering (QA) dataset and on negative samples from WordNet. |
A Simple Baseline for Knowledge-Based Visual Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies emphasize the importance of incorporating both explicit and implicit knowledge to answer questions requiring external knowledge. |
| Approach: | They propose a pipeline that incorporates both explicit and implicit knowledge . their method is training-free and does not require access to external databases or APIs . |
| Outcome: | The proposed method achieves state-of-the-art accuracy on OK-VQA and A-OK-VQ datasets. |
Unsupervised Question Answering via Answer Diversifying (2022.coling-1)
Copied to clipboard
| Challenge: | Existing extractive question answering methods use labeled data to train QA models. |
| Approach: | They propose an unsupervised method by diversifying answers by using data construction, data augmentation and denoising filter. |
| Outcome: | The proposed method outperforms previous models on five benchmark datasets . it shows strong performance in the few-shot learning setting . |
Harvesting and Refining Question-Answer Pairs for Unsupervised QA (2020.acl-main)
Copied to clipboard
| Challenge: | Recent research attempts to extend unsupervised question answering to settings with few or no labeled data available. |
| Approach: | They propose two approaches to improve unsupervised question answering . first, they harvest lexically and syntactically divergent Wikipedia questions to automatically construct a corpus of question-answer pairs . second, they take advantage of the QA model to extract more appropriate answers . |
| Outcome: | The proposed approach outperforms previous unsupervised approaches by a large margin and is competitive with early supervised models. |
Uni-Parser: Unified Semantic Parser for Question Answering on Knowledge Base and Database (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches on semantic parsing suffer from exponential growth of logical form candidates and can hardly generalize to unseen data. |
| Approach: | They propose a unified semantic parser for question answering on KB and DB . they define the primitive as the essential element in their framework . |
| Outcome: | The proposed framework can predict logical forms by altering and composing top-ranked primitives with different operations. |