Neural Natural Logic Inference for Interpretable Question Answering (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing question answering models are based on textual entailment tasks . prior work has focused on QA on premise-based questions . |
| Approach: | They propose a neural-symbolic QA approach that integrates natural logic reasoning within deep learning architectures towards developing effective question answering models. |
| Outcome: | The proposed model outperforms previous work on multiple-choice science questions . it integrates natural logic reasoning within deep learning architectures to build proof paths . |
Similar Papers
Can NLI Models Verify QA Systems’ Predictions? (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent question answering systems perform well on benchmark datasets, but are not always well-calibrated to spot spurious answers under distribution shifts. |
| Approach: | They propose to use natural language inference to verify whether answers are correct . they leverage large pre-trained models and recent prior datasets to construct powerful question conversion and decontextualization modules. |
| Outcome: | The proposed approach improves the confidence estimation of a QA model across different domains, evaluated in a selective QA setting. |
QA-NatVer: Question Answering for Natural Logic-based Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work has focused on natural logic, which operates directly on natural language by capturing the semantic relation of spans between an aligned claim and its evidence via set-theoretic operators. |
| Approach: | They propose to use question answering to predict natural logic operators using generalization capabilities of instruction-tuned language models. |
| Outcome: | The proposed approach outperforms the best baseline on a Danish verification dataset by 4.3 accuracy points. |
Bridging Knowledge Gaps in Neural Entailment via Symbolic Models (D18-1)
Copied to clipboard
| Challenge: | Textual entailment models focus on lexical gaps but rarely on knowledge gaps. |
| Approach: | They propose a fact-level decomposition of the hypothesis and a knowledge lookup module to fill knowledge gaps in Science Entailment task. |
| Outcome: | The proposed model outperforms the base model on the SciTail dataset by 3% and 5% on the textual premise and the structured knowledge base. |
An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to interpret task-oriented dialogue systems employ an implicit reasoning strategy that makes the model predictions uninterpretable to humans. |
| Approach: | They propose a neuro-symbolic approach that performs explicit reasoning that justifies model decisions by reasoning chains. |
| Outcome: | The proposed approach achieves better results and introduces an interpretable decision process. |
Discovering Better Model Architectures for Medical Query Understanding (2021.naacl-industry)
Copied to clipboard
| Challenge: | Neural architecture search (NAS) has attracted intense attention in computer vision and NLP. |
| Approach: | They propose to use neural architecture search to optimize model architectures for medical questions . they propose to modify the ENAS method to accelerate and stabilize the search results . |
| Outcome: | The proposed approach outperforms baseline models on two medical questions . it is compared with other NAS methods and shows that it provides the best results . |
QED: A Framework and Dataset for Explanations in Question Answering (2021.tacl-1)
Copied to clipboard
Matthew Lamm, Jennimaria Palomaki, Chris Alberti, Daniel Andor, Eunsol Choi, Livio Baldini Soares, Michael Collins
| Challenge: | Existing question answering systems provide no explanation of reasoning that leads to answer . linguistically informed, extensible framework provides explanations in question answering . |
| Approach: | They propose a linguistically informed, extensible framework for explanations in question answering . they propose an expert-annotated dataset of QED explanations built upon a subset of the Natural Questions dataset . |
| Outcome: | The proposed framework improves the ability of untrained raters to spot errors in QA datasets. |
Natural Logic at the Core: Dynamic Rewards for Entailment Tree Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to generating entailment trees lack logical consistency . static reward structures or intricate dependencies within multi-step reasoning are often ignored . |
| Approach: | They propose a method that integrates natural logic principles into reinforcement learning to guide entailment tree generation. |
| Outcome: | Experiments on EntailmentBank show that the proposed method improves interpretability and generalization. |
Logic-Guided Data Augmentation and Regularization for Consistent Question Answering (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have focused on improving the consistency of comparison questions . current models show inconsistent comparison predictions due to small datasets . |
| Approach: | They propose a method that integrates logic rules and neural models to improve the accuracy of comparison questions by enhancing labeled training data. |
| Outcome: | The proposed method improves state-of-the-art models on WIQA and QuaRel and reduces consistency violations by 58% on HotpotQA. |
NLProlog: Reasoning with Weak Unification for Question Answering in Natural Language (P19-1)
Copied to clipboard
| Challenge: | ambiguity in natural language is difficult to interpret due to large linguistic variability. |
| Approach: | They propose to use a Prolog prover to extend neural networks with logic programming to solve multi-hop reasoning tasks over natural language. |
| Outcome: | The proposed model outperforms baseline models on two question answering tasks and is competitive on the MedHop corpus. |
Complex Reasoning in Natural Language (2023.acl-tutorials)
Copied to clipboard
| Challenge: | Recent research shows that pretrained language models are often brittle for complex reasoning tasks. |
| Approach: | They propose to use pre-trained language models to teach machines to reason over texts . they will review recent promising approaches to tackling complex reasoning tasks . |
| Outcome: | This tutorial reviews promising approaches to complex reasoning tasks . it reviews the methods that can be used to augment models with robustness . |