Challenge: Recent generative approaches for multi-hop question answering (QA) use fusion-in-decoder to generate a single sequence output . but, they often have difficulty accurately identifying passages corresponding to key entities in the context .
Approach: They propose a single-sequence prediction method that integrates a graph structure linking key entities in each context passage to relevant subsequent passages for each question.
Outcome: The proposed method improves answer exact-match/F1 scores and faithfulness of grounding on the hotpotQA dataset and achieves state-of-the-art numbers on the Musique dataset.

Similar Papers

Modeling Multi-hop Question Answering as Single Sequence Prediction (2022.acl-long)

Copied to clipboard

Challenge: Existing generative question answering models that leverage passage retrieval with a pre-trained transformer are not effective for multihop QA.
Approach: They propose a generative approach that explicitly models the reasoning process to resolve the answer for multi-hop questions by encoding cross-passage interactions.
Outcome: The proposed model improves on two multi-hop QA datasets and is interpretable.
Multi-hop Question Generation with Graph Convolutional Network (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on text-based QG focus on generating SQuAD-style questions.
Approach: They propose a multi-hop question generation model that does context encoding in multiple hops with Graph Convolutional Network and encoder fusion via an Encoder Reasoning Gate.
Outcome: Empirical results show that the proposed model generates fluent questions with high completeness and outperforms baselines on automatic evaluation metrics.
Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions? (2021.eacl-main)

Copied to clipboard

Challenge: Existing models fail to answer a large portion of sub-questions . Existing systems have achieved super-human performance .
Approach: They propose to use a neural decomposition model to generate sub-questions for a multi-hop question and extract the corresponding sub-answers.
Outcome: The proposed model is based on a hotpotQA dataset with a multi-hop question and sub-answers.
SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-hop knowledge graph reasoning suffer from slow and poor convergence . a transformer model can be used to learn and predict in an end-to-end fashion, giving faster convergence compared to previous methods .
Approach: They propose a Sequence-to-sequence based multi-hop reasoning framework . it uses an encoder-decoder transformer structure to translate the query to a path .
Outcome: The proposed framework can learn and predict in an end-to-end fashion, which gives better and faster convergence.
Recurrent One-Hop Predictions for Reasoning over Knowledge Graphs (C18-1)

Copied to clipboard

Challenge: Large scale knowledge graphs (KGs) such as Freebase are generally incomplete.
Approach: They propose a model that predicts entities at each step of mh-KB paths . the model is based on recurrent neural networks and vector representations of entities and relations .
Outcome: The proposed models show state-of-the-art for two important multi-hop KG reasoning tasks.
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps (2020.coling-main)

Copied to clipboard

Challenge: Existing multi-hop question answering datasets do not provide a complete explanation for the reasoning process from the question to the answer.
Approach: They propose a multi-hop question answering dataset that uses structured and unstructured data to test reasoning skills.
Outcome: The proposed dataset ensures multi-hop reasoning while being challenging for multi-models.
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering (2022.coling-1)

Copied to clipboard

Challenge: Generative question answering (QA) models generate answers to complex questions, but their mechanism for doing so is still poorly understood.
Approach: They decompose multi-hop questions into multiple corresponding single-hop question chains and find marked inconsistency in QA models’ answers on these pairs of ostensibly identical question chains.
Outcome: The proposed models lack zero-shot multi-hop reasoning ability when trained on single-hop questions and on logical forms.
Self-Assembling Modular Networks for Interpretable Multi-Hop Reasoning (D19-1)

Copied to clipboard

Challenge: Existing models for multi-hop question answering require multiple pieces of evidence scattered in a given context.
Approach: They propose an interpretable, controller-based self-assembling Neural Modular Network for multi-hop reasoning . their model can softly decompose a multi-step question into multiple single-hop sub-questions .
Outcome: The proposed model improves on the static, single-hop model on regular and adversarial evaluations.
Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods rely on linear sequential operations to solve First-Order Logic queries.
Approach: They propose a model-agnostic approach that fully integrates the context of the query graph.
Outcome: The proposed method improves performance on two datasets by 19.5%.
Breadth First Reasoning Graph for Multi-hop Question Answering (2021.naacl-main)

Copied to clipboard

Challenge: Recent Graph Neural Network (GNN) has been used as a promising tool in multi-hop question answering task.
Approach: They propose a model of Breadth First Reasoning Graph that passes to next nodes hop by hop until all edges have been passed.
Outcome: The proposed model achieves state-of-the-art on answer span prediction on hotpotQA leaderboard.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations