HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question answering datasets focus on dealing with homogeneous information, but using homogenous information alone might lead to coverage problems. |
| Approach: | They propose a large-scale question-answering dataset that requires reasoning on heterogeneous information. |
| Outcome: | The proposed model can achieve an EM score of 40% while the existing model is far behind human performance. |
Similar Papers
S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering (2023.acl-short)
Copied to clipboard
| Challenge: | Existing question answering systems use a retriever-reader framework to answer multi-hop questions . existing models lack retrieval, selector, and reasoner capabilities . |
| Approach: | They propose a three-stage text tableQA framework which comprises of retriever, selector, and reasoner. |
| Outcome: | The proposed framework outperforms baseline methods in the few-shot setting and ranks first on the HybridQA leaderboard. |
How Robust Are the QA Models for Hybrid Scientific Tabular Data? A Study Using Customized Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing tabular QA models are lacking in understanding their robustness on scientific information. |
| Approach: | They propose a dataset to assess the robustness of tabular QA models on scientific hybrid tabular data. |
| Outcome: | The proposed model performs well on scientific tables and text, while the best score is 0.462. |
FeTaQA: Free-form Table Question Answering (2022.tacl-1)
Copied to clipboard
Linyong Nan, Chiachun Hsieh, Ziming Mao, Xi Victoria Lin, Neha Verma, Rui Zhang, Wojciech Kryściński, Hailey Schoelkopf, Riley Kong, Xiangru Tang, Mutethia Mutuma, Ben Rosand, Isabel Trindade, Renusree Bandaru, Jacob Cunningham, Caiming Xiong, Dragomir Radev, Dragomir Radev
| Challenge: | Existing table-based question answering datasets lack advanced information-based questions that require reasoning and integration of information pieces retrieved from structured knowledge sources. |
| Approach: | They propose a dataset with 10K Wikipedia-based table, question, free-form answer, supporting table cells pairs that can be used to generate an answer. |
| Outcome: | The proposed dataset has 10K Wikipedia-based table, question, free-form answer, supporting table cells pairs. |
Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answering (2021.acl-long)
Copied to clipboard
| Challenge: | Existing generative models for open-domain question answering focus on generating direct answers from unstructured textual information, but a large amount of knowledge is stored in structured databases, and need to be accessed using query languages such as SQL. |
| Approach: | They propose a hybrid framework that takes both textual and tabular evidences as input and generates either direct answers or SQL queries depending on which form could better answer the question. |
| Outcome: | The proposed framework outperforms baseline models on OpenSQuAD datasets and can generate SQL queries on the associated databases to obtain the final answers. |
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering (D18-1)
Copied to clipboard
Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, Christopher D. Manning
| Challenge: | Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. |
| Approach: | They propose a new dataset with 113k Wikipedia-based question-answer pairs with four key features: (1) the questions require finding and reasoning over multiple supporting documents to answer; (2) the questions are diverse and not constrained to any pre-existing knowledge bases or knowledge schemas; (3) the questions provide sentence-level supporting facts required for reasoning; and (4) a type of factoid comparison questions to test QA systems’ ability to extract relevant facts and perform necessary comparison. |
| Outcome: | The proposed dataset has 113k Wikipedia-based question-answer pairs and four key features that make it challenging for the latest QA systems. |
PeerQA: A Scientific Question Answering Dataset from Peer Reviews (2025.naacl-long)
Copied to clipboard
| Challenge: | a dataset of 579 QA pairs from 208 scientific articles contains answers that reviewers raised while thoroughly examining the scientific article. |
| Approach: | They propose a dataset that contains questions that reviewers raised while thoroughly examining the scientific article. |
| Outcome: | The proposed dataset contains 579 QA pairs from 208 academic articles . the results show that decontextualization approaches improve retrieval performance . |
MESAQA: A Dataset for Multi-Span Contextual and Evidence-Grounded Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Existing question answering systems focus on extracting answers from single spans, but real-world scenarios require synthesizing information from multiple spans. |
| Approach: | They propose a dataset that leverages the MASH-QA dataset and large language models (LLMs) to ensure that each Q/A pair requires considering all selected spans. |
| Outcome: | The proposed method enables the model to answer multiple Q/A pairs in a single span, while ensuring that all selected spans are considered. |
MultiTabQA: Generating Tabular Answers for Multi-Table Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Recent tabular question answering models only answer questions over a single table . multi-table operations often result in tabular outputs . |
| Approach: | They propose a model that answers questions over multiple tables and generalizes to generate tabular answers. |
| Outcome: | The proposed model outperforms state-of-the-art single table QA models on a multi-table QA setting. |
TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance (2021.acl-long)
Copied to clipboard
Fengbin Zhu, Wenqiang Lei, Youcheng Huang, Chao Wang, Shuo Zhang, Jiancheng Lv, Fuli Feng, Tat-Seng Chua
| Challenge: | Existing QA systems focus on unstructured text, structured knowledge base, or semi-structured tables. |
| Approach: | They propose a large-scale question answering model based on financial reports . numerical reasoning is usually required to infer the answer . |
| Outcome: | The proposed model achieves 58.0% inF1, an 11.1% increase over the baseline model, but still lags behind the best human model. |
HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets focused on multiturn dialogue systems focus on text or table information. |
| Approach: | They propose a dataset that consists of crowdsourced conversations grounded on Wikipedia text and tables. |
| Outcome: | The proposed dataset shows that there is still ample opportunity for improvement in the current state of dialogue systems. |