HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation (2022.acl-long)
Copied to clipboard
Zhoujun Cheng, Haoyu Dong, Zhiruo Wang, Ran Jia, Jiaqi Guo, Yan Gao, Shi Han, Jian-Guang Lou, Dongmei Zhang
| Challenge: | Existing studies on table reasoning focus on flat tables and hierarchical tables . a new dataset, HiTab, aims to examine numerical reasoning over hierarchic tables based on hierarchically structured tables - a strong challenge for existing baselines and a valuable benchmark for future research. |
| Approach: | They propose a hierarchical question answering and natural language generation dataset to study hierarchic tables. |
| Outcome: | The proposed model shows that it is effective in QA and natural language generation over hierarchical tables. |
Similar Papers
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases. |
| Approach: | They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar. |
| Outcome: | The proposed framework can produce high-quality natural language questions over strong baselines. |
A guide to the dataset explosion in QA, NLI, and commonsense reasoning (2020.coling-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide an up-to-date guide to the recent datasets . the target audience is the NLP practitioners who are lost in dozens of the recent data sets. |
| Approach: | This tutorial provides an up-to-date guide to the recent datasets . it surveys old and new methodological issues with dataset construction . |
| Outcome: | This tutorial aims to provide an up-to-date guide to the recent datasets . it surveys the old and new methodological issues with dataset construction . |
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data (2022.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for numerical reasoning over hybrid data only include a single flat table in each document . |
| Approach: | They propose a new benchmark with QA pairs over multi hierarchical tabular and textual data. |
| Outcome: | The proposed model is more complex and challenging than existing benchmarks and is available on github . it uses facts retrieving to extract relevant facts from both tables and text and symbolic reasoning over retrieved facts. |
TaKG: A New Dataset for Paragraph-level Table-to-Text Generation Enhanced with Knowledge Graphs (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing table-to-text generation benchmarks have some limitations, such as E2E and ToTTo focusing on singlesentence generation tasks. |
| Approach: | They propose a new table-to-text generation dataset called TaKG that uses a set of knowledge graphs to enhance table input. |
| Outcome: | The proposed model outperforms existing models for short-text generation tasks and shows reliable performance on long-text generated across a variety of metrics. |
HTML: Hierarchical Topology Multi-task Learning for Semantic Parsing in Knowledge Base Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches struggle with mapping questions to precise logical forms . Existing frameworks struggle with complex mapping of questions to logical form . |
| Approach: | They propose a framework that leverages a hierarchical multi-task learning paradigm to enhance the performance of logical form generation. |
| Outcome: | The proposed framework outperforms supervised fine-tuning methods and training-free ones on large language models. |
QuASAR: A Question-Driven Structure-Aware Approach for Table-to-Text Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for table-to-text generation fail to capture the structure of tabular data or rely on complex attention mechanisms, limiting their applicability. |
| Approach: | They propose a question-driven self-supervised approach to enhance the model’s structural perception and representation capabilities by focusing on structure-related queries. |
| Outcome: | The proposed model improves its model's structural perception and representation capabilities by guiding it to capture local and global table structures. |
AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry (2022.naacl-industry)
Copied to clipboard
Yannis Katsis, Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Mustafa Canim, Michael Glass, Alfio Gliozzo, Feifei Pan, Jaydeep Sen, Karthik Sankaranarayanan, Soumen Chakrabarti
| Challenge: | Table Question Answering (Table QA) systems have been shown to be highly accurate when trained and tested on open-domain datasets built on top of Wikipedia tables. |
| Approach: | They propose a domain-specific Table QA test dataset to test Table Question Answering systems on open-domain datasets built on top of Wikipedia tables. |
| Outcome: | The proposed methods are highly accurate when tested on open-domain datasets built on top of Wikipedia tables. |
Logical Natural Language Generation from Open-Domain Tables (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on neural natural language generation focus on surface-level realizations with limited emphasis on logical inference. |
| Approach: | They propose a task where a model is tasked with generating natural language statements that can be logically entailed by facts in an open-domain semi-structured table. |
| Outcome: | The proposed task is based on the existing TabFact dataset with a wide range of logical/symbolic inferences. |
Semantic Graphs for Generating Deep Questions (2020.acl-main)
Copied to clipboard
| Challenge: | Existing research has focused on generating factoid questions relevant to one fact obtainable from a single sentence. |
| Approach: | They propose a framework that first constructs a semantic-level graph and then encodes it by introducing an attention-based GGNN. |
| Outcome: | The proposed framework captures the global structure of the document and facilitates reasoning over multiple facts. |
E5: Zero-shot Hierarchical Table Analysis using Augmented LLMs via Explain, Extract, Execute, Exhibit and Extrapolate (2024.naacl-long)
Copied to clipboard
| Challenge: | Hierarchical tables with multi-level headers are confusing for models due to their complex structure, implicit semantics, and calculation relationships. |
| Approach: | They propose a code-augmented framework for zero-shot hierarchical table question answering that combines self-explaining the table's hierarchic structures with external code execution to prevent hallucinations. |
| Outcome: | The proposed framework outperforms state-of-the-art fine-tuning methods with a 44.38 Exact Match improvement. |