ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models with table-specific architectures and pre-training methods perform well on understanding table structures but lack table reasoning skills. |
| Approach: | They propose to pre-train tables with table reasoning skills without complex architectures . they define 7 table reasoning skill, and then pre-teach them to generate tables . |
| Outcome: | The proposed model improves on four tasks and is available on github. |
Similar Papers
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills (2022.acl-long)
Copied to clipboard
| Challenge: | Large pre-trained language models struggle in tasks that require reasoning . recent work shows that they struggle in performing symbolic reasoning operations without substantial amounts of additional data. |
| Approach: | They propose to leverage semi-structured tables and generate at scale question-paragraph pairs where answering the question requires reasoning over multiple facts in the paragraph. |
| Outcome: | The proposed model outperforms T5, a popular pre-trained encoder-decoder model, on reasoning-focused reading comprehension datasets. |
Leveraging Data Recasting to Enhance Tabular Reasoning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to create tabular inference data are limited by human annotation and synthetic generation. |
| Approach: | They propose a framework for semi-automatically recasting tabular data to make use of both approaches. |
| Outcome: | The proposed framework can be used to build tabular NLI instances from five datasets. |
Generative Table Pre-training Empowers Models for Tabular Prediction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to use table pre-training to boost tabular prediction performance remain open . a bachelor's degree earns less than 50K, and a generative LM can be used to unify tasks via one LM. |
| Approach: | They propose a method that leverages table pre-training to empower tabular prediction models. |
| Outcome: | The proposed method outperforms baseline models on 12 datasets and can be easily combined with various backbone models. |
Structure-Aware Pre-Training for Table-to-Text Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Pretraining techniques have achieved great success on table-to-text generation. |
| Approach: | They propose a pre-trained model that is trained with tables and their contexts to generate fluent text from table input. |
| Outcome: | The proposed model can understand the structured input table and generate fluent text. |
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data (2020.acl-main)
Copied to clipboard
| Challenge: | Recent years have witnessed the burgeoning of pretrained language models (LMs) for text-based natural language understanding tasks. |
| Approach: | They propose a pretrained language model that jointly learns representations for NL sentences and (semi-)structured tables. |
| Outcome: | The proposed model performs best on the weakly-supervised semantic parsing benchmark WikiTableQuestions while performing competitively on the text-to-SQL dataset Spider. |
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Logical table-to-text generation requires models to derive logical-level facts from table records via logical inference. |
| Approach: | They propose a pretrained logical form generator framework to improve generation fidelity . they use a dataset to test the logical inference accuracy of the framework . |
| Outcome: | The proposed framework outperforms baselines on LOGICNLG and CONTLOG on two benchmarks. |
ReEx-SQL: Reasoning with Execution-Aware Reinforcement Learning for Text-to-SQL (2026.acl-long)
Copied to clipboard
Yaxun Dai, Wenxuan Xie, Xialie Zhuang, Tianyu Yang, Ziyi Liu, Haiqin Yang, Yiying Yang, Yuhang Zhao, Pingfu Chao, Wenhao Jiang
| Challenge: | Current Text-to-SQL reasoning models lack integrated execution feedback during generation. |
| Approach: | They propose a text-to-SQL framework that interacts with the SQL execution engine during decoding and dynamically adjusts reasoning based on execution feedback. |
| Outcome: | The proposed framework achieves 89.1% accuracy on Spider and 65.3% on BIRD at the 7B scale. |
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering (2022.naacl-main)
Copied to clipboard
| Challenge: | a table-based question answering system requires complex reasoning and alignment between questions and tables. |
| Approach: | They propose a table-based QA model that consumes both natural and synthetic data . they combine retrieval with masking to pair natural sentences with QA . |
| Outcome: | The proposed model outperforms existing models in few-shot and full settings and on WikiTableQuestions. |
Enhancing Tabular Reasoning with Pattern Exploiting Training (2022.aacl-main)
Copied to clipboard
| Challenge: | Existing methods based on pre-trained language models have shown superior performance over tabular tasks despite showing inherent problems such as not using the right evidence and inconsistent predictions across inputs. |
| Approach: | They utilize Pattern-Exploiting Training (PET) on pre-trained language models to strengthen tabular reasoning models’ pre-existing knowledge and reasoning abilities. |
| Outcome: | The proposed model exhibits superior understanding of knowledge facts and tabular reasoning compared to baseline models. |
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing research on fact verification focuses on unstructured textual evidence, but it is still underexplored. |
| Approach: | They propose to use a table-based language model to verify textual statements . they use cell embeddings and numerical information to improve accuracy . |
| Outcome: | The proposed method outperforms the state-of-the-art model on question answering tasks even without modeling numerical information. |