Challenge: TableLLM is a robust large language model capable of handling tabular data manipulation tasks.
Approach: They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy.
Outcome: The proposed model has 8 billion parameters and is capable of handling tabular data tasks.

Similar Papers

TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing solutions for table reasoning tasks are mainly tested on small tables and face scalability issues and struggle with complex queries due to incomplete or dispersed data across different table sections.
Approach: They propose a table reasoning pre-processor suite that can be used to leverage large language models (LLMs) in table-based tasks.
Outcome: The proposed method improves LLMs’ reasoning capabilities in various tabular tasks and enhances interaction between LLM and tabular data by employing effective pre-processing.
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)

Copied to clipboard

Challenge: Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity.
Approach: They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability.
Outcome: The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability.
An Efficient Retrieval-Based Method for Tabular Prediction with LLM (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for tabular prediction rely on extensive pre-training or fine-tuning of LLMs . a retrieval-based approach eliminates the need for training any modules or performing data augmentation .
Approach: They propose a retrieval-based approach that utilizes the powerful capabilities of large language models in representation, comprehension, and inference.
Outcome: The proposed method exhibits strong predictive performance on tabular prediction task, affirming its practicality and effectiveness.
Empowering Tabular Data Preparation with Language Models: Why and How? (2026.acl-long)

Copied to clipboard

Challenge: Tabular data preparation is a critical step in enhancing the usability of tabular data.
Approach: They analyze how LMs can be combined with other components for different tabular data preparation tasks.
Outcome: The proposed methods lack the ability to capture the relationships within tables and adapt to the tasks involved.
Rethinking Tabular Data Understanding with Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area.
Approach: They propose a method for table structure normalization to improve model performance . they propose aggregation of multiple reasoning pathways to improve performance based on textual and symbolic reasoning.
Outcome: The proposed method improves performance on symbolic reasoning tasks with textual reasoning slightly outperforming symbolic reasoning on tables.
Solving Data-centric Tasks using Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Large language models are increasingly useful for data-centric tasks, but how do we decide how much data to include in the prompt?
Approach: They propose a cluster-then-select prompting technique that adds the most representative rows from the input data to the LLM prompt.
Outcome: The proposed technique outperforms a baseline for tasks with syntactic variation in the input table.
TabularMath: Understanding Math Reasoning over Tables with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Mathematical reasoning has long been a key benchmark for evaluating large language models.
Approach: They propose a framework that transforms math word problems into scalable tabular reasoning tasks.
Outcome: The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks.
Question Answering over Tabular Data with DataBench: A Large-Scale Empirical Evaluation of LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are showing emerging abilities, but they are not large enough to assess their capabilities.
Approach: They propose a benchmark that compares large language models with open and closed source models.
Outcome: The proposed benchmark compares open and closed-source models with open-source and closed source models.
TableLlama: Towards Open Large Generalist Models for Tables (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for interpreting, augmenting, and querying semi-structured tables require pretraining on tables or special model architecture design.
Approach: They construct a dataset with a variety of tables and tasks for instruction tuning and evaluating LLMs.
Outcome: The proposed model achieves comparable or better performance on 7 out of 8 in-domain tasks compared with the base model on 6 out-of-domain datasets.
SEC-FinTables: Evaluating Large Language Models for Detecting Logical Inconsistencies on Tabular Data (2026.findings-acl)

Copied to clipboard

Challenge: Large language models are increasingly deployed in high-stakes domains where logical inconsistencies are unrecognized.
Approach: They propose a benchmarking system that decomposes inconsistency detection into granular subtasks and a protocol that decompiles it into subtask.
Outcome: The proposed model decomposes inconsistencies into subtasks and identifies them in 103,395 real-world and error-injected table instances.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations