SQLForge: Synthesizing Reliable and Diverse Data to Enhance Text-to-SQL Reasoning in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing closed-source LLMs have a performance gap in text-to-SQL reasoning tasks. |
| Approach: | They propose a SQL-based approach to synthesize reliable data to enhance text-to-SQL reasoning in LLMs. |
| Outcome: | The proposed model achieves state-of-the-art accuracy on the widely recognized Spider and BIRD benchmarks, significantly narrowing the performance gap with closed-source methods. |
Similar Papers
Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs. |
| Approach: | They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model . |
| Outcome: | The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning. |
SQLGenie: A Practical LLM based System for Reliable and Efficient SQL Generation (2025.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) enable natural language to SQL conversion, but generating accurate, efficient queries is challenging due to ambiguous intent, domain knowledge requirements and database constraints. |
| Approach: | They propose a system for reliable SQL generation that integrates Table Onboarder, SQL Generator and Feedback Augmentation. |
| Outcome: | The proposed system surpasses the best single-LLM baseline by 21.5% and the strongest pipeline competitor by 5.3% on public benchmarks and internal datasets. |
PARSQL: Enhancing Text-to-SQL through SQL Parsing and Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models have made significant strides in text-to-SQL tasks, but small language models struggle to accurately interpret natural language questions due to resource limitations. |
| Approach: | They propose a SQL parser that extracts constraints from SQL to generate sub-SQLs . they use a rule-based and LLM-based method to generate step-by-step SQL explanations based on the results . |
| Outcome: | The proposed framework outperforms models with the same model size on BIRD and Spider benchmarks. |
Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL (2025.coling-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL approaches have overlooked the critical aspect of system robustness. |
| Approach: | They propose a robust text-to-SQL solution that integrates with LLMs . their method achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% . |
| Outcome: | The proposed solution achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% on the general Spider and Bird benchmarks. |
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Generating accurate SQL queries for user questions rely on the capability of large language models (LLMs) however, some knowledge is not explicitly included in the database schema and user question or has been learned by LLMs. |
| Approach: | They propose a Knowledge-to-SQL framework that employs tailored Data Expert LLM (DELLM) to provide helpful knowledge for all text-to SQL models. |
| Outcome: | The proposed framework improves the state-of-the-art approaches for text-to-SQL tasks by leveraging a data expert LLM (DELLM) to provide useful knowledge for all text- to-SqL models. |
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)
Copied to clipboard
Yiqun Hu, Yiyun Zhao, Jiarong Jiang, Wuwei Lan, Henghui Zhu, Anuj Chauhan, Alexander Hanbo Li, Lin Pan, Jun Wang, Chung-Wei Hang, Sheng Zhang, Jiang Guo, Mingwen Dong, Joseph Lilien, Patrick Ng, Zhiguo Wang, Vittorio Castelli, Bing Xiang
| Challenge: | Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data. |
| Approach: | They propose a framework that imposes strong typing constraints and incorporates key relationships from schema. |
| Outcome: | The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider. |
Towards Faithful and Robust LLM Specialists for Evidence-Based Question-Answering (2024.acl-long)
Copied to clipboard
| Challenge: | Evidence-Based QA has proved insufficiently faithful with Large Language Models . a typical application of LLMs is in Evidence-based Question Answering (QA). |
| Approach: | They propose a data generation pipeline with automated data quality filters to fine-tune LLMs for better source quality and answer attributability. |
| Outcome: | The proposed model can synthesize high-quality training and testing data at scale. |
DSQG-Syn: Synthesizing High-quality Data for Text-to-SQL Parsing by Domain Specific Question Generation (2025.findings-naacl)
Copied to clipboard
Shaoming Duan, Youxuan Wu, Chuanyi Liu, Yuhao Zhang, Zirui Wang, Peiyi Han, Shengyuan Yu, Liang Yan, Yingwei Liang
| Challenge: | Existing methods for generating SQL queries using natural language questions produce inconsistent NLQ-SQL pairs. |
| Approach: | They propose a text-to-SQL data synthesis framework that generates domain-relevant questions . they synthesize NLQ-SqL pairs that are domain-specific and intent-consistent . |
| Outcome: | The proposed method outperforms closed-source LLMs on the Text-to-SQL task. |
DTS-SQL: Decomposed Text-to-SQL with Small Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | relying on proprietary Large Language Models poses privacy and cost implications for models. |
| Approach: | They propose a two-stage fine-tuning approach that breaks down the task into two simpler tasks. |
| Outcome: | The proposed method achieves 60.31% execution accuracy on Bird hold-out test set . it is the highest performance among methods using 7B parameter models . |
CORES: Code-Oriented Reasoning for Complex Text-to-SQL and Generalizable TableQA (2026.findings-acl)
Copied to clipboard
Meng Zhang, Ruochun Jin, Yuanxi Peng, Wenjing Yang, Haotian Wang, Liting Sun, Kun Hu, Silin Yang, Zhang Ke-di
| Challenge: | Text-to-SQL models struggle with complex analytical tasks such as generating simple SQL queries. |
| Approach: | They propose a text-to-sql model that leverages Python as a procedural reasoning pivot to enhance both complex SQL generation and tabular reasoning. |
| Outcome: | The proposed model outperforms baseline models on six text-to-SQL benchmarks by 6.44% on average while maintaining good capability on three tableQA benchmarks. |