Challenge: Existing text-to-SQL systems encode the same schema for every question, resulting in unnecessary high inference cost and missing crucial database knowledge.
Approach: They propose a paradigm that directly internalizes database knowledge into the parametric knowledge of a text-to-SQL model during training and eliminates the need for schema encoding during inference.
Outcome: The proposed paradigm significantly reduces the input token length by 66%-98% and outperforms traditional systems on three benchmarks.

Similar Papers

DuoRAT: Towards Simpler Text-to-SQL Models (2021.naacl-main)

Copied to clipboard

Challenge: Recent text-to-SQL models can translate natural language questions to corresponding SQL queries on unseen databases.
Approach: They propose a re-implementation of the RAT-SQL model that uses only relation-aware or vanilla transformers as the building blocks.
Outcome: The proposed model is based on the spider dataset and shows it can be used on large databases without human intervention.
Clause-Wise and Recursive Decoding for Complex and Cross-Domain Text-to-SQL Generation (D19-1)

Copied to clipboard

Challenge: Existing deep learning approaches for text-to-SQL generation are limited to the WikiSQl dataset . a novel clause-wise decoding neural network model can be used to generate complex queries over multiple databases .
Approach: They propose a SQL clause-wise decoding neural architecture with a schema encoder to address the Spider task.
Outcome: The proposed model achieves 4.6% accuracy gain on the Spider dataset and 9.8% accuracy gain in test and dev sets.
ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing text-to-SQL models are limited to SQLite due to dataset limitations . data generated through static prompting is noisy and unreliable, authors say .
Approach: They propose a text-to-SQL framework with execution-driven, agentic bootstrapping . ExeSQl bridges the dialect gap in text- to-Sql, achieving average improvements .
Outcome: ExeSQL bridges the dialect gap in text-to-SQl, with average improvements of 15.2%, 10.38%, and 4.49% over GPT-4o on PostgreSQLE, MySQL, and Oracle.
Addressing Limitations of Encoder-Decoder Based Approach to Text-to-SQL (2022.coling-1)

Copied to clipboard

Challenge: Existing attempts on Text-to-SQL task show a dramatic decline in performance for new databases.
Approach: They propose a hybrid system that integrates rule-based and deep learning components to improve model accuracy.
Outcome: The proposed system achieves double-digit percentage improvement for non-Spider databases.
Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) (D19-61)

Copied to clipboard

Challenge: EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China .
Approach: EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China . call for papers for this second workshop met with a strong response .
Outcome: the EMNLP-IJCNLP 2019 workshop on deep learning approaches for low-resource natural language processing takes place in Hong Kong, China.
Leveraging Training Dynamics and Self-Training for Text Classification (2022.findings-emnlp)

Copied to clipboard

Challenge: Semi-supervised learning (SSL) is a promising technique for improving deep learning models when training data is scarce.
Approach: They propose a semi-supervised learning approach that leverages training dynamics of unlabeled data.
Outcome: The proposed method achieves an average increase in F1 score of 3.5% over baselines in low resource settings.
TTD-SQL: Tree-Guided Token Decoding for Efficient and Schema-Aware SQL Generation (2025.emnlp-industry)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved state-of-the-art accuracy on benchmarks like Spider and BIRD, but inference latency due to sequential autoregressive decoding remains a challenge for real-time deployments.
Approach: a new framework integrates SQL grammar and database schema constraints into the decoding process . tree-Guided Token Decoding (TTD-SQL) precomputes token-level decision trees over SQL keywords, table names, and column identifiers .
Outcome: a new framework reduces schema hallucinations and inference latency due to autoregressive decoding . tree-Guided Token Decoding achieves 19.96% token-rate speedups .
Hey, That’s My Data! Token-Only Dataset Inference in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing dataset inference methods require logit access, but many modern LLMs restrict such access.
Approach: They propose a token-only dataset inference framework that allows models to overwrite prior knowledge when trained on new data.
Outcome: The proposed framework overwrites prior knowledge when trained on new data.
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers (2020.acl-main)

Copied to clipboard

Challenge: Existing semantic parsing models struggle to generalize to unseen database schemas.
Approach: They propose a framework to address schema encoding, schema linking, and feature representation within a text-to-SQL encoder.
Outcome: The proposed framework boosts the match accuracy to 57.2% on the spider dataset, surpassing its best counterparts by 8.7%.
CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions (2024.naacl-long)

Copied to clipboard

Challenge: Recent studies have demonstrated that Large Language Models (LLMs) have impressive capabilities in a variety of domains and tasks.
Approach: They propose a method which prompts LLMs to generate SQL queries based on the previously generated SQL query with an edition chain.
Outcome: The proposed method outperforms different in-context learning baselines and achieves state-of-the-art performance on two benchmarks SParC and CoSQL using LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations