Challenge: Existing attempts on Text-to-SQL task show a dramatic decline in performance for new databases.
Approach: They propose a hybrid system that integrates rule-based and deep learning components to improve model accuracy.
Outcome: The proposed system achieves double-digit percentage improvement for non-Spider databases.

Similar Papers

Clause-Wise and Recursive Decoding for Complex and Cross-Domain Text-to-SQL Generation (D19-1)

Copied to clipboard

Challenge: Existing deep learning approaches for text-to-SQL generation are limited to the WikiSQl dataset . a novel clause-wise decoding neural network model can be used to generate complex queries over multiple databases .
Approach: They propose a SQL clause-wise decoding neural architecture with a schema encoder to address the Spider task.
Outcome: The proposed model achieves 4.6% accuracy gain on the Spider dataset and 9.8% accuracy gain in test and dev sets.
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data.
Approach: They propose a framework that imposes strong typing constraints and incorporates key relationships from schema.
Outcome: The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider.
Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect (2022.coling-1)

Copied to clipboard

Challenge: text-to-SQL is a language processing and database-based language processing (NLP) task is to convert natural utterances into SQL queries and its practical application is to build natural language interfaces to database systems.
Approach: They propose to conduct a systematic survey of text-to-SQL to examine the challenges and potential future directions.
Outcome: The proposed system converts natural utterances into SQL queries and is a representative task in semantic parsing.
DuoRAT: Towards Simpler Text-to-SQL Models (2021.naacl-main)

Copied to clipboard

Challenge: Recent text-to-SQL models can translate natural language questions to corresponding SQL queries on unseen databases.
Approach: They propose a re-implementation of the RAT-SQL model that uses only relation-aware or vanilla transformers as the building blocks.
Outcome: The proposed model is based on the spider dataset and shows it can be used on large databases without human intervention.
Graph Enhanced Cross-Domain Text-to-SQL Generation (D19-53)

Copied to clipboard

Challenge: Existing deep learning approaches for semantic parsing do not generalize to unseen data sets . existing benchmarks have shown text-to-SQL parsers do not generally perform well to unsen SQL queries.
Approach: They propose a new cross-domain learning scheme to perform text-to-SQL translation . they demonstrate its use on a large-scale cross- domain text- to-Sql data set Spider .
Outcome: The proposed learning scheme improves on a large-scale text-to-SQL data set.
A Review of Cross-Domain Text-to-SQL Models (2020.aacl-srw)

Copied to clipboard

Challenge: WikiSQL and Spider are cross-domain text-to-SQl datasets that have attracted much attention from the research community.
Approach: They propose to divide top models into two paradigms and evaluate their models for schema linking, pretrained word embeddings, reasoning assistance modules.
Outcome: The proposed models have over 90% execution accuracy, the authors show . the proposed models are more complex and more complex than the proposed ones .
PARSQL: Enhancing Text-to-SQL through SQL Parsing and Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large language models have made significant strides in text-to-SQL tasks, but small language models struggle to accurately interpret natural language questions due to resource limitations.
Approach: They propose a SQL parser that extracts constraints from SQL to generate sub-SQLs . they use a rule-based and LLM-based method to generate step-by-step SQL explanations based on the results .
Outcome: The proposed framework outperforms models with the same model size on BIRD and Spider benchmarks.
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases.
Approach: They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar.
Outcome: The proposed framework can produce high-quality natural language questions over strong baselines.
Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing text-to-SQL models do not generalize when faced with domain knowledge that does not frequently appear in training data.
Approach: They propose a human-curated dataset based on the Spider benchmark for text-to-SQL translation.
Outcome: The proposed model performs better on unseen domains than existing models on public benchmarks.
Improving Generalization in Semantic Parsing by Increasing Natural Language Variation (2024.eacl-long)

Copied to clipboard

Challenge: Existing approaches generate question reformulations via models trained on Spider or only introduce local changes. Existing methods generate question form reformulation but lack robustness.
Approach: They use data augmentation to enhance the robustness of text-to-SQL parsers against natural language variations by generating more realistic and diverse questions.
Outcome: The proposed model improves on the new spider dataset by using a few prompts.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations