Papers with WikiSQL
A Review of Cross-Domain Text-to-SQL Models (2020.aacl-srw)
Copied to clipboard
| Challenge: | WikiSQL and Spider are cross-domain text-to-SQl datasets that have attracted much attention from the research community. |
| Approach: | They propose to divide top models into two paradigms and evaluate their models for schema linking, pretrained word embeddings, reasoning assistance modules. |
| Outcome: | The proposed models have over 90% execution accuracy, the authors show . the proposed models are more complex and more complex than the proposed ones . |
BookSQL: A Large Scale Text-to-SQL Dataset for Accounting Domain (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models for accounting databases that can be queried using natural language are lacking in some domains. |
| Approach: | They propose a large-scale text-to-SQL dataset for accounting and financial domains . they propose 'bookSQl' to be used to query accounting databases using natural language . |
| Outcome: | The proposed model performs poorly on the existing model, pointing towards a more focused model for this domain. |
SQL Generation via Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Text-to-SQL systems can generate SQL queries given natural language questions. |
| Approach: | They propose a method that formulates a question answering problem as a query answering problem where different slots are predicted by a unified machine reading comprehension (MRC) model. |
| Outcome: | The proposed method can achieve competitive results on WikiSQL, suggesting it being a promising direction for text-to-SQl. |
Semantic Parsing with Syntax- and Table-Aware SQL Generation (P18-1)
Copied to clipboard
Yibo Sun, Duyu Tang, Nan Duan, Jianshu Ji, Guihong Cao, Xiaocheng Feng, Bing Qin, Ting Liu, Ming Zhou
| Challenge: | Existing approaches generate a SQL query word-by-word but results are incorrect or not executable due to mismatch between question words and table contents. |
| Approach: | They propose a generative model to map natural language questions into SQL queries. |
| Outcome: | The proposed model significantly improves state-of-the-art execution accuracy from 69.0% to 74.4% on a large question- SQL dataset. |
Natural Language Interface for Databases Using a Dual-Encoder Model (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to train data-driven natural language interfaces for databases are limited and lack of large datasets is probably the main reason for the lack of complex machine learning approaches. |
| Approach: | They propose a sketch-based two-step neural model for generating structured queries based on a user’s request in natural language. |
| Outcome: | The proposed model improves on two recent large datasets suitable for data-driven solutions for natural language interfaces for databases. |
SQLGenie: A Practical LLM based System for Reliable and Efficient SQL Generation (2025.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) enable natural language to SQL conversion, but generating accurate, efficient queries is challenging due to ambiguous intent, domain knowledge requirements and database constraints. |
| Approach: | They propose a system for reliable SQL generation that integrates Table Onboarder, SQL Generator and Feedback Augmentation. |
| Outcome: | The proposed system surpasses the best single-LLM baseline by 21.5% and the strongest pipeline competitor by 5.3% on public benchmarks and internal datasets. |
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers (2021.acl-long)
Copied to clipboard
| Challenge: | Recent large-scale datasets such as Spider and WikiSQL facilitated novel modeling techniques for text-to-SQl parsing. |
| Approach: | They propose a new cross-domain evaluation dataset of real Web databases . they examine the choice of evaluation tasks for text-to-SQL parsers . |
| Outcome: | The proposed model improves accuracy by 13.2% over state-of-the-art parsers in real-life environments. |
Question Generation from SQL Queries Improves Neural Semantic Parsing (D18-1)
Copied to clipboard
| Challenge: | Using question generation, we learn a semantic parser with 30% of the supervised training data. |
| Approach: | They propose to use question generation to learn a semantic parser with less supervised training data. |
| Outcome: | The proposed method improves the state-of-the-art model with less training data. |
What It Takes to Achieve 100% Condition Accuracy on WikiSQL (D18-1)
Copied to clipboard
| Challenge: | despite of its simplicity, none of the publicly reported structured query generation models can achieve an accuracy beyond 62%, which is far from enough for practical use. |
| Approach: | They propose a model that can achieve 88.6% condition accuracy on WikiSQL . they ask: why is the accuracy still low for such simple queries? |
| Outcome: | The proposed solution can reach up to 88.6% condition accuracy on the WikiSQL dataset. |
Weakly Supervised Semantic Parsing by Learning from Mistakes (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Weakly supervised semantic parsing requires searching consistent logical forms in a huge space and dealing with spurious logical form. |
| Approach: | They propose a learning framework that trains parsers via utterance-denotation pairs . they use utterrance-logical form pairs created from mistakes to bootstrap parser . |
| Outcome: | The proposed framework outperforms state-of-the-art methods on WikiSQL, TabFact and other datasets. |
Topic Transferable Table Question Answering (2021.emnlp-main)
Copied to clipboard
Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Jaydeep Sen, Mustafa Canim, Soumen Chakrabarti, Alfio Gliozzo, Karthik Sankaranarayanan
| Challenge: | Weakly-supervised table question-answering (TableQA) models have achieved state-of-art performance by using pre-trained BERT transformer to jointly encoding a question and a table to produce structured query for the question. |
| Approach: | They propose a framework for TableQA that incorporates topic-specific vocabulary injection into BERT, a novel text-to-text transformer generator and a logical form re-ranker. |
| Outcome: | The proposed framework provides a reasonably good baseline for topic shift benchmarks. |
TaPas: Weakly Supervised Table Parsing via Pre-training (2020.acl-main)
Copied to clipboard
| Challenge: | Answering natural language questions over tables is often seen as a semantic parsing task. |
| Approach: | They propose an approach to question answering over tables without generating logical forms by selecting table cells and optionally applying a corresponding aggregation operator. |
| Outcome: | The proposed approach outperforms or rivals existing models on three different datasets and performs on par with the state-of-the-art on WikiSQL and WikiTQ. |
Open-WikiTable : Dataset for Open Domain Question Answering with Complex Reasoning over Table (2023.findings-acl)
Copied to clipboard
| Challenge: | Open-WikiTable is the first open domain question answering dataset that requires complex reasoning over tables. |
| Approach: | They propose to use open-domain question answering over tables to extract questions from tables. |
| Outcome: | The dataset is publicly available. it is built upon WikiSQL and WikiTableQuestions. |
Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study (D19-1)
Copied to clipboard
| Challenge: | Existing semantic parsing technologies are not well-suited for use in real-world applications. |
| Approach: | They propose a model-based intelligent agent that generates a clarification question in natural language . they propose 'interactive semantic parsing' with a human user in the loop . |
| Outcome: | The proposed approach improves both parsing accuracy and user confidence . it is demonstrated on two text-to-SQL datasets with different state-of-the-art parsers . |
An Inner Table Retriever for Robust Table Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Table Question Answering (TableQA) is a task of answering NL user questions using factoid answers extracted from table content. |
| Approach: | They propose a method for handling long tables in TableQA that extracts sub-tables to preserve the most relevant information for a question. |
| Outcome: | The proposed method can improve TableQA's accuracy with up to 1.3-4.8% and achieve state-of-the-art in two benchmarks. |
“What Do You Mean by That?” A Parser-Independent Interactive Approach for Enhancing Text-to-SQL (2020.emnlp-main)
Copied to clipboard
| Challenge: | In Natural Language Interfaces to Databases systems, text-to-SQL parsers allow users to query databases by using natural language questions. |
| Approach: | They propose a parser-independent interactive approach that interacts with users using multi-choice questions and can easily work with arbitrary parsers. |
| Outcome: | The proposed approach improves performance with limited interaction turns by using simulation and human evaluation on two cross-domain datasets with five state-of-the-art parsers. |
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL parsing methods mainly focus on English, but there is no labeled data available for the language . a larges-scale and pragmatic Chinese dataset is used for cross-domain text- to-Sql task . |
| Approach: | They propose a larges-scale Chinese dataset for a cross-domain text-to-SQL task . they analyze questions from several representative applications and use an effective data construction framework . |
| Outcome: | The proposed dataset contains 200 databases, 813 tables, and 23,797 question/SQL pairs. |
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases. |
| Approach: | They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar. |
| Outcome: | The proposed framework can produce high-quality natural language questions over strong baselines. |
Uncovering and Categorizing Social Biases in Text-to-SQL (2023.acl-long)
Copied to clipboard
| Challenge: | Existing Text-to-SQL models are trained on clean, neutral datasets, such as Spider and WikiSQl, but these models contain social bias at different rates. |
| Approach: | They propose to use data to map natural language utterances to SQL queries. |
| Outcome: | The proposed model can contain social bias at different rates in the downstream Text-to-SQL task. |
ToolWriter: Question Specific Tool Synthesis for Tabular Data (2023.emnlp-main)
Copied to clipboard
| Challenge: | Tabular question answering (TQA) requires joint reasoning of natural language with large amounts of semi-structured data. |
| Approach: | They propose to use query-specific programs to generate query-based tools to simplify large tables and detect when to apply them to transform tables. |
| Outcome: | The proposed tool improves state-of-the-art on two tabular question-answering datasets. |