Exploring the Compositional Generalization in Context Dependent Text-to-SQL Parsing (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models struggle on the text-to-SQL benchmarks, but we propose a method to improve their generalization ability. |
| Approach: | They propose a method to improve the combinatorial generalization of Text-to-SQL models by aligning previous SQL statements with the input utterance. |
| Outcome: | The proposed method improves the generalization ability of Text-to-SQL models. |
Similar Papers
Exploring Schema Generalizability of Text-to-SQL (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing text-to-SQL models are limited in their generalizability, despite their performance being over-estimated. |
| Approach: | They propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
| Outcome: | The proposed framework generates text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
Measuring and Improving Compositional Generalization in Text-to-SQL via Component Alignment (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing models suffer performance degradation when evaluated on Spider-CG, even though every sub-sentence is seen during training. |
| Approach: | They propose a clause-level compositional example generation method to generate compositional biases from SQL clauses. |
| Outcome: | The proposed method improves generalization performance even on a training dataset. |
Towards Generalizable and Robust Text-to-SQL Parsing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL parsers must be generalizable and robust against input perturbations. |
| Approach: | They propose a novel framework to learn text-to-SQL parsing in stages to improve parser's ability to acquire general SQL knowledge instead of capturing spurious patterns. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the Spider, SParC, and CoSQL datasets. |
Compositional Generalization for Data-to-Text Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Data-to-text generation models can be used to generate textual descriptions from structured data . despite advances, systems struggle when confronted with unseen combinations of predicates . |
| Approach: | They propose a data-to-text generation model that addresses compositional generalization by clustering predicates into groups. |
| Outcome: | The proposed model outperforms T5-baselines in all evaluation metrics. |
Leveraging Explicit Lexico-logical Alignments in Text-to-SQL Parsing (2022.acl-short)
Copied to clipboard
| Challenge: | Text-to-SQL parsing aims to parse natural language questions into SQL queries . current attention-based approaches can only model alignments at the token level . |
| Approach: | They propose a method to leverage explicit lexico-logical alignments by identifying possible phrase-level alignments and injecting them as additional contexts into the parsing procedure. |
| Outcome: | The proposed approach improves performance by 3.4% on Squall. |
Improving Generalization in Language Model-based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-based Techniques (2023.acl-short)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs)2 have been adopted for semantic parsing due to their promising performance and straightforward architectures. |
| Approach: | They propose to use token preprocessing to preserve semantic boundaries of tokens produced by LM tokenizers and special tokens to mark the boundaries of aligned components. |
| Outcome: | The proposed techniques improve the performance of pre-trained language models on two text-to-SQL semantic parsing datasets. |
Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion (2022.acl-long)
Copied to clipboard
| Challenge: | Existing text-to-SQL parsers struggle with out-of-domain generalization problems, arguing that they lack the ability to match domain specific phrases to composite operations over columns. |
| Approach: | They propose to use a synthetic dataset and a re-purposed train/test split to quantify out-of-domain generalization over column operations to address this problem. |
| Outcome: | The proposed method outperforms baseline parsers on the domain generalization problem, while boosting the underlying parser’ overall performance by 13.8% relative accuracy gain (5.1% absolute). |
Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions (D19-1)
Copied to clipboard
Rui Zhang, Tao Yu, Heyang Er, Sungrok Shim, Eric Xue, Xi Victoria Lin, Tianze Shi, Caiming Xiong, Richard Socher, Dragomir Radev
| Challenge: | Generating SQL queries from user utterances is an important task to help end users acquire information from databases. |
| Approach: | They propose a context-dependent text-to-SQL generation task that edits previous queries . they use an utterance-table encoder and a table-aware decoder to incorporate context . |
| Outcome: | The proposed model is flexible to change individual tokens and robust to error propagation. |
MultiSQL: A Schema-Integrated Context-Dependent Text2SQL Dataset with Diverse SQL Operations (2024.findings-acl)
Copied to clipboard
| Challenge: | Text2SQL is a task that translates natural language into SQL statements. |
| Approach: | They propose a task that translates natural language into SQL statements. |
| Outcome: | The proposed task enables users to convert natural language into SQL statements. |
How Do In-Context Examples Affect Compositional Generalization? (2023.acl-long)
Copied to clipboard
| Challenge: | In-context learning paradigms that focus on large corpus are limiting compositional generalization performance. |
| Approach: | They propose a test suite to investigate in-context compositional generalization . they propose to use examples that are structurally similar to the test case . |
| Outcome: | The proposed test suite investigates in-context compositional generalization performance . it finds that the performance can be affected by the selection of in-const examples . |