| Challenge: | Semantic parsing is an important task that allows to democratize human-computer interaction. |
| Approach: | They construct and complement a Russian text-to-SQL dataset by integrating a spider query with a RAT-SqL and BRIDGE database. |
| Outcome: | The proposed datasets show that they perform well with monolingual training and improved accuracy in multilingual scenarios. |
Similar Papers
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task (D18-1)
Copied to clipboard
Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, Zilin Zhang, Dragomir Radev
| Challenge: | Existing datasets for semantic parsing are too small in terms of number of programs for training modern data-intensive models. |
| Approach: | They propose a large-scale complex and cross-domain semantic parsing task for a database . they use a dataset with 10,181 questions and 5,693 unique complex SQL queries . |
| Outcome: | The proposed task is different from previous tasks because it uses the same database and program . the best model achieves only 9.7% exact matching accuracy on a database split setting. |
Graph Enhanced Cross-Domain Text-to-SQL Generation (D19-53)
Copied to clipboard
| Challenge: | Existing deep learning approaches for semantic parsing do not generalize to unseen data sets . existing benchmarks have shown text-to-SQL parsers do not generally perform well to unsen SQL queries. |
| Approach: | They propose a new cross-domain learning scheme to perform text-to-SQL translation . they demonstrate its use on a large-scale cross- domain text- to-Sql data set Spider . |
| Outcome: | The proposed learning scheme improves on a large-scale text-to-SQL data set. |
A Review of Cross-Domain Text-to-SQL Models (2020.aacl-srw)
Copied to clipboard
| Challenge: | WikiSQL and Spider are cross-domain text-to-SQl datasets that have attracted much attention from the research community. |
| Approach: | They propose to divide top models into two paradigms and evaluate their models for schema linking, pretrained word embeddings, reasoning assistance modules. |
| Outcome: | The proposed models have over 90% execution accuracy, the authors show . the proposed models are more complex and more complex than the proposed ones . |
DuoRAT: Towards Simpler Text-to-SQL Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent text-to-SQL models can translate natural language questions to corresponding SQL queries on unseen databases. |
| Approach: | They propose a re-implementation of the RAT-SQL model that uses only relation-aware or vanilla transformers as the building blocks. |
| Outcome: | The proposed model is based on the spider dataset and shows it can be used on large databases without human intervention. |
Clause-Wise and Recursive Decoding for Complex and Cross-Domain Text-to-SQL Generation (D19-1)
Copied to clipboard
| Challenge: | Existing deep learning approaches for text-to-SQL generation are limited to the WikiSQl dataset . a novel clause-wise decoding neural network model can be used to generate complex queries over multiple databases . |
| Approach: | They propose a SQL clause-wise decoding neural architecture with a schema encoder to address the Spider task. |
| Outcome: | The proposed model achieves 4.6% accuracy gain on the Spider dataset and 9.8% accuracy gain in test and dev sets. |
Exploring Underexplored Limitations of Cross-Domain Text-to-SQL Generalization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL models do not generalize when faced with domain knowledge that does not frequently appear in training data. |
| Approach: | They propose a human-curated dataset based on the Spider benchmark for text-to-SQL translation. |
| Outcome: | The proposed model performs better on unseen domains than existing models on public benchmarks. |
Towards Robustness of Text-to-SQL Models against Synonym Substitution (2021.acl-long)
Copied to clipboard
Yujian Gan, Xinyun Chen, Qiuping Huang, Matthew Purver, John R. Woodward, Jinxia Xie, Pengsheng Huang
| Challenge: | Existing text-to-SQL models rely on lexical matching between words in NL questions and tokens in table schemas, which may break the schema linking mechanism. |
| Approach: | They propose a human-curated dataset for text-to-SQL translation . they replace schema-related words with manually selected synonyms . |
| Outcome: | The proposed model outperforms its counterparts without the defense. |
Improving Generalization in Semantic Parsing by Increasing Natural Language Variation (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches generate question reformulations via models trained on Spider or only introduce local changes. Existing methods generate question form reformulation but lack robustness. |
| Approach: | They use data augmentation to enhance the robustness of text-to-SQL parsers against natural language variations by generating more realistic and diverse questions. |
| Outcome: | The proposed model improves on the new spider dataset by using a few prompts. |
Addressing Limitations of Encoder-Decoder Based Approach to Text-to-SQL (2022.coling-1)
Copied to clipboard
| Challenge: | Existing attempts on Text-to-SQL task show a dramatic decline in performance for new databases. |
| Approach: | They propose a hybrid system that integrates rule-based and deep learning components to improve model accuracy. |
| Outcome: | The proposed system achieves double-digit percentage improvement for non-Spider databases. |
A Pilot Study for Chinese SQL Semantic Parsing (D19-1)
Copied to clipboard
| Challenge: | Existing datasets to map natural language text into SQL are limited in their use in question-to-sql mapping. |
| Approach: | They propose to use a Chinese-based semantic parser to map natural language text into SQL. |
| Outcome: | The proposed dataset compares a character-based parser with a word embedding scheme for Chinese . the results show that the parsers are subject to segmentation errors and cross-lingual embedders are useful for text-to-SQL mapping. |