CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases (D19-1)
Copied to clipboard
Tao Yu, Rui Zhang, Heyang Er, Suyi Li, Eric Xue, Bo Pang, Xi Victoria Lin, Yi Chern Tan, Tianze Shi, Zihan Li, Youxuan Jiang, Michihiro Yasunaga, Sungrok Shim, Tao Chen, Alexander Fabbri, Zifan Li, Luyao Chen, Yuwen Zhang, Shreya Dixit, Vincent Zhang, Caiming Xiong, Richard Socher, Walter Lasecki, Dragomir Radev
| Challenge: | CoSQL is a corpus for building cross-domain, general-purpose database querying dialogue systems. |
| Approach: | They present a corpus for building cross-domain, general-purpose database querying dialogue systems . they use a Wizard-of-Oz collection of 3k turns plus 10k+ annotated SQL queries . |
| Outcome: | The proposed corpus is based on a Wizard-of-Oz dataset of 3k dialogues querying 200 complex DBs spanning 138 domains. |
Similar Papers
MultiSQL: A Schema-Integrated Context-Dependent Text2SQL Dataset with Diverse SQL Operations (2024.findings-acl)
Copied to clipboard
| Challenge: | Text2SQL is a task that translates natural language into SQL statements. |
| Approach: | They propose a task that translates natural language into SQL statements. |
| Outcome: | The proposed task enables users to convert natural language into SQL statements. |
Conversing with databases: Practical Natural Language Querying (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Large amount of companies' data is stored in relational databases . quick hypotheses validation is rarely, if ever, possible for majority of nontechnical business stakeholders. |
| Approach: | They propose a hybrid NLQ system for conversational DB querying that allows non-technical users to formulate data requests as natural language questions. |
| Outcome: | The proposed system is based on a hybrid NLQ (Natural Language Querying) system for conversational DB querying. |
CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset (2020.tacl-1)
Copied to clipboard
| Challenge: | Despite the significant contributions to the community, there is still a gap between existing dialogue corpora and real-life human dialogue data. |
| Approach: | They propose to develop Chinese cross-domain wizard-of-oz task-oriented dataset CrossWOZ with rich annotations of dialogue states and dialogue acts on both user and system sides. |
| Outcome: | The proposed dataset contains 6K dialogue sessions and 102K utterances for 5 domains, including hotel, restaurant, attraction, metro, and taxi. |
SPARQL-to-Text Question Generation for Knowledge-Based Conversational Applications (2022.aacl-main)
Copied to clipboard
| Challenge: | a paper focuses on the generation of natural language questions based on SPARQL queries . knowledge-based approaches have become popular in the field of question answering and dialogue . |
| Approach: | This paper focuses on the generation of natural language questions based on SPARQL queries . it uses 4 knowledge-based QA corpora homogenized for the task and a new challenge set is introduced . |
| Outcome: | The proposed task is based on the generation of questions in a conversational context. |
Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect (2022.coling-1)
Copied to clipboard
| Challenge: | text-to-SQL is a language processing and database-based language processing (NLP) task is to convert natural utterances into SQL queries and its practical application is to build natural language interfaces to database systems. |
| Approach: | They propose to conduct a systematic survey of text-to-SQL to examine the challenges and potential future directions. |
| Outcome: | The proposed system converts natural utterances into SQL queries and is a representative task in semantic parsing. |
DialSQL: Dialogue Based Structured Query Generation (P18-1)
Copied to clipboard
| Challenge: | Recent advances in deep learning and semantic parsing have improved the translation accuracy of natural language questions to structured queries. |
| Approach: | They propose a dialogue-based structured query generation framework that leverages human intelligence to boost performance of existing algorithms via user interaction. |
| Outcome: | The proposed framework improves on a WikiSQL dataset from 61.3% to 69.0% using only 2.4 validation questions per dialogue. |
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Tianyu Guo, Hao Liang, Ruitong Liu, Yuying Li, Qifeng Cai, Jingxuan Wei, Yuchen Wu, Bihui Yu, Xiangxiang Zhang, Wentao Zhang, Bin Cui
| Challenge: | Structured Query Language (SQL) is the cornerstone for data-driven decision-making. |
| Approach: | They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework. |
| Outcome: | The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework. |
CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that Large Language Models (LLMs) have impressive capabilities in a variety of domains and tasks. |
| Approach: | They propose a method which prompts LLMs to generate SQL queries based on the previously generated SQL query with an edition chain. |
| Outcome: | The proposed method outperforms different in-context learning baselines and achieves state-of-the-art performance on two benchmarks SParC and CoSQL using LLMs. |
Natural SQL: Making SQL Easier to Infer from Natural Language Specifications (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that do not support executable SQL generation can generate executable queries. |
| Approach: | They propose an SQL intermediate representation called Natural SQL (NatSQL) they propose to preserve the core functionalities of SQL while simplifying the queries . |
| Outcome: | The proposed model outperforms existing models on a text-to-SQL benchmark . it significantly improves the performance of previous models on the same dataset . |
GraphQL Query Generation: A Large Training and Benchmarking Dataset (2024.emnlp-industry)
Copied to clipboard
Manish Kesarwani, Sambit Ghosh, Nitin Gupta, Shramona Chakraborty, Renuka Sindhgatta, Sameep Mehta, Carlos Eberhardt, Dan Debrunner
| Challenge: | GraphQL is a powerful query language for APIs, but crafting complex GraphqL queries can be challenging. |
| Approach: | a team of researchers has created a large-scale, cross-domain text-to-GraphQL query operation dataset . the dataset includes 10,940 training triples spanning 185 cross-source data stores and 957 test triples over 14 data stores. |
| Outcome: | The proposed dataset includes 10,940 training triples and 957 test triples over 14 data stores. |