Papers with WTQ
Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding (2022.emnlp-industry)
Copied to clipboard
Jun Wang, Patrick Ng, Alexander Hanbo Li, Jiarong Jiang, Zhiguo Wang, Bing Xiang, Ramesh Nallapati, Sudipta Sengupta
| Challenge: | Recent research on Text-to-SQL semantic parsing relies on parser or heuristic based approach to understand natural language query. |
| Approach: | They propose a general-purpose, modular neural semantic parsing framework that is based on token-level fine-grained query understanding. |
| Outcome: | The proposed framework outperforms the state-of-the-art model by 2.7% on a WikiTableQuestions test set. |
TableFormer: Robust Transformer Modeling for Table-Text Encoding (2022.acl-long)
Copied to clipboard
| Challenge: | Existing tables models require linearization of the table structure, where row or column order is encoded as an unwanted bias. |
| Approach: | They propose a robust and structurally aware table-text encoding architecture TableFormer where tabular structural biases are incorporated completely through learnable attention biase. |
| Outcome: | The proposed architecture outperforms strong baselines on SQA, WTQ and TabFact table reasoning datasets and achieves state-of-the-art performance on SQ. |
Faithful Low-Resource Data-to-Text Generation through Cycle Training (2023.acl-long)
Copied to clipboard
| Challenge: | Methods to generate text from structured data have advanced significantly in recent years, but can fail to produce output faithful to the input data, especially on out-of-domain data. |
| Approach: | They evaluate the effectiveness of cycle training by using two models which are inverses of each other to generate text from structured data and one which generates the structured data from natural language text. |
| Outcome: | The proposed approach achieves nearly the same performance as fully supervised approaches on the WebNLG, E2E, WTQ, and WSQL datasets. |
Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments (2024.findings-acl)
Copied to clipboard
Sitao Cheng, Ziyuan Zhuang, Yong Xu, Fangkai Yang, Chaoyun Zhang, Xiaoting Qin, Xiang Huang, Ling Chen, Qingwei Lin, Dongmei Zhang, Saravan Rajmohan, Qi Zhang
| Challenge: | Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables. |
| Approach: | They propose a framework that allows LLMs to efficiently and faithfully reason over structured environments. |
| Outcome: | The proposed framework surpasses state-of-the-art fine-tuned methods on three KGQA and two TableQA datasets and surpasse CWQ and WTQ methods. |
Iterative Search for Weakly Supervised Semantic Parsing (N19-1)
Copied to clipboard
| Challenge: | Recent work has focused on training semantic parsers via weak supervision from denotations alone. |
| Approach: | They propose an iterative training algorithm that alternates between searching for consistent logical forms and maximizing the marginal likelihood of the retrieved ones. |
| Outcome: | The proposed algorithm outperforms the previous best systems on WikiTableQuestions and Cornell Natural Language Visual Reasoning (NLVR) iteratively train models that provide guidance to subsequent models to search for logical forms of increasing complexity, thus dealing with spuriousness. |
RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations (2023.acl-long)
Copied to clipboard
Yilun Zhao, Chen Zhao, Linyong Nan, Zhenting Qi, Wenlin Zhang, Xiangru Tang, Boyu Mi, Dragomir Radev
| Challenge: | Existing Table QA models are vulnerable to task-specific perturbations, such as replacing key question entities or shuffling table columns. |
| Approach: | They propose to use large language models to generate adversarial examples to enhance training, which significantly improves the robustness of Table QA models. |
| Outcome: | The proposed model significantly improves on existing Table QA models against human-annotated adversarial perturbations. |
TACR: A Table Alignment-based Cell Selection Method for HybridQA (2023.findings-acl)
Copied to clipboard
| Challenge: | Hybrid Question-Answering datasets lack a robust reasoning model for text-based QA. |
| Approach: | They propose a table-question-alignment-based cell-selection and reasoning model for hybrid text and table QA. |
| Outcome: | The proposed model outperforms baselines on HybridQA and WikiTableQuestions datasets on cell selection and argumentation. |