Capturing Row and Column Semantics in Transformer Based Question Answering over Tables (2021.naacl-main)
Copied to clipboard
Michael Glass, Mustafa Canim, Alfio Gliozzo, Saneem Chemmengath, Vishwajeet Kumar, Rishav Chakravarti, Avi Sil, Feifei Pan, Samarth Bharadwaj, Nicolas Rodolfo Fauceglia
| Challenge: | Existing transformer based approaches have been used to answer questions over tables. |
| Approach: | They propose a transformer based architecture that independently classifies rows and columns to identify relevant cells and a model that incorporates existing tables to improve efficiency. |
| Outcome: | The proposed model outperforms the state-of-the-art transformer based approaches on WikiSQL lookup questions and achieves 3.4% and 18.86% additional precision improvement on the standard WikisQL benchmark. |
Similar Papers
CLTR: An End-to-End, Transformer-Based System for Cell-Level Table Retrieval and Table Question Answering (2021.acl-demo)
Copied to clipboard
| Challenge: | Existing systems that retrieve tables based on keyword queries and table contents often result in poor quality . a growing demand for natural language questions over tables to be used for QA . |
| Approach: | They propose an end-to-end transformer-based table question answering system that takes natural language questions and massive table corpora as inputs to retrieve the most relevant tables. |
| Outcome: | The proposed system can retrieve relevant tables and locate the correct cells to answer questions. |
An Inner Table Retriever for Robust Table Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Table Question Answering (TableQA) is a task of answering NL user questions using factoid answers extracted from table content. |
| Approach: | They propose a method for handling long tables in TableQA that extracts sub-tables to preserve the most relevant information for a question. |
| Outcome: | The proposed method can improve TableQA's accuracy with up to 1.3-4.8% and achieve state-of-the-art in two benchmarks. |
TaPas: Weakly Supervised Table Parsing via Pre-training (2020.acl-main)
Copied to clipboard
| Challenge: | Answering natural language questions over tables is often seen as a semantic parsing task. |
| Approach: | They propose an approach to question answering over tables without generating logical forms by selecting table cells and optionally applying a corresponding aggregation operator. |
| Outcome: | The proposed approach outperforms or rivals existing models on three different datasets and performs on par with the state-of-the-art on WikiSQL and WikiTQ. |
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for answer sentence selection (AS2) are not yet available for AS2 . |
| Approach: | They propose to incorporate paragraph-level semantics within and across documents to improve transformers for AS2 . they propose to use a dataset to predict whether two sentences are extracted from the same paragraph . |
| Outcome: | The proposed model outperforms baseline models on public and industrial datasets on three public and one industrial dataset. |
Multi-Row, Multi-Span Distant Supervision For Table+Text Question Answering (2023.acl-long)
Copied to clipboard
Vishwajeet Kumar, Yash Gupta, Saneem Chemmengath, Jaydeep Sen, Soumen Chakrabarti, Samarth Bharadwaj, Feifei Pan
| Challenge: | Existing question answering systems for tables and linked text are relatively unexplored. |
| Approach: | They propose a transformer-based question answering system that copes with distant supervision along both axes of the question and answer. |
| Outcome: | The proposed system beats baselines for HybridQA and OTT-QA with best EM and F1 scores on a held out test set. |
TableFormer: Robust Transformer Modeling for Table-Text Encoding (2022.acl-long)
Copied to clipboard
| Challenge: | Existing tables models require linearization of the table structure, where row or column order is encoded as an unwanted bias. |
| Approach: | They propose a robust and structurally aware table-text encoding architecture TableFormer where tabular structural biases are incorporated completely through learnable attention biase. |
| Outcome: | The proposed architecture outperforms strong baselines on SQA, WTQ and TabFact table reasoning datasets and achieves state-of-the-art performance on SQ. |
IM-TQA: A Chinese Table Question Answering Dataset with Implicit and Multi-type Table Structures (2023.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks only evaluate model performance on tables with explicit table structures, which means headers are explicitly annotated and treated as model input during inference. |
| Approach: | They propose a new Table Question Answering (TQA) dataset with implicit and multi-type table structures that requires the model to understand tables without directly available header annotations. |
| Outcome: | The proposed framework outperforms baselines on a dataset with implicit and multi-type table structures and can handle multi-table tables including previously neglected complex tables. |
Learning Relational Decomposition of Queries for Question Answering from Tables (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to Table Question-Answering focus on generating answers directly from inputs, but there are limitations when executing numerical operations. |
| Approach: | They propose to imitate a restricted subset of SQL-like algebraic operations and use them to generate a query. |
| Outcome: | The proposed methods bridge the gap between semantic parsing and direct answering methods and offer valuable insights into which types of operations should be predicted by a generative architecture and which should be executed by an external algorithm. |
Permutation Invariant Strategy Using Transformer Encoders for Table Understanding (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for encoding text in tables require additional training and require additional pretraining. |
| Approach: | They propose a novel encoding strategy that preserves the critical property of permutation invariance across rows or columns. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on three table interpretation tasks: column type annotation, relation extraction, and entity linking. |
The Cascade Transformer: an Application for Efficient Answer Sentence Selection (2020.acl-main)
Copied to clipboard
| Challenge: | Recent research shows that transformer-based neural networks can greatly advance the state of the art over many natural language processing tasks. |
| Approach: | They propose a technique to adapt transformer-based models into a cascade of rankers. |
| Outcome: | The proposed technique reduces computation by 37% with almost no impact on accuracy on two English question answering datasets. |