Papers by Saneem Chemmengath
AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry (2022.naacl-industry)
Copied to clipboard
Yannis Katsis, Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Mustafa Canim, Michael Glass, Alfio Gliozzo, Feifei Pan, Jaydeep Sen, Karthik Sankaranarayanan, Soumen Chakrabarti
| Challenge: | Table Question Answering (Table QA) systems have been shown to be highly accurate when trained and tested on open-domain datasets built on top of Wikipedia tables. |
| Approach: | They propose a domain-specific Table QA test dataset to test Table Question Answering systems on open-domain datasets built on top of Wikipedia tables. |
| Outcome: | The proposed methods are highly accurate when tested on open-domain datasets built on top of Wikipedia tables. |
Multi-Row, Multi-Span Distant Supervision For Table+Text Question Answering (2023.acl-long)
Copied to clipboard
Vishwajeet Kumar, Yash Gupta, Saneem Chemmengath, Jaydeep Sen, Soumen Chakrabarti, Samarth Bharadwaj, Feifei Pan
| Challenge: | Existing question answering systems for tables and linked text are relatively unexplored. |
| Approach: | They propose a transformer-based question answering system that copes with distant supervision along both axes of the question and answer. |
| Outcome: | The proposed system beats baselines for HybridQA and OTT-QA with best EM and F1 scores on a held out test set. |
Topic Transferable Table Question Answering (2021.emnlp-main)
Copied to clipboard
Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Jaydeep Sen, Mustafa Canim, Soumen Chakrabarti, Alfio Gliozzo, Karthik Sankaranarayanan
| Challenge: | Weakly-supervised table question-answering (TableQA) models have achieved state-of-art performance by using pre-trained BERT transformer to jointly encoding a question and a table to produce structured query for the question. |
| Approach: | They propose a framework for TableQA that incorporates topic-specific vocabulary injection into BERT, a novel text-to-text transformer generator and a logical form re-ranker. |
| Outcome: | The proposed framework provides a reasonably good baseline for topic shift benchmarks. |
Let the CAT out of the bag: Contrastive Attributed explanations for Text (2022.emnlp-main)
Copied to clipboard
| Challenge: | XAI has seen an explosion of interest in explaining black box behavior . contrastive/counterfactual explanations have seen a surge of interest recently . |
| Approach: | They propose a method which provides contrastive explanations for natural language text data with a novel twist by exploiting attribute classifiers. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four benchmark metrics. |
Capturing Row and Column Semantics in Transformer Based Question Answering over Tables (2021.naacl-main)
Copied to clipboard
Michael Glass, Mustafa Canim, Alfio Gliozzo, Saneem Chemmengath, Vishwajeet Kumar, Rishav Chakravarti, Avi Sil, Feifei Pan, Samarth Bharadwaj, Nicolas Rodolfo Fauceglia
| Challenge: | Existing transformer based approaches have been used to answer questions over tables. |
| Approach: | They propose a transformer based architecture that independently classifies rows and columns to identify relevant cells and a model that incorporates existing tables to improve efficiency. |
| Outcome: | The proposed model outperforms the state-of-the-art transformer based approaches on WikiSQL lookup questions and achieves 3.4% and 18.86% additional precision improvement on the standard WikisQL benchmark. |