Papers by Samarth Bharadwaj

6 papers
Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages (2021.emnlp-main)

Copied to clipboard

Challenge: A study of multilingual fine-tuning yields better performance on downstream NLP applications . low resource languages such as Oriya and Punjabi are found to be the largest beneficiaries of multi-lingual fine tuning.
Approach: They propose to leverage the relatedness of languages that belong to the same family in NLP models by multilingual fine-tuning.
Outcome: The proposed approach improves performance on downstream NLP tasks by 15% compared to monolingual fine-tuning.
Disfluency Correction using Unsupervised and Semi-supervised Learning (2021.eacl-main)

Copied to clipboard

Challenge: Disfluencies in conversational speech can affect performance of downstream NLP tasks.
Approach: They propose a disfluency correction model that converts disfluent to fluent text . they use unsupervised encoder-decoder models to generate semi-supervised models .
Outcome: The proposed model achieves a BLEU score of 79.39 on the Switchboard corpus test set and 85.28 with semi-supervision.
AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry (2022.naacl-industry)

Copied to clipboard

Challenge: Table Question Answering (Table QA) systems have been shown to be highly accurate when trained and tested on open-domain datasets built on top of Wikipedia tables.
Approach: They propose a domain-specific Table QA test dataset to test Table Question Answering systems on open-domain datasets built on top of Wikipedia tables.
Outcome: The proposed methods are highly accurate when tested on open-domain datasets built on top of Wikipedia tables.
Multi-Row, Multi-Span Distant Supervision For Table+Text Question Answering (2023.acl-long)

Copied to clipboard

Challenge: Existing question answering systems for tables and linked text are relatively unexplored.
Approach: They propose a transformer-based question answering system that copes with distant supervision along both axes of the question and answer.
Outcome: The proposed system beats baselines for HybridQA and OTT-QA with best EM and F1 scores on a held out test set.
Topic Transferable Table Question Answering (2021.emnlp-main)

Copied to clipboard

Challenge: Weakly-supervised table question-answering (TableQA) models have achieved state-of-art performance by using pre-trained BERT transformer to jointly encoding a question and a table to produce structured query for the question.
Approach: They propose a framework for TableQA that incorporates topic-specific vocabulary injection into BERT, a novel text-to-text transformer generator and a logical form re-ranker.
Outcome: The proposed framework provides a reasonably good baseline for topic shift benchmarks.
Capturing Row and Column Semantics in Transformer Based Question Answering over Tables (2021.naacl-main)

Copied to clipboard

Challenge: Existing transformer based approaches have been used to answer questions over tables.
Approach: They propose a transformer based architecture that independently classifies rows and columns to identify relevant cells and a model that incorporates existing tables to improve efficiency.
Outcome: The proposed model outperforms the state-of-the-art transformer based approaches on WikiSQL lookup questions and achieves 3.4% and 18.86% additional precision improvement on the standard WikisQL benchmark.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations