Papers by Bhargavi Paranjape
An Information Bottleneck Approach for Controlling Conciseness in Rationale Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to condition models on a concise rationale are less accurate than models that can use the entire context. |
| Approach: | They propose a method to optimize a bound on the Information Bottleneck objective to extract concise rationales from a binary mask and an end-task predictor that uses only the residual sentences. |
| Outcome: | The proposed model outperforms existing norm-minimization techniques in task performance and agreement with human rationales in the ERASER benchmark. |
FiD-Ex: Improving Sequence-to-Sequence Models for Extractive Rationale Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained sequence to sequence models are effective in making and generating NL explanations, but they have many shortcomings. |
| Approach: | They propose a model that uses sentence markers to eliminate explanation fabrication . they use fusion-in-decoder architecture to handle long input contexts . |
| Outcome: | The proposed model significantly improves on the ERASER explainability benchmark. |
PuMer: Pruning and Merging Tokens for Efficient Vision Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large-scale vision language models use Transformers to perform cross-modal interactions . state-of-the-art models are memory intensive and expensive due to quadratic complexity . |
| Approach: | They propose a token reduction framework that uses text-informed Pruning and modality-aware Merging strategies to progressively reduce the tokens of input image and text. |
| Outcome: | The proposed framework improves inference speed and memory footprint on four vision language tasks. |
Prompting Contrastive Explanations for Commonsense Reasoning Tasks (2021.findings-acl)
Copied to clipboard
| Challenge: | Large pretrained language models (PLMs) can achieve near-human performance on commonsense reasoning tasks, but provide little human-interpretable evidence of the underlying reasoning they use. |
| Approach: | They propose to use large pretrained language models to generate evidence for commonsense reasoning NLP tasks . they use models to contrast alternative explanations based on key attribute(s) required to justify the correct answer . |
| Outcome: | The proposed model improves performance on two commonsense reasoning benchmarks compared to previous non-contrastive alternatives. |
Measuring and Improving Attentiveness to Partial Inputs with Counterfactuals (2024.findings-emnlp)
Copied to clipboard
Yanai Elazar, Bhargavi Paranjape, Hao Peng, Sarah Wiegreffe, Khyathi Chandu, Vivek Srikumar, Sameer Singh, Noah Smith
| Challenge: | Existing studies have found that datasets with paired inputs are prone to spurious correlations, resulting in models trained only on those outperform chance. |
| Approach: | They propose a counterfactual attentiveness test to measure reliance on spurious correlations by replacing part of the input with its counterpart from a different example. |
| Outcome: | The proposed method improves models' attentiveness on ten datasets spanning four tasks: natural language inference, reading comprehension, paraphrase detection, and visual & language reasoning. |
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on counterfactual data augmentation only considered restricted classes of perturbations, limiting their effectiveness. |
| Approach: | They propose a retrieval-augmented framework for creating diverse counterfactual perturbations for CDA. |
| Outcome: | Experiments on natural language inference and sentiment analysis show that the proposed framework can be used to encourage diversity in manually authored perturbations. |
Retrieval-guided Counterfactual Generation for QA (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work shows that data augmentation using counterfactuals can help ameliorate this weakness. |
| Approach: | They propose a Retrieve-Generate-Filter technique to generate counterfactuals using QA framework and question generation model trained on original task data. |
| Outcome: | The proposed method improves performance on out-of-domain and challenging evaluation sets over and above existing methods. |
Entity Projection via Machine Translation for Cross-Lingual NER (D19-1)
Copied to clipboard
| Challenge: | a subset of languages have large annotated corpora for named entity recognition. |
| Approach: | They propose a system that leverages machine translation systems twice to improve named entity recognition. |
| Outcome: | The proposed system outperforms existing methods on Armenian languages by 4.1 points . it achieves state-of-the-art F_1 scores for Armenian, outperforming monolingual model trained on Armenia. |