Papers by Swaprava Nath
One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation (2024.acl-long)
Copied to clipboard
Tejpalsingh Siledar, Swaroop Nath, Sankara Muddu, Rupasai Rangaraju, Swaprava Nath, Pushpak Bhattacharyya, Suman Banerjee, Amey Patil, Sudhanshu Singh, Muthusamy Chelliah, Nikesh Garera
| Challenge: | Existing evaluation methods for opinion summarizations lack adequate opinion summary evaluation datasets. |
| Approach: | They propose a dataset that combines 7 dimensions crucial to opinion summaries . they propose OP-I-PROMPT, a dimension-independent prompt, and OP PROMPTS, . |
| Outcome: | The proposed model achieves a Spearman correlation of 0.70 with human judgments, surpassing prior methods. |
“You are Beautiful, Body Image Stereotypes are Ugly!” BIStereo: A Benchmark to Measure Body Image Stereotypes in Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | BIStereo is a suite of language models that uncover body image stereotypes in language models. |
| Approach: | They propose a metric, TriSentBias, that captures the biased preferences of LMs towards a certain body type over others. |
| Outcome: | The proposed metric captures biased preferences of LMs towards a certain body type over others. |
Product Description and QA Assisted Self-Supervised Opinion Summarization (2024.findings-naacl)
Copied to clipboard
Tejpalsingh Siledar, Rupasai Rangaraju, Sankara Muddu, Suman Banerjee, Amey Patil, Sudhanshu Singh, Muthusamy Chelliah, Nikesh Garera, Swaprava Nath, Pushpak Bhattacharyya
| Challenge: | Existing methods to generate opinion summarization without supervised training data are limited due to the lack of additional sources. |
| Approach: | They propose a synthetic dataset creation strategy that leverages reviews and additional sources to generate a pseudo-summary. |
| Outcome: | The proposed approach achieves 14.5% improvement in ROUGE-1 F1 over existing models. |