Papers by Rahil Parikh
Disentangling Biased Knowledge from Reasoning in Large Language Models via Machine Unlearning (2025.acl-long)
Copied to clipboard
Zheyuan Liu, Suraj Maharjan, Fanyou Wu, Rahil Parikh, Belhassen Bayar, Srinivasan H. Sengamedu, Meng Jiang
| Challenge: | Existing approaches to disentangle biased knowledge from reasoning are sub-optimal . entangled data makes curation difficult, leading to inclusion of sensitive, toxic data. |
| Approach: | They propose a framework that selectively removes biased knowledge while preserving reasoning abilities. |
| Outcome: | The proposed framework improves fairness accuracy by 14.7% and reasoning performance by 62.6% across multiple LLMs. |
Canary Extraction in Natural Language Understanding Models (2022.acl-short)
Copied to clipboard
| Challenge: | Recent literature has focused on Model Inversion Attacks (ModIvA) that can extract training data from model parameters. |
| Approach: | They propose an attack that extracts canaries from NLU training data and reconstructs them using non-sensitive tokens. |
| Outcome: | The proposed attack can reconstruct a four digit code in the training dataset with a probability of 0.5 in its best configuration. |
Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning (2023.acl-short)
Copied to clipboard
Mustafa Ozdayi, Charith Peris, Jack FitzGerald, Christophe Dupuy, Jimit Majmudar, Haidar Khan, Rahil Parikh, Rahul Gupta
| Challenge: | Large Language Models memorize significant portions of training data, which poses privacy risk. |
| Approach: | They propose a prompt-tuning approach to control the extraction rates of memorized content in large language models. |
| Outcome: | The proposed techniques yield 9.3% increase in extraction rate compared to baseline model . the proposed defense achieves 97.7% reduction with a perplexity increase of 16.9% . |