Papers by Mansi Rana
Lightweight Safety Guardrails Using Fine-tuned BERT Embeddings (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing approaches to filter out inappropriate user prompts or system outputs have been successful, but using fine-tuned LLMs as guardrails introduces increased latency and higher maintenance costs. |
| Approach: | They propose to fine-tune a lightweight architecture that reduces the model size from LlamaGuard’s 7 billion parameters to approximately 67 million parameters. |
| Outcome: | Sentence-BERT reduces the model size from 7 billion parameters to approximately 67 million while maintaining comparable performance on the AEGIS safety benchmark. |
Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing methods for zero-shot slot filling focus on text data, overlooking conversational data. |
| Approach: | They propose a method for automatic data annotation with slot induction and black-box knowledge distillation from a teacher LLM to a smaller model. |
| Outcome: | The proposed method outperforms existing models on internal datasets by 26% relative increase in F1 score. |