Papers by Rishanth Rajendhran
VeriFastScore: Speeding up long-form factuality evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | VeriFastScore model can be used to evaluate long-form factuality but requires multiple LLM calls and can take up to 100s to evaluate a single response. |
| Approach: | They propose a model that leverages synthetic data to fine-tune Llama3.1 8B for extracting and verifying all verifiable claims within a given text based on evidence from Google Search. |
| Outcome: | The proposed model achieves strong correlation with the original VeriScore pipeline at both the example level and system level while achieving an overall speedup of 6.6 over Veriscore. |
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to measure robustness are problematic, and out-of-domain evaluations are no longer relevant. |
| Approach: | They examine models of different sizes spanning different architectural choices and pretraining objectives. |
| Outcome: | The results show that not all out-of-domain tests provide insight into robustness . merely scaling models does not make them adequately robust . |