Papers by Nishanth Madhusudhan
Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Abstention Ability (AA) is a critical aspect of Large Language Model (LLM) reliability. |
| Approach: | They propose a black-box evaluation approach and a new dataset, Abstain-QA, to rigorously assess AA across varied question types, domains, and task types. |
| Outcome: | The proposed evaluation process and new dataset, Abstain-QA, are crafted to rigorously assess AA across varied question types, domains, and task types. |