Papers by Gracjan Góral

Copied to clipboard

Challenge:	Using a framework that combines instruction-following with critical reasoning, we show that the ability of LLMs to override defaults when faced with invalid options is impaired by alignment techniques.
Approach:	They propose a framework for evaluating LLMs’ capacity to balance instruction-following with critical reasoning when presented with multiple-choice questions containing no valid answers.
Outcome:	The proposed framework improves models' ability to override defaults when faced with invalid options while minimizing the impact of model size and training techniques on the model.