Papers by Peter Devine
M-IFEval: Multilingual Instruction-Following Evaluation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Instruction following is a core capability of Large language models (LLMs), making evaluating this capability essential to understanding these models. |
| Approach: | They propose a multilingual instruction following evaluation benchmark that expands to other languages . they propose to use both general and language-specific instructions to evaluate LLMs . |
| Outcome: | The proposed benchmark is extended to French, Japanese, and Spanish . it shows that performance across languages and instruction types can vary widely . |