Papers by Keno Harada
When Instructions Multiply: Measuring and Estimating LLM Capabilities of Multiple Instructions Following (2025.findings-emnlp)
Copied to clipboard
Keno Harada, Yudai Yamazaki, Masachika Taniguchi, Edison Marrese-Taylor, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo
| Challenge: | a large number of languages are increasingly used to evaluate their ability to follow multiple instructions simultaneously. |
| Approach: | They propose two benchmarks to evaluate LLMs' ability to follow multiple instructions simultaneously . they use many instruction-following eval and style-aware Mostly Basic programming problems . |
| Outcome: | The proposed models predict performance on unseen instruction combinations and not used during training with 10% error. |