Papers by Seungpil Lee
From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract and Reasoning Corpus (ARC) is a benchmark designed to evaluate reasoning abilities alone by reducing the amount of prior knowledge and data required to solve the tasks. |
| Approach: | They propose a multiple-choice format suitable for assessing stages like Understand and Apply in Large Language Models (LLMs). |
| Outcome: | The proposed model supports analogical reasoning and evidence analysis, but LLMs use shortcuts in the MC-LARC format. |