Papers by Yinzhu Quan
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | EconLogicQA requires models to discern and sequence multiple interconnected events, capturing the complexity of economic logics. |
| Approach: | They propose a benchmark to assess the sequential reasoning capabilities of large language models (LLMs) EconLogicQA requires models to discern and sequence multiple interconnected events, capturing the complexity of economic logics. |
| Outcome: | The proposed benchmark is based on a set of multi-event scenarios derived from economic articles and evaluates it across leading-edge LLMs. |