Papers by Risako Ando
Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason’s Selection Task (2026.eacl-short)
Copied to clipboard
| Challenge: | In humans, reasoning often performs well in domain specific settings, especially in normative rather than purely formal contexts. |
| Approach: | They propose a dataset that explicitly encodes deontic modality to systematically distinguish deontics from descriptive conditionals and analyze LLMs’ conditional reasoning under deontical rules. |
| Outcome: | The proposed dataset systematically distinguishes deontic from descriptive conditionals and examines LLMs’ conditional reasoning under deontics. |
Exploring Reasoning Biases in Large Language Models Through Syllogism: Insights from the NeuBAROCO Dataset (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models of large language reasoning exhibit reasoning biases similar to humans, a study shows . syllogistic reasoning is one of the basic forms of deductive reasoning . |
| Approach: | They propose to use a syllogism dataset to evaluate models' reasoning abilities . they propose to ask LLMs to translate slogismatic slurs into abstract logical expressions . |
| Outcome: | The proposed method shows that models exhibit reasoning biases similar to humans, and that there is room for improvement in reasoning problems where premises and hypotheses are neither entailment nor contradiction. |