Papers by Peter Hongler
Too Fast, Too Shallow – LLMs, Including Reasoning LLMs, Are Unreliable Constitutional Reasoners (2026.findings-acl)
Copied to clipboard
| Challenge: | Using three different datasets, we assess LLMs’ constitutional reasoning abilities using three different constitutional frameworks. |
| Approach: | They propose to use the influential dual process theory of cognition to assess LLMs' constitutional reasoning abilities. |
| Outcome: | The LLMs label less than 70% correctly and open-weight reasoning LLM and gpt-4o outperform open- weight non-reasoning LLM. |