Papers by Michael Bernstein
On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning (2023.acl-long)
Copied to clipboard
| Challenge: | Prior work has focused on logical reasoning tasks; it remains unclear whether improvements hold for more diverse types of reasoning, especially in socially situated contexts. |
| Approach: | They perform a controlled evaluation of zero-shot CoT reasoning in two socially sensitive domains: harmful questions and stereotype benchmarks. |
| Outcome: | The results show that zero-shot CoT reasoning increases model’s likelihood to produce harmful or undesirable output, but decreases with improved instruction following. |