Papers with AoT
Concept-Reversed Winograd Schema Challenge: Evaluating and Improving Robust Reasoning in Large Language Models via Abstraction (2025.naacl-short)
Copied to clipboard
| Challenge: | Recent research has revealed that Large Language Models (LLMs) often experience issues with hallucinations and unreliable reasoning due to semantic associations and superficial logical chains. |
| Approach: | They propose a concept-reversed Winograd Schema Challenge dataset to evaluate the robustness of Large Language Models (LLMs) they propose Abstraction-of-Thought (AoT) method for recovering adversarial cases to normal cases using conceptual abstraction to improve LLMs’ robustness and consistency in reasoning. |
| Outcome: | The proposed method improves LLMs’ robustness and consistency in reasoning under adversarial and long-tail scenarios. |
Abstraction-of-Thought Makes Language Models Better Reasoners (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract reasoning is a key to generalization in human reasoning, but eliciting language models to perform reasoning with abstraction remains unexplored. |
| Approach: | They propose a new structured reasoning format called Abstraction-of-Thought (AoT) this approach elicits language models to first contemplate on the abstract level before incorporating concrete details . |
| Outcome: | The proposed model outperforms the prevailing Chain-of-Thought (CoT) reasoning on 23 unseen tasks. |