Papers by Yonghong Deng

2 papers
How Do LLMs and VLMs Understand Viewpoint Rotation Without Vision? An Interpretability Study (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on spatial intelligence from the perspective of visual-spatial intelligence have not explored whether visual intelligence alone is sufficient to endow models with spatial intelligence.
Approach: They propose to use a linguistic perspective to investigate spatial intelligence from a theoretical perspective.
Outcome: The proposed model performs poorly on the proposed dataset while human can easily achieve 100% accuracy.
Where CoT Reasoning Commits: Entropy Traces Identify Interpretable Attention Heads (2026.findings-acl)

Copied to clipboard

Challenge: a growing body of work suggests a disconnect between the generated rationale and the model's actual choice.
Approach: They propose a mechanism-aware framework that interprets the evolving "choice state" of attention heads during CoT generation . they identify a set of intervention targets and perform Selective Head Fine-Tuning .
Outcome: The proposed framework interprets the "choice state" of attention heads during CoT generation . it detects two functional behaviors: Steadfast Heads and Wavering Heads .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations