Papers by Lihao Sun
LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models generate tokens by updating high-dimensional representations and decoding from them at each timestep. |
| Approach: | They propose a framework that allows reasoning correction and length control based on derived ideal trajectories. |
| Outcome: | The proposed model can predict correctness and length control based on ideal trajectories. |
Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race (2025.acl-long)
Copied to clipboard
| Challenge: | et al., 2012) show value-aligned language models exhibit stereotypes in word association tasks . ignoring racial nuances can perpetuate subtle biases in LMs . |
| Approach: | They propose a bias mitigation strategy that incentivizes representation of racial concepts in early model layers. |
| Outcome: | The proposed approach incentivizes representation of racial concepts in early model layers . it reduces implicit bias by reducing the number of ambiguous inputs, the authors show . |