Papers by Zhange Zhang
Token-Aware Editing of Internal Activations for Large Language Model Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to optimize the behavior of large language models neglect misalignment discrepancies among tokens, resulting in deviant alignment direction and inflexible editing strength. |
| Approach: | They propose a token-aware editing approach to exploit the misalignment discrepancy among tokens to enhance activation probing and facilitate intervention. |
| Outcome: | Extensive experiments on three alignment capabilities demonstrate the efficacy of the proposed approach surpassing baseline by 25.8% on the primary metric of truthfulness with minimal cost. |
Lexical Diversity-aware Relevance Assessment for Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on widely used benchmarks demonstrate the efficacy of our approach, yielding a 10.6% accuracy improvement on HotpotQA. |
| Approach: | They propose a Lexical Diversity-aware RAG method to address the biases in relevant information retrieval and utilization induced by lexical diversity. |
| Outcome: | Extensive experiments on widely used benchmarks show the proposed method yields a 10.6% accuracy improvement on HotpotQA. |