Papers by Yubin Zheng
Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recent work has demonstrated the power of large language models in recalling knowledge and reasoning. |
| Approach: | They propose to erase shortcut neurons to mitigate the associated risks . 20% of the failures are attributed to shortcuts, they find . |
| Outcome: | The proposed approach reduces failures in multi-hop knowledge editing caused by shortcuts by 20% . |
Is Continuous Prompt a Combination of Discrete Prompts? Towards a Novel View for Interpreting Continuous Prompts (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the interpretability and transferability of continuous prompts have not been conducted on the subject. |
| Approach: | They propose to interpret continuous prompts as the weighting of discrete prompts by jointly optimizing prompt fidelity and downstream fidelity. |
| Outcome: | The proposed interpretations provide effective readability and plausibility, which is helpful to understand the decision-making of continuous prompts and discover potential shortcuts. |