Papers with FlipGuard
Bit-Flip Error Resilience in LLMs: A Comprehensive Analysis and Defense Framework (2025.emnlp-main)
Copied to clipboard
Yuhang Chen, Zhen Tan, Ajay Kumar Jaiswal, Huaizhi Qu, Xinyu Zhao, Qi Lin, Yu Cheng, Andrew Kwong, Zhichao Cao, Tianlong Chen
| Challenge: | Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped. |
| Approach: | They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation . |
| Outcome: | The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs. |
FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in preference alignment have significantly improved Large Language Models' ability to generate texts that align with human preferences and values. |
| Approach: | They propose a constrained optimization approach to detect and mitigate update regression with focal attention. |
| Outcome: | The proposed approach detects and mitigates update regression with focal attention while maintaining excellent overall performance. |