Papers by Chengyu Song
Can Textual Unlearning Solve Cross-Modality Safety Alignment? (2024.findings-emnlp)
Copied to clipboard
Trishna Chakraborty, Erfan Shayegani, Zikui Cai, Nael Abu-Ghazaleh, M. Salman Asif, Yue Dong, Amit Roy-Chowdhury, Chengyu Song
| Challenge: | integrating new modalities into large language models creates new attack surface . existing safety training techniques like SFT and RLHF are not feasible in multi-modal settings . |
| Approach: | They explore whether unlearning in the textual domain can be effective for cross-modality safety alignment. |
| Outcome: | The proposed approach reduces the Attack Success Rate (ASR) to less than 8% and preserves the utility. |
HEAL: An Empirical Study on Hallucinations in Embodied Agents Driven by Large Language Models (2025.findings-emnlp)
Copied to clipboard
Trishna Chakraborty, Udita Ghosh, Xiaopan Zhang, Fahim Faisal Niloy, Yue Dong, Jiachen Li, Amit Roy-Chowdhury, Chengyu Song
| Challenge: | Large language models are increasingly being adopted as the cognitive core of embodied agents. |
| Approach: | They propose a systematic study of hallucinations in large language models . they aim to understand to what extent hallucinos occur, what types trigger them . |
| Outcome: | The proposed model can induce hallucinations up to 40 higher than base prompts . the model fails to resolve scene-task inconsistencies, the study finds . |