Papers by Zonglin Di
T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in text-to-image generative models have produced high quality images with a breakthrough of inference speed. |
| Approach: | They propose a text-to-image association test framework that quantifies implicit stereotypes between concepts and valence and those in images. |
| Outcome: | The proposed framework quantifies implicit stereotypes between concepts and valence and those in images. |
Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning (2024.naacl-long)
Copied to clipboard
| Challenge: | Towards Byzantine-robust federated embodied agent learning, we study the attack and defense for the task of vision-and-language navigation (VLN) |
| Approach: | They propose a new method to defend against a navigation-and-language navigation attack using navigation as wish (NAW) the method provides the server with a 'prompt' of the vision-and language alignment variance between benign and malicious clients so they can be distinguished during training. |
| Outcome: | The proposed method outperforms other state-of-the-art defense methods on two VLN datasets. |