Papers by Jisoo Yang
Selective Test-Time Debiasing for CLIP via Reward Gating (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for debiasing use uniform bias corrections across all input queries . weak debiases retains bias in sensitive queries, while weak dealiases in biased ones . |
| Approach: | They propose a framework that selectively applies debiasing based on input sensitivity . RG-TTA adaptively triggers fairness regularization based upon bias sensitivity of each input . |
| Outcome: | Experiments show that debiasing improves zero-shot performance while maintaining fairness . weak debiased queries distort semantically meaningful information while weak ones fail to mitigate stereotypes . |
Speaking Beyond Language: A Large-Scale Multimodal Dataset for Learning Nonverbal Cues from Video-Grounded Dialogues (2025.acl-long)
Copied to clipboard
Youngmin Kim, Jiwan Chung, Jisoo Kim, Sunghyun Lee, Sangkyu Lee, Junhyeok Kim, Cheoljong Yang, Youngjae Yu
| Challenge: | Existing large language models fail to incorporate nonverbal elements into conversational experiences. |
| Approach: | They propose a multimodal language model that generates nonverbal cues alongside text . their dataset is annotated with time-aligned text, facial expressions, and body language . |
| Outcome: | The proposed model generates nonverbal languages and text, corresponding to conversational input. |