Papers by Zijun Gao
Dual-Phase Accelerated Prompt Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for prompt optimization make light of the importance of high-quality initialization and the identification of effective directions. |
| Approach: | They propose a method which uses a meta-instruction to generate high-quality initial prompts and iteratively optimize them at the sentence level. |
| Outcome: | The proposed method achieves consistent accuracy gain over baselines with less than five optimization steps. |
Images Speak Louder than Words: Understanding and Mitigating Bias in Vision-Language Model from a Causal Mediation Perspective (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current methods to learn biases from the perspective of model components are limited by their complexity and performance. |
| Approach: | They propose a framework that incorporates causal mediation analysis to measure and map the pathways of bias generation and propagation within vision-language and multimodal tasks. |
| Outcome: | The proposed framework is applicable to a wide range of vision-language and multimodal tasks and reduces bias by 22.03% and 9.04% in the MSCOCO and PASCAL-SENTENCE datasets. |