Papers by Ya Jing
Towards Unifying Reference Expression Generation and Comprehension (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for REG and REC have distinct inputs and connections between them . a new model for REg and reprehension is needed to solve these problems . |
| Approach: | They propose a unified model for REG and REC that fuses image, region and text . they propose Vision-conditioned Masked Language Modeling and Text-Conditioned Region Prediction . |
| Outcome: | The proposed model outperforms existing models on REG and REC tasks. |
Improving Visual-Semantic Embedding with Adaptive Pooling and Optimization Objective (2023.eacl-main)
Copied to clipboard
Zijian Zhang, Chang Shu, Ya Xiao, Yuan Shen, Di Zhu, Youxin Chen, Jing Xiao, Jey Han Lau, Qian Zhang, Zheng Lu
| Challenge: | Recent VSE models combine simple pooling methods with hard triplet loss to improve performance. |
| Approach: | They propose an adaptive pooling strategy that allows the model to learn how to aggregate features through a combination of simple pooling methods. |
| Outcome: | The proposed strategy outperforms current state-of-the-art systems on image-to-text and text-toimage retrieval. |