Papers by Zixu Wang
Contrastive Video-Language Learning with Fine-grained Frame Sampling (2022.aacl-main)
Copied to clipboard
| Challenge: | despite recent progress in video and language representation learning, the weak or sparse correspondence between the two modalities remains a bottleneck. |
| Approach: | They propose a fine-grained contrastive objective for video frame sampling to improve cross-modal correspondence. |
| Outcome: | The proposed approach achieves state-of-the-art performance on YouCookII with long videos. |
Do We Always Need Query-Level Workflows? Rethinking Agentic Workflow Generation for Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches generate workflows either at task level or query level, but their relative costs and benefits remain unclear. |
| Approach: | They propose a query-level workflow generation framework that generates tasks at task level and query level. |
| Outcome: | The proposed framework reduces token usage by up to 83% compared to existing approaches . it maintains competitive performance with an average degradation of just 0.61% compared with existing approaches across multiple datasets . |
Guiding Visual Question Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to Visual Question Generation (VQG) are trained to mimic an arbitrary choice of concept but only one or a few are captured by the human references. |
| Approach: | They propose a variant of Visual Question Generation which conditions the question generator on categorical information based on expectations on the type of question and the objects it should explore. |
| Outcome: | The proposed model improves on the current state of the art on an answer-category augmented VQA dataset and human evaluation validates that guidance helps the generation of questions that are grammatically coherent and relevant to the given image and objects. |
Exploring Supervised and Unsupervised Rewards in Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Autoregressive sequence-to-sequence (seq2sequ) neural architectures have become the de facto approach in Machine Translation (MT). |
| Approach: | They propose to make models less reliant on cross-entropy loss and evaluation metrics . they propose an entropicity-regularised RL method that explores the action space . |
| Outcome: | The proposed method exploits the action space and unsupervised reward function to balance between exploration and exploitation. |
Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging (2025.acl-long)
Copied to clipboard
Zhenyang Cai, Junying Chen, Rongsheng Wang, Weihong Wang, Yonglin Deng, Dingjie Song, Yize Chen, Zixu Zhang, Benyou Wang
| Challenge: | Current research suggests that multitask training outperforms single-task as different tasks can benefit each other, but they often overlook the internal relationships within these tasks. |
| Approach: | They employ compositional generalization (CG) to examine the generalization of multimodal large language models in medical imaging. |
| Outcome: | The proposed model can understand unseen medical images and is able to perform CG across classification and detection tasks. |