Papers by Shulei Wang
Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding (2025.findings-naacl)
Copied to clipboard
Shulei Wang, Shuai Yang, Wang Lin, Zirun Guo, Sihang Cai, Hai Huang, Ye Wang, Jingyuan Chen, Tao Jin
| Challenge: | Existing chart-related training methods lack capabilities in information extraction, mathematical reasoning, and understanding of multiple chart types. |
| Approach: | They propose a two-stage training strategy and method for jointly training a vision encoder tailored for multi-type charts to address the deficiencies in chart types and limited scope of chart tasks in existing datasets. |
| Outcome: | The proposed dataset includes 21 diverse chart types and tasks, including data retrieval and mathematical reasoning. |
Generative Music Models’ Alignment with Professional and Amateur Users’ Expectations (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent years have witnessed rapid advances in text-to-music generation using large language models. |
| Approach: | They propose a task to align AI-generated music with human expressions . they use a dataset of over 1.5 million songs to analyze their content . |
| Outcome: | The proposed framework outperforms baseline models and facilitates end-to-end generation of songs audio. |
Enhancing Multimodal Unified Representations for Cross Modal Generalization (2025.findings-acl)
Copied to clipboard
Hai Huang, Yan Xia, Shengpeng Ji, Shulei Wang, Hanting Wang, Minghui Fang, Jieming Zhu, Zhenhua Dong, Sashuai Zhou, Zhou Zhao
| Challenge: | Existing studies on discrete unified representations overlook important distinctions between different dimensions of features. |
| Approach: | They propose to use a codebook to optimize unified representations from pretraining and fine- and coarse-grained disentangling to optimize the representations. |
| Outcome: | The proposed methods improve the interpretability of multimodal unified representations . they use training-free optimization of codebook and fine and coarse cross-modal disentangling . |
Chat-Driven Text Generation and Interaction for Person Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Text-based person search (TBPS) aims to retrieve images of a target individual from large-scale databases using natural language descriptions. |
| Approach: | They propose two modules to improve retrieval accuracy and usability . they generate rich pseudo-labels through simulated dialogues with MLLMs . |
| Outcome: | The proposed method achieves competitive or superior results while eliminating the need for manual captions. |
Efficient Prompting for Continual Adaptation to Missing Modalities (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods combine various missing cases to train recovery modules or align multimodal features, resulting in suboptimal performance, high computational costs, and catastrophic forgetting. |
| Approach: | They propose a continual multimodal missing modality task that uses prompts to learn modalities . existing methods often aggregate various missing cases to train recovery modules . authors conduct extensive experiments on three public datasets . |
| Outcome: | The proposed method consistently outperforms state-of-the-art methods on three public datasets. |