Papers by Jieming Zhu
CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling (2025.acl-long)
Copied to clipboard
Minghui Fang, Shengpeng Ji, Jialong Zuo, Hai Huang, Yan Xia, Jieming Zhu, Xize Cheng, Xiaoda Yang, Wenrui Liu, Gang Wang, Zhenhua Dong, Zhou Zhao
| Challenge: | Cross-modal retrieval tasks are used to retrieve data from one modality or another based on a query from another modality. |
| Approach: | They propose a generative cross-modal retrieval framework based on coarse-to-fine semantic modeling . they propose combining K-Means and RQ-VAE to discretize multimodal data into token sequences that support autoregressive generation. |
| Outcome: | The proposed framework achieves excellent performance and efficiency in multimodal retrieval tasks. |
MINER: Multi-Interest Matching Network for News Recommendation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods learn a single user embedding from user’s historical behaviors to represent the reading interest. |
| Approach: | They propose a poly attention scheme to learn multiple interest vectors for each user, which encodes the different aspects of user interest. |
| Outcome: | The proposed approach significantly outperforms existing state-of-the-art methods on the MIND news recommendation benchmark. |
Enhancing Multimodal Unified Representations for Cross Modal Generalization (2025.findings-acl)
Copied to clipboard
Hai Huang, Yan Xia, Shengpeng Ji, Shulei Wang, Hanting Wang, Minghui Fang, Jieming Zhu, Zhenhua Dong, Sashuai Zhou, Zhou Zhao
| Challenge: | Existing studies on discrete unified representations overlook important distinctions between different dimensions of features. |
| Approach: | They propose to use a codebook to optimize unified representations from pretraining and fine- and coarse-grained disentangling to optimize the representations. |
| Outcome: | The proposed methods improve the interpretability of multimodal unified representations . they use training-free optimization of codebook and fine and coarse cross-modal disentangling . |
ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment (2025.emnlp-main)
Copied to clipboard
Zhipeng Bian, Jieming Zhu, Qijiong Liu, Wang Lin, Guohao Cai, Zhaocheng Du, Jiacheng Sun, Zhou Zhao, Zhenhua Dong
| Challenge: | Large language models and diffusion models have opened new possibilities for AI-generated content . personalized cover image generation remains underexplored despite its critical role in boosting user engagement on digital platforms. |
| Approach: | They propose a framework that integrates MLLM-based prompting with personalized preference alignment to generate high-quality, contextually relevant covers. |
| Outcome: | The proposed framework improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy in downstream tasks. |
RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation (2025.emnlp-main)
Copied to clipboard
Sashuai Zhou, Weinan Gan, Qijiong Liu, Ke Lei, Jieming Zhu, Hai Huang, Yan Xia, Ruiming Tang, Zhenhua Dong, Zhou Zhao
| Challenge: | Existing methods for addressing item-level user interests are lacking in cross-domain generalization . RecBase model is domain-agnostic and can be used to enhance recommender systems' effectiveness . |
| Approach: | They propose a domain-agnostic foundational model pretrained with a recommendation-oriented objective that leverages a large-scale, heterogeneous, cross-domain corpus with unified textual representations and feature mappings to enhance cross- domain generalization. |
| Outcome: | The proposed model matches or surpasses baselines in zero-shot and cross-domain recommendation tasks on eight real-world datasets. |
Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation (2022.coling-1)
Copied to clipboard
| Challenge: | Personalized news recommendation is a ubiquitous channel in various online applications, such as Google News and MSN News. |
| Approach: | They propose a plug-and-play pre-trainer to learn both user and news encoders through multi-task pre-training. |
| Outcome: | The proposed model improves on existing models and improves inference and updating time. |
MIRA: Empowering One-Touch AI Services on Smartphones with MLLM-based Instruction Recommendation (2025.acl-industry)
Copied to clipboard
| Challenge: | generative AI is revolutionizing how users interact with smartphones, transforming how they interact with them. |
| Approach: | They propose a framework for task instruction recommendation that enables intuitive one-touch AI tasking on smartphones. |
| Outcome: | The proposed framework shows significant improvements in recommendation accuracy and coherence and intent alignment with predefined instruction candidates. |