Papers by Haojie Zhang
Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output (2024.naacl-long)
Copied to clipboard
| Challenge: | Multimodal summarization with multimodal output (MSMO) has attracted increasing research interest . evaluation is an emerging yet underexplored research topic . |
| Approach: | They propose a framework that studies three research questions of MSMO evaluation . they propose an automatic evaluation metric and a meta-evaluation benchmark dataset . |
| Outcome: | The proposed evaluation metric and human-annotated meta-evaluation benchmark are used to assess the quality of evaluation metrics and show the framework is effective. |
Fine-Tuning Encoder-Decoder Models with Contrastive Learning for In-Context Distractor Generation (2025.findings-emnlp)
Copied to clipboard
Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, Mohammed I. Thanoon, Haojie Zhuang, Behnaz Soltani, Munazza Zaib
| Challenge: | Distractors are used to generate plausible but incorrect options for fill-in-the-blank questions . research studies focus on fine-tuning pre-trained models with data augmentation techniques to generate distractors . |
| Approach: | They propose a model that trains the model to recognize essential semantic features necessary to generate distractors. |
| Outcome: | The proposed model outperforms existing models on two public datasets. |
AgentV-RL: Scaling Reward Modeling with Agentic Verifier (2026.findings-acl)
Copied to clipboard
Jiazheng Zhang, Ziche Fu, Zhiheng Xi, Wenqing Jing, Mingxu Chai, Wei He, Guoqiang Zhang, Chenghao Fan, Chenxin An, Wenxiang Chen, Zhicheng Liu, Haojie Pan, Dingwei Zhu, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing approaches to improve LLM reasoning are limited in complex domains and lack external grounding makes verifiers unreliable on computation-intensive tasks. |
| Approach: | They propose a framework that transforms reward modeling into a multi-turn, tool-augmented deliberative process. |
| Outcome: | The proposed framework surpasses state-of-the-art ORMs by 25.2% under parallel and sequential TTS. |
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs (2024.emnlp-main)
Copied to clipboard
Xin Zhou, Ping Nie, Yiwen Guo, Haojie Wei, Zhanqiu Zhang, Pasquale Minervini, Ruotian Ma, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing research seeks to enhance RAG performance by retrieving higher-quality documents or designing RAG-specific LLMs, but internal mechanisms that contribute to RAG’s effectiveness remain underexplored. |
| Approach: | They propose to examine the internal mechanisms within the popular Mixture-of-Expert (MoE)-based LLMs and examine their ability to improve RAG by examining expert activations. |
| Outcome: | The proposed method significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks. |
Self-Guided Alignment: Adaptive Preference Sensing for Multi-Objective Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to align LLMs with diverse human values rely on ground-truth scores . existing approaches implicitly approximate an average-user preference, thereby failing to capture heterogeneity of human values or accommodate conflicting user needs. |
| Approach: | They propose a framework that transforms passive reward dependency into an intrinsic adaptive sensing capability. |
| Outcome: | The proposed framework outperforms state-of-the-art models in multiple model scales and improves preference alignment. |
TransLLM: A Unified Multi-Task Large Language Model for Urban Transportation via Learnable Prompting (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models lack generalization capabilities and lack structured spatiotemporal data. |
| Approach: | They propose a unified multi-task framework that synergizes spatiotemporal encoding with LLM reasoning through learnable prompt composition. |
| Outcome: | The proposed framework outperforms baseline models on seven datasets and three tasks on supervised and zero-shot settings with excellent generalization and robustness. |
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains (2021.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models have been successful in NLP tasks, but their large size and long inference time limit their deployment in real-time applications. |
| Approach: | They propose a meta-teacher model that captures transferable knowledge across domains and passes it to students. |
| Outcome: | The proposed model can distill large teacher models into small student models with guidance from the meta-teacher. |
Beyond Dialogue: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing role-playing training methods often lack profile-dialogue alignment at the sentence level. |
| Approach: | They propose a framework that aligns dialogue with profile traits for each scenario, eliminating biases during training. |
| Outcome: | The proposed model outperforms most proprietary role-playing models and is fully automated and low-cost. |
Trainable Hard Negative Examples in Contrastive Learning for Unsupervised Abstractive Summarization (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for contrastive learning rely on manual negative examples and are poor in quality and adaptability during training. |
| Approach: | They propose a framework that learns trainable negative examples for contrastive learning in unsupervised abstractive summarization by combining a negative example network and a representation network. |
| Outcome: | The proposed approach eliminates the need for manual negative example design and improves on two benchmark datasets. |
Meta Distant Transfer Learning for Pre-trained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Notable PLMs are available for text classification tasks, but performance of PLM on downstream tasks may be limited by the availability of training set. |
| Approach: | They propose a meta-learning framework to learn the transferable knowledge across tasks using PLMs. |
| Outcome: | The proposed framework outperforms baselines on seven datasets and is task-agnostic and unbiased. |
Learning From the Source Document: Unsupervised Abstractive Summarization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for abstractive summarization are under supervised training, but obtaining high-quality and large-scale datasets for supervised learning is laboriously difficult. |
| Approach: | They propose an unsupervised method that leverages contrastive learning to generate summaries by rewriting and paraphrasing the source documents to generate good summary. |
| Outcome: | The proposed method outperforms baseline methods on extensive experiments on source documents and fake documents. |
Better Pre-Training by Reducing Representation Confusion (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to improve pre-trained language models address information confusion in position encoding and model representations. |
| Approach: | They propose two techniques to improve pre-trained language models by decoupling directions and auxiliary regularizers. |
| Outcome: | The proposed techniques can improve pre-trained language models on GLUE benchmarks. |
The More, The Better? A Critical Study of Multimodal Context in Radiology Report Summarization (2025.findings-emnlp)
Copied to clipboard
Mong Yuan Sim, Wei Emma Zhang, Xiang Dai, Biaoyan Fang, Sarbin Ranjitkar, Arjun Burlakoti, Jamie Taylor, Haojie Zhuang
| Challenge: | Current multimodal summarization models often fail to utilize radiology images in summarizing Findings section. |
| Approach: | They conduct a thorough analysis to determine whether current multimodal summarization models can utilize radiology images in summarizing Findings section. |
| Outcome: | The Impression section plays a crucial role in communication between radiologists and physicians. |