Papers by Weitong Zhang
Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output (2024.naacl-long)
Copied to clipboard
| Challenge: | Multimodal summarization with multimodal output (MSMO) has attracted increasing research interest . evaluation is an emerging yet underexplored research topic . |
| Approach: | They propose a framework that studies three research questions of MSMO evaluation . they propose an automatic evaluation metric and a meta-evaluation benchmark dataset . |
| Outcome: | The proposed evaluation metric and human-annotated meta-evaluation benchmark are used to assess the quality of evaluation metrics and show the framework is effective. |
Phi: Preference Hijacking in Multi-modal Large Language Models at Inference Time (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models have raised serious safety concerns. |
| Approach: | They propose a method for manipulating the output preference of MLLMs using a preference hijacked image. |
| Outcome: | The proposed method works at inference time and requires no model modifications. |