Papers by Sicheng Lai
Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for unimodal large language models are inadequate for MLLMs due to multimodal data complexity and multi-phase training. |
| Approach: | MM-DETECT analyzes data contamination using a framework that defines two contamination categories - unimodal and cross-modal . |
| Outcome: | The proposed framework quantifies contamination severity across multiple-choice and caption-based Visual Question Answering tasks. |
ViDove: A Translation Agent System with Multimodal Context and Memory-Augmented Reasoning (2025.emnlp-demos)
Copied to clipboard
Yichen Lu, Wei Dai, Jiaen Liu, Ching Wing Kwok, Zongheng Wu, Xudong Xiao, Ao Sun, Sheng Fu, Jianyuan Zhan, Yian Wang, Takatomo Saito, Sicheng Lai
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in Machine Translation (MT) tasks. |
| Approach: | They propose a translation agent system designed for multimodal input that leverages visual and contextual background information to enhance the translation process. |
| Outcome: | The proposed translation agent achieves significantly higher translation quality in subtitle generation and general translation tasks compared to previous state-of-the-art systems. |