Papers by Weihong Lin
HAIC: Improving Human Action Understanding and Generation with Better Captions for Multi-modal Large Language Models (2025.acl-long)
Copied to clipboard
Xiao Wang, Jingyun Hua, Weihong Lin, Yuanxing Zhang, Fuzheng Zhang, Jianlong Wu, Di Zhang, Liqiang Nie
| Challenge: | Existing studies have shown that high-quality video captions can improve MLLMs' performance on videos involving human actions. |
| Approach: | They propose a data annotation pipeline to collect videos featuring clear human actions from the Internet and annotate them in a standardized caption format that uses human attributes to distinguish individuals. |
| Outcome: | The proposed pipeline combines two datasets to evaluate human action understanding. |
Sequential and Repetitive Pattern Learning for Temporal Knowledge Graph Reasoning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to learn temporal evolutional representations of entities are hard to capture the complex temporal patterns such as sequential and repetitive. |
| Approach: | They propose a Sequential and Repetitive Pattern Learning method that captures both sequential and repetitive patterns. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four representative benchmarks on GDELT dataset, where performance improvement of MRR reaches up to 18.84%. |