Papers by Zhihan Li
Cross-Modal Commentator: Automatic Machine Commenting Based on Cross-Modal Information (P19-1)
Copied to clipboard
| Challenge: | Existing work on commenting based on textual content is focused on other modalities, such as graphics and images. |
| Approach: | They propose a task to integrate multiple modalities into automatic commenting . they construct a large-scale dataset and propose 'co-attention' model to capture dependency between textual and visual information. |
| Outcome: | The proposed model can achieve better performance than baselines. |
Aligning Large Language Models with Implicit Preferences from User-Generated Content (2025.acl-long)
Copied to clipboard
Zhaoxuan Tan, Zheng Li, Tianyi Liu, Haodong Wang, Hyokun Yun, Ming Zeng, Pei Chen, Zhihan Zhang, Yifan Gao, Ruijie Wang, Priyanka Nigam, Bing Yin, Meng Jiang
| Challenge: | Existing preference learning methods rely heavily on curated data from humans or advanced LLMs, which is costly and difficult to scale. |
| Approach: | They propose a framework that leverages implicit preferences in unlabeled user-generated content to generate preference data. |
| Outcome: | The proposed framework transforms user-generated content into user queries and generates responses from the policy model. |
ALERT: An LLM-powered Benchmark for Automatic Evaluation of Recommendation Explanations (2025.naacl-long)
Copied to clipboard
Yichuan Li, Xinyang Zhang, Chenwei Zhang, Mao Li, Tianyi Liu, Pei Chen, Yifan Gao, Kyumin Lee, Kaize Ding, Zhengyang Wang, Zhihan Zhang, Jingbo Shang, Xian Li, Trishul Chilimbi
| Challenge: | Existing benchmarks for recommendation explanation evaluation lack item diversity and user preferences data. |
| Approach: | They propose a model-agnostic recommendation explanation evaluation benchmark based on Amazon e-commerce categories with implicit preferences . they propose two novel automatic evaluators that enable scalable and human-preference aligned evaluation of explanations . |
| Outcome: | The proposed model-agnostic evaluation benchmark outperforms existing methods in a variety of domains. |
IHEval: Evaluating Language Models on Following the Instruction Hierarchy (2025.naacl-long)
Copied to clipboard
Zhihan Zhang, Shiyang Li, Zixuan Zhang, Xin Liu, Haoming Jiang, Xianfeng Tang, Yifan Gao, Zheng Li, Haodong Wang, Zhaoxuan Tan, Yichuan Li, Qingyu Yin, Bing Yin, Meng Jiang
| Challenge: | Instruction-tuned language models (LMs) are increasingly deployed as interactive services across various applications. |
| Approach: | They propose a benchmark to evaluate models' ability to follow the instruction hierarchy by comparing their models to a set of benchmarks. |
| Outcome: | The proposed benchmark covers 3,538 examples across nine tasks covering cases where instructions in different priorities either align or conflict. |
What Are the Implications of Your Question? Non-Information Seeking Question-Type Identification in CNN Transcripts (2024.lrec-main)
Copied to clipboard
| Challenge: | Non-information seeking questions capture subtle dynamics of human discourse . authors use dataset of over 1,500 information-seeking questions and NISQs as benchmark . |
| Approach: | They use a dataset of over 1,500 information-seeking question(ISQ) and NISQ to evaluate human and machine performance on classifying fine-grained NISq types. |
| Outcome: | The proposed corpus is the first publicly available for annotation of non-information seeking questions . it evaluates human and machine performance on classifying fine-grained questions based on models . |
Toward Optimal LLM Alignments Using Two-Player Games (2025.findings-emnlp)
Copied to clipboard
Rui Zheng, Hongyi Guo, Zhihan Liu, Xiaoying Zhang, Yuanshun Yao, Xiaojun Xu, Zhaoran Wang, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang, Yang Liu, Hang Li
| Challenge: | Alignment of large language models (LLM) is a process that ensures the model’s responses to user prompts align with human intentions and social values. |
| Approach: | They propose an alignment method based on a two-agent game consisting of an adversarial agent and a defensive agent. |
| Outcome: | The proposed method improves on a two-agent game with an adversarial agent and a defensive agent. |
MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing chart understanding benchmarks focus on single-chart tasks, neglecting multi-hop reasoning required to extract and integrate information from multiple charts. |
| Approach: | They propose a benchmark that evaluates MLLMs’ capabilities in four key areas: direct question answering, parallel question answering and comparative reasoning. |
| Outcome: | The proposed benchmark evaluates MLLMs’ capabilities in four key areas: direct question answering, parallel question answering and comparative reasoning. |
EmoPrompt-ECPE: Emotion Knowledge-aware Prompt-tuning for Emotion-Cause Pair Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for Emotion-cause pair extraction (ECPE) do not distinguish between the emotion-caused pairs that belong to different types of emotions, limiting their applicability. |
| Approach: | They propose an Emotion-cause pair extraction method which integrates the implicit knowledge of cause clauses into a prompt template and extends the emotion labels to categories with an external emotion word base. |
| Outcome: | The proposed method extracts all potential emotion clauses and corresponding cause clauses from unannotated documents. |
Detecting RAG Extraction Attack via Dual-Path Runtime Integrity Game (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) systems augment large language models with external knowledge, but introduce a critical security vulnerability: Knowledge Base Leakage. |
| Approach: | They propose a runtime defense mechanism inspired by stack canaries in software security . canaryRAG embeds carefully designed canary tokens into retrieved chunks and reformulates RAG extraction defense as a dual-path runtime integrity game. |
| Outcome: | The proposed system can detect and prevent RAG Knowledge Base Leakage in real time . it can be integrated into arbitrary RAG pipelines without retraining or structural modifications . |