Papers by Yanan Chen
Beyond Memorization: A Rigorous Evaluation Framework for Medical Knowledge Editing (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing methods show promising results on general-domain benchmarks, but their effectiveness in the medical domain remains largely unexplored. |
| Approach: | They propose a framework to evaluate medical knowledge editing using model-generated rationales as editing targets. |
| Outcome: | The proposed method improves editing efficacy and generalization in medical models without full retraining. |
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)
Copied to clipboard
Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou
| Challenge: | Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text. |
| Approach: | They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types. |
| Outcome: | The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages. |
Rethinking Data Augmentation in Text-to-text Paradigm (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to augment training data are limited or marginal, or even diminishing or adverse especially given original training corpus is relatively sufficient or the backbone classifiers are PLM based. |
| Approach: | They propose to integrate text-to-text language models and construct a new two-phase framework for augmentation using two novel schemes. |
| Outcome: | The proposed framework synthesizes new samples benefiting from the knowledge learned from pre-trained language models on two public classification datasets and shows remarkable gains. |
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants (2026.acl-long)
Copied to clipboard
Pei Wang, Yanan Wu, Xiaoshuai Song, Weixun Wang, Gengru Chen, Zhongwen Li, Kezhong Yan, Qi Liu, Ken Deng, Shuaibing Zhao, Shaopan Xiong, Xuepeng Liu, Xuefeng Chen, Wanxi Deng, Wenbo Su, Bo Zheng
| Challenge: | Existing studies on large language model-based agents focus on evaluation benchmarks without training support. |
| Approach: | They propose a large-scale Chinese shopping simulation environment that uses large language models to train agents. |
| Outcome: | The proposed model performs poorly in a large-scale and challenging shopping environment in China. |
Breaking the Stigma! Unobtrusively Probe Symptoms in Depression Disorder Diagnosis Dialogue (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent efforts to improve depression-diagnosis-oriented dialogue systems ignore the Stigma preventing users from open conversations about their struggles. |
| Approach: | They propose a method to promote a sense of unobtrusiveness within the dialogue system and assessing depression disorder by probing symptoms. |
| Outcome: | The proposed method improves on baselines including unobtrusiveness evaluation of dialogue content and diagnostic accuracy. |
SciExplore: Evaluating Autonomous Agents from Scientific Navigation to Information Integration (2026.findings-acl)
Copied to clipboard
Yinhao Tang, Youqing Fang, Yanan Sun, Wenran Liu, Weiming Zhang, Bin Liu, Kuikun Liu, Wenwei Zhang, Kai Chen
| Challenge: | Existing benchmarks emphasize general-domain retrieval or static scientific question answering . SciExplore focuses on scientific database navigation, ambiguous literature retrieval, missing reference completion, and cross-source structured knowledge synthesis tasks. |
| Approach: | They propose a benchmark to evaluate scientific information-seeking and reasoning capabilities of LLMs and agents. |
| Outcome: | The new benchmark assesses the capabilities of state-of-the-art LLMs and agents in scientific research workflows. |
Prompt-Based Metric Learning for Few-Shot NER (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing metric learning methods do not fully incorporate label semantics into modeling. |
| Approach: | They propose a method to largely improve metric learning for few-shot named entity recognition (NER) a pre-defined category is a key natural language understanding task . |
| Outcome: | The proposed method outperforms the previous state-of-the-art (SOTA) method with 16 of 18 settings outperformed previous methods by 9.12% and 34.51% . |
DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to generate empathetic responses are monotonous and generic, resulting in shallow empathy and few connections to the context. |
| Approach: | They propose to use explicit control to guide the empathy expression and a framework DiffusEmp to unify the utilization of dialogue context and attribute-oriented control signals. |
| Outcome: | The proposed framework outperforms baselines on EmpatheticDialogue in terms of controllability, informativeness, diversity, and diversity without the loss of context-relatedness. |
URG: A Unified Ranking and Generation Method for Ensembling Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to rank and generate large language models have limited performance due to time-intensive nature of ranking process and lack of error propagation. |
| Approach: | They propose a framework that jointly ranks the outputs of Large Language Models and generates fine-grained fusion results. |
| Outcome: | The proposed framework achieves state-of-the-art (SOTA) performance on ranking and generation tasks. |
Athena: Safe Autonomous Agents with Verbal Contrastive Learning (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing safety benchmarks on the ability of large language models to perform tasks are lacking. |
| Approach: | They propose a framework that leverages verbal contrastive learning to guide agents towards safety . they use past safe and unsafe trajectories as in-context examples to guide them towards safety. |
| Outcome: | The proposed framework leverages verbal contrastive learning to guide agents towards safety while performing tasks. |
VestaBench: An Embodied Benchmark for Safe Long-Horizon Planning Under Multi-Constraint and Adversarial Settings (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing safety benchmarks do not represent a diverse range of multi-constraint tasks that require long-horizon planning with a focus on safety. |
| Approach: | They propose a benchmark to assess the safety of embodied AI agents under multiple constraints. |
| Outcome: | The proposed benchmarks show that LLMs perform poorly against their tasks . they also suffer significantly compromised safety outcomes . |
FARSS: Fisher-Optimized Adaptive Low-Rank and Singular-Vector Selection for Knowledge-Preserving Fine-Tuning (2026.findings-acl)
Copied to clipboard
Renxing Chen, Ziwei Xiang, Peisong Wang, Hongjian Fang, Meng Li, Fanhu Zeng, Yanan Zhu, Peipei Yang, Xu-Yao Zhang, Jian Cheng
| Challenge: | Low-rank adaptation methods for large language models have limitations in preserving world knowledge and limiting updates to preserve world knowledge. |
| Approach: | They propose a Fisher-optimized adaptive low Rank and Singular-VectorSelection framework for knowledge-preserving fine-tuning that allows efficient and task-sensitive updates. |
| Outcome: | The proposed framework outperforms existing methods for knowledge-preserving fine-tuning. |
Human-Agent Collaborative Paper-to-Page Crafting (2026.findings-acl)
Copied to clipboard
Qianli Ma, Siyu Wang, Chen Yilin, Yinhao Tang, Yixiang Yang, Chang Guo, Bingjie Gao, Zhening Xing, Yanan Sun, Zhipeng Zhang
| Challenge: | Existing approaches to create project pages from academic papers have focused on static slides and posters, but the dynamic nature of webpages remains an unaddressed challenge. |
| Approach: | They propose a novel multi-agent system that deconstructs paper-to-page creation into a coarse-to fine pipeline from narrative planning to multimodal content generation and interactive rendering. |
| Outcome: | The proposed system generates high-quality, visually appealing pages in under 15 minutes for less than $0.1 . |
ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models (2024.findings-acl)
Copied to clipboard
Yanan Wu, Jie Liu, Xingyuan Bu, Jiaheng Liu, Zhanhui Zhou, Yuanxing Zhang, Chenchen Zhang, ZhiqiBai ZhiqiBai, Haibin Chen, Tiezheng Ge, Wanli Ouyang, Wenbo Su, Bo Zheng
| Challenge: | ConceptMath evaluates concept-wise mathematical reasoning of Large Language Models (LLMs) Existing benchmarks that evaluate general mathematical reasoning with an average accuracy fail to probe the fine-grained failure modes of mathematical reasoning on specific datasets. |
| Approach: | They introduce a bilingual, fine-grained benchmark that evaluates concept-wise mathematical reasoning of Large Language Models. |
| Outcome: | The proposed benchmarks evaluate concept-wise mathematical reasoning of Large Language Models with concept-based accuracies. |
Event-Centric Query Expansion in Web Search (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing studies rely on long-term search log mining to improve search experience . EQE system is a novel event retrieval framework that can select the best expansion from a significant amount of potential events quickly and accurately. |
| Approach: | They propose a QE system that uses a four-stage event retrieval framework . they collect news headlines and then refine a dual-tower semantic model to serve as an encoder . |
| Outcome: | The proposed system can select the best expansion from a significant amount of potential events quickly and accurately. |