Papers by Zhenhua Chen
UAQFact: Evaluating Factual Knowledge Utilization of LLMs on Unanswerable Questions (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets to assess LLMs' performance on unanswerable questions lack factual knowledge support. |
| Approach: | They propose a bilingual unanswerable question dataset with auxiliary factual knowledge created from a Knowledge Graph and two new tasks to measure LLMs' ability to utilize internal and external factual information. |
| Outcome: | The proposed datasets show that LLMs do not consistently perform well even when they have factual knowledge stored. |
Expectation Confirmation Preference Optimization for Multi-Turn Conversational Recommendation Agent (2025.findings-acl)
Copied to clipboard
Xueyang Feng, Jingsen Zhang, Jiakai Tang, Wei Li, Guohao Cai, Xu Chen, Quanyu Dai, Yue Zhu, Zhenhua Dong
| Challenge: | Recent advances in Large Language Models (LLMs) have propelled the development of Conversational Recommendation Agents (CRAs). |
| Approach: | They propose a multi-turn preference optimization paradigm that leverages Expectation Confirmation Theory to explicitly model the evolution of user satisfaction throughout multi-turned dialogues. |
| Outcome: | The proposed paradigm eliminates the significant sampling overhead of existing MTPO methods while ensuring the optimization process drives meaningful improvements. |
PreCo: A Large-scale Dataset in Preschool Vocabulary for Coreference Resolution (D18-1)
Copied to clipboard
| Challenge: | Existing methods for coreference resolution are based on word2vec-like representations of entities. |
| Approach: | They propose a large-scale English dataset for coreference resolution . they use 38K documents and 12.5M words from English-speaking preschoolers . |
| Outcome: | The proposed dataset is more efficient with higher training-test overlap than OntoNotes . the study also shows that mention detection and clustering are more efficient on PreCo . |
Evolutionary Guided Decoding: Iterative Value Refinement for LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for directing language model outputs are limited in their accuracy due to a distributional gap . existing methods train static value functions on trajectories sampled exclusively from the base policy . |
| Approach: | They propose a framework to bridge a distributional gap in the accuracy of value functions . they propose RLHF to align language models with human values and task requirements . |
| Outcome: | The proposed framework reduces computational costs and improves value function accuracy by leveraging principled value function optimization. |
Sparse Black-Box Multimodal Attack for Vision-Language Adversary Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing adversarial attacks using imperceptible perturbations are challenging to simulate . e-commerce product restrictions and hate speech monitoring are examples of such attacks . |
| Approach: | They propose a black-box adversarial attack that leverages sparse perturbations to simulate adversarials exhibited by illegal merchants in the black- box scenario. |
| Outcome: | The proposed method outperforms existing attacks and unimodal attacks by treating images and text in discrete space and outperforming existing models. |
AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack immersion and adaptability, resulting in limited character orchestration and on-the-fly character introduction. |
| Approach: | They propose an LLM-based framework that allows actors to interact with users in an ongoing narrative. |
| Outcome: | The proposed framework outperforms commercial LLMs in character consistency, environment grounding, and narrative coherence. |
SocialEval: Evaluating Social Intelligence of Large Language Models (2025.acl-long)
Copied to clipboard
Jinfeng Zhou, Yuxuan Chen, Yihan Shi, Xuanming Zhang, Leqi Lei, Yi Feng, Zexuan Xiong, Miao Yan, Xunzhi Wang, Yaru Cao, Jianing Yin, Shuai Wang, Quanyu Dai, Zhenhua Dong, Hongning Wang, Minlie Huang
| Challenge: | Existing work on LLMs does not address their social intelligence (SI) and their discrepancy with humans. |
| Approach: | They propose a script-based bilingual SI benchmark that integrates outcome-oriented goal achievement evaluation and process-oriented interpersonal ability evaluation by manually crafting narrative scripts. |
| Outcome: | The proposed model is based on a script-based bilingual evaluation paradigm that integrates outcome- and process-oriented evaluation by manually crafting narrative scripts. |
MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have highlighted the significance of memory mechanisms in LLM-based agents, which enable them to store observed information and adapt to dynamic environments. |
| Approach: | They propose a dataset and benchmark to evaluate the memory capability of LLM-based agents from multiple aspects including their effectiveness, efficiency, and capacity. |
| Outcome: | The proposed benchmark incorporates factual memory and reflective memory as different levels, and proposes participation and observation as various interactive scenarios. |
Filtering before Iteratively Referring for Knowledge-Grounded Response Selection in Retrieval-Based Chatbots (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that FIRE outperforms previous methods for building knowledge-grounded retrieval-based chatbots . a method called Filtering before iteratively referring is used to ground a conversation on background knowledge . |
| Approach: | They propose a method for grounding conversation on background knowledge . they use context filter and knowledge filter to make context and knowledge aware . experimental results show that FIRE outperforms previous methods . |
| Outcome: | The proposed method outperforms previous methods on two datasets. |
Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing mainstream methods for zero-shot cross-lingual named entity recognition ignore the rich and complementary information lying in the intermediate layers of pre-trained language models and domain-invariant information is easily lost during transfer. |
| Approach: | They propose a mixture of short-channel distillers to fully interact the rich hierarchical information in the teacher model and to transfer knowledge to the student model sufficiently and efficiently. |
| Outcome: | The proposed method shows great generalization and compatibility across languages and fields. |
Pre-training Language Model as a Multi-perspective Course Learner (2023.findings-acl)
Copied to clipboard
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
| Challenge: | Experimental results show that our method significantly improves ELECTRA’s average performance by 2.8% and 3.2% absolute points respectively on GLUE and SQuAD 2.0 benchmarks. |
| Approach: | They propose a multi-perspective course learning method to fetch many degrees and visual angles for sample-efficient pre-training and to fully leverage the relationship between generator and discriminator. |
| Outcome: | The proposed method improves ELECTRA's performance on GLUE and SQuAD 2.0 benchmarks and overshadows recent advanced ELECL-style models under the same settings. |
MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigation (2024.acl-long)
Copied to clipboard
| Challenge: | Embodied agents equipped with GPT as their brains have extraordinary decision-making and generalization abilities across various tasks. |
| Approach: | They propose a map-based agent that introduces an online linguistic-formed map to encourage global exploration. |
| Outcome: | The proposed agent achieves state-of-the-art zero-shot performance on R2R and REVERIE simultaneously. |
DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited. |
| Approach: | They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones. |
| Outcome: | The proposed model greatly enhances diversity of dialog response while keeping the coherence. |
Query-Efficient Textual Adversarial Example Generation for Black-Box Attacks (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing black-box attacks require thousands of queries on the target model, making them expensive in real-world applications. |
| Approach: | They propose a new approach that guides word substitutions using prior knowledge from the training set to improve the attack efficiency. |
| Outcome: | The proposed approach reduces query-free attack and guided search attacks by a factor of 10 500 . it improves transferability and generalization by the ensemble of the ABPens in NLP . |
Semantic Sentence Matching via Interacting Syntax Graphs (2022.coling-1)
Copied to clipboard
| Challenge: | Extensive research efforts have been devoted to the task of matching two natural language sentences. |
| Approach: | They propose to embed syntactic structures into an embedding vector and combine them with other features to predict matching scores. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three public datasets and can interpret sentences in interpretable way. |
Crafting Adversarial Examples for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Effective adversary generation for neural machine translation is crucial for robust systems. |
| Approach: | They propose to leverage round-trip translation technique to build valid metrics for evaluating NMT adversarial attacks. |
| Outcome: | The proposed method could break the state-of-art NMT models with small perturbations. |
Learning to Refuse: Towards Mitigating Privacy Risks in LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit remarkable capabilities in understanding and generating natural languages, but can inadvertently memorize private information, posing significant privacy risks. |
| Approach: | They propose to use a dataset to evaluate machine unlearning methods for protecting personal data in a realistic scenario. |
| Outcome: | The proposed model outperforms baseline methods by 5.65 points and protects target individuals’ personal data while maintaining general capabilities. |
Improving Retrospective Language Agents via Joint Policy Gradient Optimization (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have sparked interest in creating autonomous agents. |
| Approach: | They propose a framework that jointly optimizes both task-planning and self-reflective evolution capabilities in language agents. |
| Outcome: | The proposed framework improves task planning and self-reflective evolution capabilities in language agents. |
Unlocking the Effectiveness of LoRA-FP for Seamless Transfer Implantation of Fingerprints in Downstream Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | lightweight plug-and-play framework that encodes backdoor fingerprints into LoRA adapters . |
| Approach: | proposed framework encodes backdoor fingerprints into LoRA adapters via constrained fine-tuning . enables seamless fingerprint transplantation through parameter fusion, eliminating full-parameter updates while maintaining integrity. |
| Outcome: | The proposed framework achieves superior robustness against various scenarios while reducing computational overhead compared to traditional approaches. |
Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time (2026.findings-acl)
Copied to clipboard
Mingkuan Zhao, Yide Gao, Wentao Hu, Suquan Chen, Tianchen Huang, Zhenhua An, Zetao Chang, Xiayu Sun, Yuheng Min
| Challenge: | Existing mitigation strategies rely on suppressing specific neuron activations or employing computationally expensive contrastive decoding mechanisms, which often result in increased perplexity or significantly elevated inference latency. |
| Approach: | They propose a lightweight inference-time intervention method grounded in the perspective of residual stream signal dynamics to resolve the signal attenuation of external evidence during its propagation through deep networks. |
| Outcome: | The proposed method improves contextual faithfulness across multiple factual consistency and strong knowledge-conflict tasks while maintaining the model’s general language understanding capabilities. |
Q-PRM: Adaptive Query Rewriting for Retrieval-Augmented Generation via Step-level Process Supervision (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to rewriting queries often lack supervision signals for intermediate steps . existing approaches rely on outcome-supervised training or heuristic rules to guide the rewrite process . |
| Approach: | They propose a query rewriting framework that generates process-level supervision signals for intermediate steps. |
| Outcome: | a new query rewriting framework outperforms existing approaches on open-domain QA benchmarks. |
Probing Language Models for Pre-training Data Detection (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive capabilities, while raising concerns about the data contamination due to privacy issues and leakage of benchmark datasets in the pre-training phase. |
| Approach: | They propose to utilize the probing technique to examine the model’s internal activations to detect pre-training data contamination by examining the model's internal activates. |
| Outcome: | The proposed method outperforms baselines and achieves state-of-the-art performance on both WikiMIA and ArxivMIA, with additional experiments confirming its efficacy. |
Detecting Speaker Personas from Conversational Texts (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on personas are pre-defined and hard to obtain before a conversation . a new task aims to detect speaker persona based on conversational text . |
| Approach: | They propose a task to detect speaker personas based on conversational text . they build a dataset for SPD and propose utterance-to-profile matching networks . |
| Outcome: | The proposed task outperforms baseline models and utterance-to-profile (U2P) matching networks. |