Papers by Chenhao Zhang

20 papers
AIDA-SEAT: Towards Reliable AI Doctor Assistant via State-Evaluation-Action Tree Enhanced LLMs in Online Hospital (2026.acl-industry)

Copied to clipboard

Challenge: Existing systems rely on large language models or retrieval-augmented generation (RAG) but these methods lack the explicit logical pathways essential for multi-step reasoning.
Approach: They propose an AIDA-SEAT framework to provide reliable clinical decision-making support by transforming and modifying medical documents and doctors' state-evaluation-action trees.
Outcome: The proposed framework achieves 1.01% higher than current state-of-the-art (SOTA) baselines across five departments, including common RAG-based methods.
Static Models, Dynamic World: A Unified Perspective on Temporal Perception in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models are trained on static corpora but deployed in a dynamic world . a foundational tension remains between time and the ability to understand it .
Approach: They formalize temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers.
Outcome: The proposed framework formalizes temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers . the framework induces four temporal information regimes corresponding to internal reasoning, answer recency, premise anchoring, and genuine world indeterminacy .
Reasoning in a Combinatorial and Constrained World: Benchmarking LLMs on Natural-Language Combinatorial Optimization (2026.findings-acl)

Copied to clipboard

Challenge: NLCO evaluates large language models for combinatorial optimization (CO) . existing evaluations emphasize relatively simple reasoning competencies .
Approach: They propose a combinatorial optimization benchmark that evaluates large language models on CO reasoning.
Outcome: The proposed model can handle combinatorial optimization without writing code or calling external solvers.
WIKIGENBENCH:Exploring Full-length Wikipedia Generation under Real-World Scenario (2025.coling-main)

Copied to clipboard

Challenge: Existing efforts to generate Wikipedia articles for new events fall short of real-world application.
Approach: They propose a benchmark to generate Wikipedia articles for new events under real-world scenarios . they use systematic metrics and LLM-based metrics to assess verifiability, organization, and other aspects aligned with real-life scenarios.
Outcome: The proposed benchmarks show that hierarchical-based methods generate more comprehensive content while fine-tuned methods achieve better verifiability.
Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences lack flexibility . static alignment preferences lack the ability to correct misaligned behaviors as they emerge .
Approach: They propose a framework that enables dynamic and continuous alignment of large language models with human preferences.
Outcome: The proposed framework improves safety and accuracy of a 7B model with human annotations.
FLamE: Few-shot Learning from Natural Language Explanations (2023.acl-long)

Copied to clipboard

Challenge: Recent work has shown limited utility of natural language explanations in improving classification.
Approach: They propose a two-stage few-shot learning framework that generates explanations and fine-tunes a smaller model with generated explanations.
Outcome: The proposed framework increases inference accuracy over strong baselines, but human evaluation reveals that the majority of generated explanations does not adequately justify classification decisions.
Multi-Hop Knowledge Editing via Critic-Guided Multi-Agent Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods rely on unidirectional, feed-forward pipelines . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Approach: They propose a framework for closed-loop post-edit reasoning that uses a Critic agent to verify coherence and step-wise correctness.
Outcome: Experiments on MQuAKE-2002 and MQuADE-hard show that CARE effectively mitigates error propagation . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
CPsyExam: A Chinese Benchmark for Evaluating Psychology using Examinations (2025.coling-main)

Copied to clipboard

Challenge: CPsyExam prioritizes psychological knowledge and case analysis separately, recognizing the significance of applying psychological knowledge to real-world scenarios.
Approach: They propose a psychological benchmark, CPsyExam, constructed from questions from Chinese examination systems.
Outcome: The proposed benchmark prioritizes psychological knowledge and case analysis separately, recognizing the significance of applying psychological knowledge to real-world scenarios.
CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling (2024.findings-acl)

Copied to clipboard

Challenge: Existing datasets lack consulting knowledge, resulting in LLMs lacking professional consulting competence.
Approach: They propose a report-based multi-turn dialogue reconstruction framework for Chinese psychological counseling that uses large language models to assist counseling.
Outcome: The proposed framework is open-source and can be used in future research.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps.
Approach: They propose a framework that reconceptualizes context management as a Next Step Prediction problem.
Outcome: The proposed framework improves task success rates and robust cross-lingual performance.
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach: They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome: The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.
Active Example Selection for In-Context Learning (2022.emnlp-main)

Copied to clipboard

Challenge: In-context learning performance is unstable across samples of examples, suggesting the idiosyncrasies of how language models acquire information.
Approach: They propose a reinforcement learning algorithm for identifying generalizable policies to select demonstration examples and propose 'in-context learning' performance can be highly unstable across samples of examples, suggesting the idiosyncrasies of how language models acquire information.
Outcome: The proposed model can perform tasks with examples with a 5.8% improvement on GPT-2 and GPT-3, but the improvement diminishes on larger models, suggesting emerging capabilities of large language models.
Subgraph-Guided Executable Logical Form Generation for Knowledge Base Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrieval-augmented approaches focus on ignoring the structural information of the Knowledge Base (KB) and the question.
Approach: They propose a structure-aware subgraph retrieval stage that ranks candidate subgraphs by aligning them with the question’s structure, along with semantic relevance.
Outcome: Experiments on GrailQA, WebQSP, and GraphQuestions show that the proposed framework achieves state-of-the-art performance.
Learning to Ignore Adversarial Attacks (2023.eacl-main)

Copied to clipboard

Challenge: Despite the strong performance of current NLP models, they can be brittle against adversarial inputs.
Approach: They propose a rationale model that explicitly learns to ignore adversarial tokens . their approach leads to sizable improvements in robustness over baseline models .
Outcome: The proposed model outperforms data augmentation with adversarial examples and closes the gap between model performance and an attacked test set.
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach: They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome: The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.
SolEval: Benchmarking Large Language Models for Repository-level Solidity Smart Contract Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods focus on Python and Java, neglecting Solidity, the programming language for Ethereum smart contracts.
Approach: They construct a repository-level benchmark for Solidity to evaluate the performance of LLMs on Ethereum.
Outcome: The proposed benchmarks show that the best performing LLM achieves only 26.29% Pass@10, highlighting room for improvement in Solidity code generation.
VRPO: Rethinking Value Modeling for Robust RL under Noisy Supervision in LLM Post-Training (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning (RL) in real-world environments often suffers from ambiguous or incomplete supervision.
Approach: They propose a framework that enhances value modeling for robust RL in LLM post-training by integrating auxiliary losses guided by entropy and perplexity from a frozen language model and variational information bottleneck.
Outcome: The proposed framework outperforms baselines on multi-turn dialogue, math reasoning, and science QA with rule-based and model-based rewards.
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)

Copied to clipboard

Challenge: Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows .
Approach: They propose a repository-level evaluation benchmark to assess security of AI-generated code.
Outcome: The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation.
CompKBQA: Component-wise Task Decomposition for Knowledge Base Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge base question answering methods struggle with complex queries.
Approach: They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation.
Outcome: The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations