Papers by Zhiwei Chen

36 papers
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach: They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome: Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.
DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections (2026.findings-acl)

Copied to clipboard

Challenge: Several studies rely on additional models to optimize mixtures.
Approach: They propose a method that dynamically optimizes instruction-tuning dataset mixtures by prior-scaled Boltzmann Exploration and a multi-armed bandit setup.
Outcome: The proposed method improves the TÜLU-2-mixture and TÜLO-3-mixtures across 10 benchmarks while introducing minimal computational overhead over naive sampling.
Draft Model Knows When to Stop: Self-Verification Speculative Decoding for Long-Form Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Conventional speculative decoding methods use a predefined length policy for proposing drafts, but the reality deviates from this assumption.
Approach: They propose a self-verification length policy that adaptively determines the lengths of draft sequences by referring to the draft entropy.
Outcome: The proposed method achieves 17% speedup on MT-Bench and 22% speedup in long-form reasoning.
ActionStudio: A Lightweight Framework for Data and Training of Large Action Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing infrastructure for efficient agentic data processing and model training remains underdeveloped.
Approach: They propose a lightweight and extensible data and training framework for large action models . they propose to unify diverse agent trajectories using Unified Format 2.0 .
Outcome: The proposed framework shows 9 higher throughput than existing frameworks and performs well across public and realistic agent benchmarks.
Bridging the Capability Gap: Joint Alignment Tuning for Harmonizing LLM-based Multi-Agent Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for fine-tuning agents are often inadequate . a multi-agent system can solve complex tasks by dividing responsibilities among specialized agents .
Approach: a new framework is proposed to improve agents collaboration through iterative alignment.
Outcome: The proposed framework outperforms state-of-the-art benchmarks on held-in and held-out tasks.
Youling: an AI-assisted Lyrics Creation System (2020.emnlp-demos)

Copied to clipboard

Challenge: Recent studies have focused on a single pass of lyrics generation with little human intervention.
Approach: They propose an AI-assisted lyrics creation system that supports one pass full-text generation and interactive generation modes.
Outcome: The proposed system supports full-text generation and interactive generation modes . it also provides a revision module which enables users to revise undesired lyrics repeatedly.
Multi-Granularity Semantic Revision for Large Language Model Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating large language models rely on student-generated outputs, which introduce generation errors and misguide the distillation process.
Approach: They propose a multi-granularity semantic revision method for LLM distillation that corrects errors using teacher-generated tokens and re-generates the sequence to minimize errors.
Outcome: The proposed method reduces errors and misguides distillation on student models and improves consistency between teacher and student outputs.
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)

Copied to clipboard

Challenge: Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses.
Approach: They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information.
Outcome: The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average).
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps (2020.acl-main)

Copied to clipboard

Challenge: Existing state-of-the-art VLN agents do not generalize well for long navigation tasks.
Approach: They propose a VLN agent that is learned to navigate by decomposing long instructions into shorter ones and completing them sequentially.
Outcome: The proposed agent can follow long instructions better than existing ones, but it does not generalize well.
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models.
Approach: They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning.
Outcome: The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings.
HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies for named entity recognition focus on flat NER, i.e., without nested entities, by sequence labeling methods.
Approach: They propose a Hierarchical Transformer network which decomposes the input sentence into multi-grained spans and enhances the representation learning in a hierarchical manner.
Outcome: The proposed method achieves much better performance than the state-of-the-art approaches on GENIA, ACE-2004, ace-2005 and NNE datasets.
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for fake news detection focus on fact-checked reports, resulting in limited coverage and debunking delays.
Approach: They propose a Coarse-to-fine Cascaded Evidence-Distillation neural network for explainable fake news detection based on raw reports . they use hierarchical encoders and cascaded selectors to select most explainable sentences for verdicts on top of selected top-K reports based upon raw reports.
Outcome: The proposed model outperforms baseline detection methods and generates high-quality explanations from diverse evaluation perspectives.
Divergent Thinking: Escape the Homogeneity Trap in Generative Commonsense Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Generative commonsense reasoning requires models to synthesize coherent narratives that satisfy lexical constraints and commonsensical logic.
Approach: They propose a framework that allows for deep semantic diversity rather than surface-level lexical variation.
Outcome: The proposed framework achieves over 10% improvement in overall accuracy on NoRa and SPICE score on CommonGen-Lite.
HierDiffuse: Progressive Diffusion for Robust Interest Fusion in CTR Prediction (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches fuse long-term behavioral profiles and short-term interactions, suffering from representational misalignment and noise in transient signals.
Approach: They propose a framework that redefines interest fusion as a hierarchical denoising process through diffusion models.
Outcome: The proposed framework redefines interest fusion as a hierarchical denoising process through diffusion models.
Enriching Word Embeddings with Domain Knowledge for Readability Assessment (C18-1)

Copied to clipboard

Challenge: Existing word embedding models focus on syntactic or semantic relations of words, while ignoring reading difficulty.
Approach: They propose a method which learns the word embedding for readability assessment . they extract the knowledge on word-level difficulty from three perspectives to construct a knowledge graph .
Outcome: The proposed method is effective and potential, the authors show . they use the knowledge-enriched word embedding model on English and Chinese datasets .
MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have showcased significant improvements in mathematics, but traditional benchmarks like GSM8k offer a unidimensional perspective.
Approach: MathBench is a benchmark that rigorously assesses the mathematical capabilities of large language models.
Outcome: MathBench spans a wide range of mathematical disciplines, offering a detailed evaluation of both theoretical understanding and practical problem-solving skills.
All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection (2026.acl-long)

Copied to clipboard

Challenge: RFC-Bench evaluates large language models on financial misinformation under realistic news . current models struggle to maintain coherent belief states without external grounding, study finds .
Approach: They propose a benchmark for evaluating large language models on financial misinformation under realistic news.
Outcome: The proposed model performs better when context is available, while reference-free settings expose significant weaknesses.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
LawBench: Benchmarking Legal Knowledge of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: LegalBench evaluated 20 LLMs in 162 legal tasks in 20 countries and jurisdictions.
Approach: They present a comprehensive evaluation of 21 popular Large Language Models and the first comparative analysis of the empirical results.
Outcome: The proposed benchmarks are based on the Bloom’s cognitive taxonomy and are compared to 21 popular LLMs.
Unraveling the Mystery: Defending Against Jailbreak Attacks Via Unearthing Real Intention (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly vulnerable to elusive and implicit intentions, causing security risks and compromising user experience.
Approach: They propose a method to detect and mitigate implicit jailbreak attacks using LLMs by unearthing real intentions and a greedy gradient-based algorithm to remove the least important parts of a sentence.
Outcome: The proposed method reduces attacks success rate and Harmful Score while maintaining overall model performance.
LocAgent: Graph-Guided LLM Agents for Code Localization (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches struggle to efficiently navigate complex codebases when identifying relevant code snippets.
Approach: They propose a graph-guided agent framework that addresses code localization through a distributed graph-based agent.
Outcome: The proposed framework improves accuracy on real-world benchmarks and can be used to locate code snippets at a cost of 86%.
CHEER: Centrality-aware High-order Event Reasoning Network for Document-level Event Causality Identification (2023.acl-long)

Copied to clipboard

Challenge: Recent studies focus on building a document-level graph for cross-sentence reasoning, but ignore important causal structures.
Approach: They propose a document-level event causality identification model which annotates central events and incorporates event centrality information into the reasoning network.
Outcome: The proposed model performs high-order reasoning while considering event centrality.
Rumor Detection on Twitter with Claim-Guided Hierarchical Graph Attention Networks (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for rumor detection are limited to the strict relation of user responses or oversimplify the conversation structure.
Approach: They propose a method that reinforces interaction of user opinions while reducing negative impact imposed by irrelevant posts.
Outcome: The proposed method improves performance on three Twitter datasets and can detect rumors at early stages.
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing evaluation frameworks suffer from limitations such as static task benchmarks, limited scope, and inadequate integration with practical applications.
Approach: They propose an open-source, Model Context Protocol-based evaluation framework specifically tailored for comprehensive and systematic assessment of LLM-powered agents.
Outcome: The proposed framework uncovers nuanced performance patterns and identify domain-specific strengths and weaknesses, providing valuable insights beyond traditional binary success metrics.
PCBERT: Parent and Child BERT for Chinese Few-shot NER (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches to improve model performance on few-shot or zero-shot datasets are not effective for Chinese few- shot NER.
Approach: They propose a prompt-based Parent and Child BERT for Chinese few-shot NER to train an annotating model on high-resource datasets and then discover more implicit labels on low-resourced datasets.
Outcome: The proposed model can be used on Weibo and other Chinese NER datasets and it is shown to be effective in few-shot learning.
Unsupervised Sign Language Translation and Generation (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results on the BBC-Oxford Sign Language dataset reveal that USLNet achieves competitive results compared to supervised baseline models.
Approach: They propose an unsupervised sign language translation and generation network that learns from abundant single-modality data without parallel sign language data.
Outcome: The proposed model achieves competitive results compared to baseline models on the BBC-Oxford Sign Language dataset and Open-Domain American Sign Language data.
ComRAG: Retrieval-Augmented Generation with Dynamic Vector Stores for Real-time Community Question Answering in Industry (2025.acl-industry)

Copied to clipboard

Challenge: Existing methods for Community Question Answering (CQA) focus on static knowledge, limiting their applicability to real-world scenarios.
Approach: They propose a retrieval-augmented generation framework for real-time industrial CQA that integrates static knowledge with dynamic historical QA pairs via a centroid-based memory mechanism.
Outcome: The proposed framework outperforms baselines on three industrial CQA datasets and achieves 25.9% improvement in vector similarity, reducing latency by 8.7%–23.3%, and lowering chunk growth from 20.23% to 2.06% over iterations.
SLIM: Subtrajectory-Level Elimination for More Effective Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Notable examples include OpenAI’s o1/o3/o4 series and DeepSeek-R1 .
Approach: They develop a framework to identify suboptimal subtrajectories based on human-established criteria . they also use a sampling algorithm to select data whose reasoning process is free from suboptimally subtravertories to the highest degree .
Outcome: The proposed method reduces the number of suboptimal subtrajectories by 25.9% during the inference process.
TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Composed Image Retrieval (CIR) is an image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text.
Approach: They propose a text-oriented entity mapping architecture that allows users to use a reference image and modification text to retrieve a target image.
Outcome: The proposed framework is superior in both original and multi-modification scenarios while maintaining an optimal balance between retrieval accuracy and computational efficiency.
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration (2026.findings-acl)

Copied to clipboard

Challenge: Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices.
Approach: They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration .
Outcome: The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration.
xLAM: A Family of Large Action Models to Empower AI Agent Systems (2025.naacl-long)

Copied to clipboard

Challenge: Autonomous agents powered by large language models (LLMs) have attracted significant research interest, but there are few standards for developing specialized models for agent tasks.
Approach: They propose a series of large action models with dense and mixture-of-expert architectures that unifies, augments, and synthesizes diverse datasets to enhance agent generalizability and performance.
Outcome: The proposed models outperform GPT-4, Claude-3, and many other models in terms of tool use and outperformed GPT-based models on multiple agent ability benchmarks.
Detect Rumors in Microblog Posts for Low-Resource Domains via Adversarial Contrastive Learning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing rumor detection methods are poor at detecting false rumors about breaking news or trending topics due to the lack of training data and prior knowledge.
Approach: They propose an adversarial contrastive learning framework to detect false rumors by adapting features learned from well-resourced rumor data to that of the low-resource.
Outcome: The proposed framework improves on two low-resource datasets and shows superior performance . it overcomes restriction of domain and/or language usage and improves robustness .
Multi-Prompting Decoder Helps Better Language Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to adapt Pre-trained Language Models to downstream tasks are limited by their inference APIs.
Approach: They propose a multi-prompting decoding framework that query PLMs with multiple prompts . they propose to query Plms with optimal transport for hidden states and calibrated decoding for class scores .
Outcome: The proposed framework achieves state-of-the-art results on multiple natural language understanding datasets under the few-shot setting.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations