Papers by Zhiwei Liu

37 papers
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach: They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome: Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.
DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections (2026.findings-acl)

Copied to clipboard

Challenge: Several studies rely on additional models to optimize mixtures.
Approach: They propose a method that dynamically optimizes instruction-tuning dataset mixtures by prior-scaled Boltzmann Exploration and a multi-armed bandit setup.
Outcome: The proposed method improves the TÜLU-2-mixture and TÜLO-3-mixtures across 10 benchmarks while introducing minimal computational overhead over naive sampling.
RFS-Guard: Detecting Reasoning Hallucinations via Cross-Phase Routing Focus in Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models (LRMs) generate intermediate reasoning traces before the final answer, yet they remain vulnerable to reasoning hallucinations such as subtle arithmetic errors.
Approach: They propose a Routing Focus Score (RFS) that measures how strongly cross-step attention routing aligns with semantic proximity derived from hidden-state cosine similarity.
Outcome: The proposed framework detects and localizes hallucinations without external tools or repeated sampling.
ActionStudio: A Lightweight Framework for Data and Training of Large Action Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing infrastructure for efficient agentic data processing and model training remains underdeveloped.
Approach: They propose a lightweight and extensible data and training framework for large action models . they propose to unify diverse agent trajectories using Unified Format 2.0 .
Outcome: The proposed framework shows 9 higher throughput than existing frameworks and performs well across public and realistic agent benchmarks.
PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Data (2025.findings-acl)

Copied to clipboard

Challenge: Existing research lacks direct access to such data, making benchmarking difficult due to privacy concerns.
Approach: They propose a synthetic data pipeline that generates realistic user profiles and private documents and a benchmark to evaluate models' ability to understand personal information.
Outcome: The proposed pipeline generates realistic user profiles and private documents, enabling PersonaBench, a benchmark for evaluating models’ ability to understand personal information.
Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reweighting data mixtures rely on manual designation with certain heuristics based on intuition or empirical results.
Approach: They propose a model-based framework that learns to re-weight domains by reinforcement learning on large quantities of data mixing trajectories with corresponding feedback from an evaluation environment.
Outcome: The proposed framework outperforms baselines in achieving balanced performance across source and target fields and domain spaces without retraining.
EXPLAIN: Enhancing Retrieval-Augmented Generation with Entity Summary (2025.acl-industry)

Copied to clipboard

Challenge: Existing document question answering methods reduce inference costs and input tokens.
Approach: They propose a retrieval-augmented generation method that automatically extracts useful entities and generates summaries from documents.
Outcome: The proposed method surpasses baseline retrieval-augmented generation (RAG) and long-context question answering (LC) methods achieve higher accuracy by processing entire documents, but at the cost of increased computational Corresponding authors.
Multi-Granularity Semantic Revision for Large Language Model Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating large language models rely on student-generated outputs, which introduce generation errors and misguide the distillation process.
Approach: They propose a multi-granularity semantic revision method for LLM distillation that corrects errors using teacher-generated tokens and re-generates the sequence to minimize errors.
Outcome: The proposed method reduces errors and misguides distillation on student models and improves consistency between teacher and student outputs.
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI (2024.findings-eacl)

Copied to clipboard

Challenge: DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say .
Approach: They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset .
Outcome: a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data .
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models.
Approach: They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning.
Outcome: The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings.
History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing open-domain dialogue systems conduct one-session conversations, but multi-session MSCs are under-investigated.
Approach: They propose a History-Aware Hierarchical Transformer for multi-session open-domain dialogue . they propose to encode history conversations into a history memory and leverage historical information to generate well-informed responses.
Outcome: The proposed model outperforms baseline models on a large-scale MSC dataset.
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
Divergent Thinking: Escape the Homogeneity Trap in Generative Commonsense Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Generative commonsense reasoning requires models to synthesize coherent narratives that satisfy lexical constraints and commonsensical logic.
Approach: They propose a framework that allows for deep semantic diversity rather than surface-level lexical variation.
Outcome: The proposed framework achieves over 10% improvement in overall accuracy on NoRa and SPICE score on CommonGen-Lite.
HierDiffuse: Progressive Diffusion for Robust Interest Fusion in CTR Prediction (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches fuse long-term behavioral profiles and short-term interactions, suffering from representational misalignment and noise in transient signals.
Approach: They propose a framework that redefines interest fusion as a hierarchical denoising process through diffusion models.
Outcome: The proposed framework redefines interest fusion as a hierarchical denoising process through diffusion models.
MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have showcased significant improvements in mathematics, but traditional benchmarks like GSM8k offer a unidimensional perspective.
Approach: MathBench is a benchmark that rigorously assesses the mathematical capabilities of large language models.
Outcome: MathBench spans a wide range of mathematical disciplines, offering a detailed evaluation of both theoretical understanding and practical problem-solving skills.
All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection (2026.acl-long)

Copied to clipboard

Challenge: RFC-Bench evaluates large language models on financial misinformation under realistic news . current models struggle to maintain coherent belief states without external grounding, study finds .
Approach: They propose a benchmark for evaluating large language models on financial misinformation under realistic news.
Outcome: The proposed model performs better when context is available, while reference-free settings expose significant weaknesses.
FaStFact: Faster, Stronger Long-Form Factuality Evaluations in LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior evaluation pipelines fail to evaluate factuality of long-form LLMs due to inefficiency and costly human assessment.
Approach: They propose a fast and strong evaluation pipeline that can evaluate factuality of long-form LLMs . they propose 'faStFact' to reduce cost of web searching and inference calling .
Outcome: The proposed evaluation pipeline achieves highest alignment with human evaluation and efficiency among existing baselines.
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to Named Entity Recognition (NER) are limited in labeled resources and domain shift.
Approach: They propose a progressive domain adaptation knowledge distillation approach to adapt high-resource domains to low-resourced target domains by employing three components to achieve superior domain adaptability.
Outcome: The proposed approach can adapt high-resource domains to low-resourced target domains even if they are diverse in terms and writing styles.
CHEER: Centrality-aware High-order Event Reasoning Network for Document-level Event Causality Identification (2023.acl-long)

Copied to clipboard

Challenge: Recent studies focus on building a document-level graph for cross-sentence reasoning, but ignore important causal structures.
Approach: They propose a document-level event causality identification model which annotates central events and incorporates event centrality information into the reasoning network.
Outcome: The proposed model performs high-order reasoning while considering event centrality.
LATTE: Learning to Think with Vision Specialists (2025.emnlp-main)

Copied to clipboard

Challenge: Open-source vision-language models excel on simple question-answering tasks, but struggle with complex questions that require both perception and reasoning.
Approach: They propose a family of vision-language models that have LeArned to Think wiTh vision spEcialists by offloading perception to state-of-the-art vision models.
Outcome: The proposed model achieves 4-5% gains over baselines across 6 benchmarks covering both perception and reasoning abilities.
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains.
Approach: They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore.
Outcome: The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore.
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for non-parametric domain adaptation lack kNN retrieval at each timestep, leading to substantial time overhead.
Approach: They propose a kNN-MT-based model that uses a domain-specific translation knowledge store to interpolate the prediction distribution of the model.
Outcome: The proposed model significantly extends kNN-MT with dynamic retrieval on widely-used datasets.
Selective Preference Optimization via Token-Level Reward Function Estimation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for maximizing preference optimization on all available tokens are noisy and inefficient.
Approach: They propose a selective alignment strategy that centers on efficient key token selection without strong, fine-grained supervision signals.
Outcome: The proposed strategy outperforms baseline methods on three benchmarks with up to 60% reduction in training hours.
MarkLLM: An Open-Source Toolkit for LLM Watermarking (2024.emnlp-demo)

Copied to clipboard

Challenge: Large Language Models (LLMs) embed imperceptible yet algorithmically detectable signals in outputs to identify LLM-generated text.
Approach: They propose to develop an open-source toolkit for LLM watermarking that embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text.
Outcome: MarkLLM provides a unified framework for implementing LLM watermarking algorithms, while providing user-friendly interfaces to ensure ease of access.
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing evaluation frameworks suffer from limitations such as static task benchmarks, limited scope, and inadequate integration with practical applications.
Approach: They propose an open-source, Model Context Protocol-based evaluation framework specifically tailored for comprehensive and systematic assessment of LLM-powered agents.
Outcome: The proposed framework uncovers nuanced performance patterns and identify domain-specific strengths and weaknesses, providing valuable insights beyond traditional binary success metrics.
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models face significant challenges in handling long-context tasks because of their limited effective context window size during pretraining, which restricts their ability to generalize over extended sequences.
Approach: They propose a training strategy for extending the context window of LLMs including impactful token analysis, position index transformation, and training optimization strategies.
Outcome: Experiments on three types of LLMs show that LongRecipe can utilize long sequences while requiring only 30% of the target context window size.
R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have shown compelling abilities in reasoning, decision-making, and instruction following.
Approach: They propose a benchmark to evaluate the proficiency of large language models (LLMs) in judging and identifying safety risks given agent interaction records.
Outcome: The proposed model outperforms the best-performing model, GPT-4o, while no other models significantly exceed the random.
RAEmoLLM: Retrieval Augmented LLMs for Cross-Domain Misinformation Detection Using In-Context Learning Based on Emotional Information (2025.acl-long)

Copied to clipboard

Challenge: Current methods for cross-domain misinformation detection focus on in-domain tasks and do not incorporate significant sentiment and emotion features.
Approach: They propose a retrieval augmented (RAG) LLM framework that incorporates affective information into retrieval databases.
Outcome: The proposed framework improves on three misinformation benchmarks.
Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation Learning (2023.acl-long)

Copied to clipboard

Challenge: Existing AES models are either prompt-specific or prompt-adaptive and cannot generalize well on “unseen” prompts.
Approach: They propose a prompt-aware neural AES model to extract comprehensive representation for essay scoring, including both prompt-invariant and prompt-specific features.
Outcome: The proposed model extracts comprehensive representation for essay scoring, including both prompt-invariant and prompt-specific features.
Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing text watermarking technologies lack consistency when texts are translated into different languages.
Approach: They propose a cross-lingual watermark removal attack to bypass watermarking by first obtaining a response from an LLM in a pivot language and then translating it into the target language.
Outcome: The proposed method can remove watermarks without performance loss by obtaining a response from an LLM in a pivot language and then translating it into the target language.
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration (2026.findings-acl)

Copied to clipboard

Challenge: Advanced GUI agents suffer from prohibitive deployment costs on resource-constrained devices.
Approach: They propose a lightweight GUI agent with GUI-specific knowledge and task scalability . LAMO-3B supports monolithic execution and MAS-style orchestration .
Outcome: The proposed GUI agent LAMO-3B supports monolithic execution and MAS-style orchestration.
xLAM: A Family of Large Action Models to Empower AI Agent Systems (2025.naacl-long)

Copied to clipboard

Challenge: Autonomous agents powered by large language models (LLMs) have attracted significant research interest, but there are few standards for developing specialized models for agent tasks.
Approach: They propose a series of large action models with dense and mixture-of-expert architectures that unifies, augments, and synthesizes diverse datasets to enhance agent generalizability and performance.
Outcome: The proposed models outperform GPT-4, Claude-3, and many other models in terms of tool use and outperformed GPT-based models on multiple agent ability benchmarks.
CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing multimodal large language models lack the ability to perceive the visual world with a deep concept structure cognition.
Approach: They propose a concept-level benchmark to assess MLLMs’ hierarchical concept understanding and reasoning abilities.
Outcome: The proposed model outperforms state-of-the-art models in concept structure reasoning evaluation.
Graph-Assisted Large Language Models: A Perspective on Mitigating Intrinsic Limitations (2026.findings-acl)

Copied to clipboard

Challenge: Large language models exhibit intrinsic limitations such as knowledge cutoff, single-threaded reasoning that hinders finer-grained branch and aggregation, and rigid collaboration mechanisms that struggle to coordinate specialized capabilities.
Approach: They propose a taxonomy spanning *Graph-Assisted Knowledge Augmentation*, *Graph Assisted Reasoning and Planning*, and *Graphed LLM Collaboration*.
Outcome: The proposed models show that graphs can augment and correct LLMs and support dynamic coordination among experts and agents in collaborative settings.
SlackAgents: Scalable Collaboration of AI Agents in Workspaces (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing open-source frameworks like LangChain and LlamaIndex fail to integrate into daily workflows, resulting in limited daily usage for work.
Approach: They propose a multi-agent library for scalable management and collaboration of AI agents on Slack.
Outcome: The proposed framework offers instant AI integration into organizational workflows and facilitates scalable collaboration, allowing for effective communication and task orchestration.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations