Papers by Ziqi Wang

26 papers
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach: They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome: Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.
Calibration-Aware Policy Optimization for Reasoning LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to model calibration are limited or sacrifice gains in reasoning accuracy.
Approach: They propose a method that improves calibration by 15% while boosting accuracy by 5% . they propose GRPO-style algorithms that misalign uncertainty-agnostic advantage estimation .
Outcome: The proposed approach improves calibration by 15% while achieving comparable to or better than GRPO on multiple mathematical reasoning benchmarks.
Uncertainty-Aware Routing for Principled Alignment with MoE Dynamics (2026.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) is a cornerstone for scaling LLMs, yet its training dynamics remain poorly understood, often leading to sub-optimal specialization.
Approach: They propose to use Helmholtz Free Energy and Router Entropy to study the MoE lifecycle and identify a universal Three-Stage Phase Transition .
Outcome: The proposed model reduces perplexity and improves expert distinctiveness, offering a principled path toward thermodynamically aligned computation.
MAVEN: A Massive General Domain Event Detection Dataset (2020.emnlp-main)

Copied to clipboard

Challenge: Existing datasets exhibit data scarcity and limited coverage of general-domain events.
Approach: They present a MAssive eVENt detection dataset which contains 4,480 Wikipedia documents and 168 event types.
Outcome: The proposed dataset shows that existing methods cannot achieve promising results on the small datasets.
Knowledge-augmented Financial Market Analysis and Report Generation (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing methods to generate financial market analysis text require extensive financial knowledge and skill of financial analysts.
Approach: They propose a task to generate financial market analysis reports using financial market data using a financial knowledge graph.
Outcome: The proposed framework outperforms large-scale language models and retrieval-augmented baselines in the financial market analysis generation task.
Entailment-Preserving First-order Logic Representations in Natural Language Entailment (2025.acl-long)

Copied to clipboard

Challenge: First-order logic (FOL) is often used to represent logical entailment, but determining natural language (NL) enanglement using FOL remains a challenge.
Approach: They propose an Entailment-Preserving FOL representations task and a method which trains an NL-to-FOL translator by using the natural language entailment labels as verifiable rewards.
Outcome: The proposed method achieves 1.8–2.7% improvement in EPR and 17.4–20.6% increase in E PR@16 compared to baselines in three datasets.
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval.
Approach: They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs).
Outcome: The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models.
Granular Entity Mapper: Advancing Fine-grained Multimodal Named Entity Recognition and Grounding (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for fine-grained content extraction are limited by long-tailed distribution of textual entity categories and performance of object detectors.
Approach: They propose a multi-granularity entity recognition module and a reranking module to integrate hierarchical information of entity categories, visual cues, and external textual resources collectively.
Outcome: The proposed framework achieves state-of-the-art on the fine-grained content extraction task.
SPIDE: Serial and Parallel Intertwined Speculative Decoding (2026.findings-acl)

Copied to clipboard

Challenge: Speculative decoding (SD) is a training-free SD framework that orchestrates dynamic alternation combining serial dynamic drafting with parallel draft verification.
Approach: They propose a serial and parallel intertwined speculative DEcoding framework that orchestrates dynamic alternation combining serial dynamic drafting and parallel draft verification.
Outcome: The proposed framework accelerates inference while reducing the LLM usage costs.
RAM-SD: Retrieval-Augmented Multi-agent framework for Sarcasm Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to sarcastic detection use a uniform reasoning strategy . existing approaches lack a framework to deal with the diverse analytical demands of sarcasm .
Approach: They propose a Retrieval-Augmented Multi-Agent framework for Sarcasm Detection . the framework provides transparent and interpretable reasoning traces .
Outcome: The proposed framework outperforms existing methods on four benchmarks and outperformed the strong GPT-4o+CoC baseline.
CLEVE: Contrastive Pre-training for Event Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing EE methods do not model event characteristics from large unsupervised data.
Approach: They propose a contrastive pre-training framework for event extraction to better learn event knowledge from large unsupervised data and their semantic structures.
Outcome: The proposed framework improves on ACE 2005 and MAVEN datasets on event extraction tasks.
COVID-19 Claim Radar: A Structured Claim Extraction and Tracking System (2022.acl-demo)

Copied to clipboard

Challenge: a new system extracts supporting and refuting claims from COVID-19 related news . the system is publicly available at GitHub and DockerHub, with complete documentation.
Approach: They propose a COVID-19 Claim Radar system that extracts supporting and refuting claims . the system leverages Wikidata as the hub to consolidate coreferential knowledge elements .
Outcome: The system extracts supporting and refuting claims from COVID-19 pandemic information . it leverages Wikidata as the hub to merge coreferential knowledge elements .
MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling (2026.eacl-long)

Copied to clipboard

Challenge: Experimental results show that MAViS achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness.
Approach: They propose an end-to-end multi-agent collaborative framework for long-sequence video storytelling that orchestrates specialized agents across multiple stages.
Outcome: The proposed framework achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness.
Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach (2026.acl-industry)

Copied to clipboard

Challenge: Literary translation requires balancing expression fluency with literary effect due to the scarcity of high-quality training data and the difficulty of capturing nuanced quality trade-offs.
Approach: They propose a multi-aspect iterative refinement framework that generates high-quality translation references and preference data through specialized LLM translators.
Outcome: The proposed models outperform the ground truth for SFT by 8.65 CEA100 points while leveraging an explicit reward model for GRPO yields an additional 1.51 point improvement.
Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning (2025.acl-long)

Copied to clipboard

Challenge: Existing continual learning setups for embodied intelligence focus on executing low-level actions, neglecting the ability to learn high-level planning and multi-level knowledge.
Approach: They propose a Hierarchical Embodied Continual Learning Setups (HEC) that divides the agent’s continual learning process into two layers: high-level instructions and low-level actions.
Outcome: The proposed method reduces the forgetting of old tasks compared to other methods, while orthogonally training the remaining parts.
PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning (2024.findings-acl)

Copied to clipboard

Challenge: In-context instruction tuning is a method that fine tunes with supervised instruction data to enhance the instruction following ability of large language models.
Approach: They propose an in-context instruction tuning method that incorporates positive and negative examples into the prompt for better performance.
Outcome: The proposed method outperforms baseline instruction tuning methods on in-domain and out-domain tasks up to 9.16 and 3.14 average ROUGE-L scores.
CURA: Clinical Uncertainty Risk Alignment for Language Model–Based Risk Prediction (2026.acl-long)

Copied to clipboard

Challenge: Clinical language models (LMs) are increasingly applied to support clinical risk prediction from free-text notes, yet their uncertainty estimates are poorly calibrated and clinically unreliable.
Approach: They propose a framework that aligns clinical LM-based risk estimates and uncertainty with individual error likelihoods and cohort-level ambiguities.
Outcome: The proposed framework improves accuracy on clinical risk prediction tasks without compromising discrimination.
HMEAE: Hierarchical Modular Event Argument Extraction (D19-1)

Copied to clipboard

Challenge: Existing event extraction methods classify each argument role independently, ignoring conceptual correlations between different argument roles.
Approach: They propose a Hierarchical Modular Event Argument Extraction model to provide inductive bias from the concept hierarchy of event argument roles.
Outcome: The proposed model outperforms existing methods on real-world datasets and shows that it leverages useful knowledge from the concept hierarchy.
Generalizing Few-Shot Named Entity Recognizers to Unseen Domains with Type-Related Features (2023.findings-emnlp)

Copied to clipboard

Challenge: Few-shot named entity recognition methods struggle with out-of-domain (OOD) examples due to their reliance on manual labeling for the target domain.
Approach: They propose a framework to enable generalization to an unseen target domain with only a few labeled examples.
Outcome: The proposed framework achieves significant performance improvements on in-domain and cross-domain datasets.
Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for language analysis are inadequate for specialized domains like psychology.
Approach: They have enriched a Chinese social media database with psychological lexicons to enhance its applicability to psychological text analysis.
Outcome: The proposed model performed better on six public datasets and provided relevant predictions given the masked sentences.
Debiasing LLMs by Masking Unfairness-Driving Attention Heads (2026.findings-acl)

Copied to clipboard

Challenge: Existing work probes when biased outputs appear, but gives little insight into the mechanisms that generate them, leaving existing mitigations largely fragile.
Approach: They propose a lightweight debiasing framework that detects bias heads and selectively masks only those heads that activate under DA and CoT.
Outcome: The proposed framework reduces unfairness by 391.9%- 534.5% in both one- and two-turn dialogues.
Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineering (2025.acl-long)

Copied to clipboard

Challenge: Existing work finds that long CoT reasoning can be efficiently elicited by tuning on only a few examples and can easily transfer to other tasks.
Approach: They propose a representation engineering method to unleash the general long CoT reasoning capabilities of LLMs.
Outcome: The proposed method is effective in in-domain and cross-domain scenarios.
Visual Self-Refinement for Autoregressive Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Autoregressive models excel in sequential modeling but the spatial nature of visual signals conflicts with the sequential dependencies of next-token prediction, leading to suboptimal results.
Approach: They propose a plug-and-play refinement module to enhance the spatial correspondence modeling within the generated visual sequence.
Outcome: The proposed module enhances vision-language modeling under a shared sequential prediction framework.
Model Extrapolation Expedites Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve LLM alignment training require expensive computational resources.
Approach: They propose a model extrapolation method to expedite LLMs’ alignment with human preferences by amplifying parameter changes based on a first-order approximation without any additional training overhead.
Outcome: The proposed method outperforms a fully-trained model on leading benchmarks and significantly outperformed open-source models.
Nash CoT: Multi-Path Inference with Preference Equilibrium (2024.emnlp-main)

Copied to clipboard

Challenge: Multi-path inference is an improvement on multi-path reasoning, but there is no optimal setting for the number of inference paths.
Approach: They propose to use question-related role templates to guide LLMs into relevant roles to reduce the dependence on the number of inference paths.
Outcome: The proposed system can achieve comparable or better results than self-consistency with the same number of paths.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations