Papers by Zhihao Wang

45 papers
A Sequence-to-Sequence&Set Model for Text-to-Table Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for text-to-table generation are order-insensitive, but suffer from errors . a novel sequence-tosequence&set model generates table body rows in parallel .
Approach: They propose a sequence-to-sequence generation task that serializes each table into a token sequence during training by concatenating all rows in a top-down order.
Outcome: The proposed model outperforms baselines on commonly-used datasets.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
OD-RTE: A One-Stage Object Detection Framework for Relational Triple Extraction (2023.acl-long)

Copied to clipboard

Challenge: Existing pipelines for relational triple extraction are underutilizing regional information of triple.
Approach: They propose a one-stage Object Detection framework for Relational Triple Extraction . framework uses vertices-based bounding box detection and global relational triple region detection .
Outcome: The proposed framework could extract all types of triples on two widely used datasets.
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions.
Approach: They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process.
Outcome: The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences.
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored.
Approach: They propose a survey structured around the pipeline to identify and improve MI models.
Outcome: The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency.
Exploiting Emotion-Semantic Correlations for Empathetic Response Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Empathetic response generation aims to generate empathetic responses by understanding the speaker’s emotional feelings from the language of dialogue.
Approach: They propose a dynamical Emotion-Semantic Correlation Model (ESCM) which constructs dynamic emotion-semantics through the interaction of context and emotions.
Outcome: The proposed model understands emotions more accurately and expresses fluent and informative empathetic responses.
Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences for Image-Text Retrieval (2022.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to retrieve hard negative sentences are limited in the scale of the dataset thus fail to identify negative samples of high difficulty for every image.
Approach: They propose to use a model to generate synthetic negative sentences with higher difficulty by masking and refilling the images and performing word discrimination and word correction tasks to improve retrieval and generation.
Outcome: The proposed model generates synthetic negative sentences with higher difficulty on MS-COCO and Flickr30K and is robust and faithful to state-of-the-art training.
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks.
Approach: They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes.
Outcome: The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset.
A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for misinformation detection are limited by domain knowledge and expert experience.
Approach: They propose a Multi-Agent Framework for cross-domain misinformation detection with Automated Decision Rule Optimization (MARO) they first employ multiple expert agents to analyze target-domain news, then introduce a question-reflection mechanism that guides expert agents for higher-quality analysis.
Outcome: The proposed framework improves on a common dataset and shows that iteratively improves over existing methods.
Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for inductive reasoning over knowledge graphs lack the ability to model the logical structures of complex queries.
Approach: They propose a structure-modeled textual encoding framework for inductive logical reasoning over KGs that encodes linearized query structures and entities using pre-trained language models to find answers.
Outcome: The proposed framework encodes query structures and entities using pre-trained language models to find answers.
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Version updates are an indispensable requirement for Large Language Models . a large learning rate in the first stage and a complete learning decay process are crucial for version updates of LLMs.
Approach: They propose a learning rate path switching training paradigm for version updates of Large Language Models.
Outcome: The proposed paradigm reduces training cost to 58% when training four versions of LLMs compared to PTFS and CPT .
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods for logical reasoning of text focus on contextual semantics while struggling to explicitly model the logical inference process.
Approach: They propose a logic-driven context extension framework and a data-driven augmentation algorithm that uses contrastive learning to better capture logical information.
Outcome: The proposed framework outperforms existing methods on two benchmark datasets, ReClor and LogiQA.
Evaluating Readability and Faithfulness of Concept-based Explanations (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for evaluating concepts from different perspectives lack a unified formalization.
Approach: They propose a formal definition of concepts generalizing to diverse concept-based explanations’ settings and apply it to other types of explanations or tasks.
Outcome: Extensive experimental analysis was carried out to determine the evaluation measures for explanation evaluation measures.
From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable performance across various tasks, effectively following instructions to meet diverse user needs.
Approach: They propose a framework for evaluation benchmarks and attack techniques for LLMs and MLLMs to enhance their security.
Outcome: The proposed frameworks have been exploited to exploit the weaknesses of LLMs and MLLMs.
DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration (2025.emnlp-main)

Copied to clipboard

Challenge: Existing LLMs fail to capture the dual nature of medical consultation (MC) this mismatch often results in ineffective symptom inquiry and unreliable disease diagnosis.
Approach: They propose a novel LLM-based framework that performs Dual-Decision Optimization by decoupling the two sub-tasks and optimizing them with distinct objectives through a collaborative multi-agent workflow.
Outcome: The proposed framework outperforms existing LLM-based approaches on three real-world MC datasets and achieves competitive performance with state-of-the-art generation-based methods.
PathQG: Neural Question Generation from Facts (2020.emnlp-main)

Copied to clipboard

Challenge: Existing research for question generation encodes text as a sequence of tokens without explicitly modeling fact information.
Approach: They propose to incorporate facts in the input text for question generation in a comprehensive way.
Outcome: The proposed model outperforms state-of-the-art models and human evaluation shows it generates relevant and informative questions.
Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have demonstrated remarkable performance across tasks.
Approach: They propose a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models.
Outcome: The proposed framework extends existing benchmarks to extend models across tasks and tasks.
Prototype Tuning: A Meta-Learning Approach for Few-Shot Document-Level Relation Extraction with Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Few-Shot Document-Level Relation Extraction (FSDLRE) aims to develop models capable of generalizing to new categories with minimal support examples.
Approach: They propose a meta-training approach to train Large Language Models to improve their ICL capabilities . they construct simulated episodes using relation types that do not overlap with test corpus .
Outcome: Experimental results show that the proposed approach outperforms baseline models on few-shot tasks.
LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation of Large Language Models on static benchmarks is vulnerable to data contamination and leaderboard overfitting.
Approach: LLMEval-Fair framework provides a framework for dynamic evaluation of Large Language Models . evaluators use a proprietary bank of 220k graduate-level questions to analyze model data .
Outcome: LLMEval-Fair provides robust and credible evaluation framework for Large Language Models . it provides a strong empirical validation for the dynamic evaluation paradigm .
Understanding Conflicts in Multi-Objective Alignment through Reward Consistency (2026.findings-acl)

Copied to clipboard

Challenge: Existing training pipelines still face alignment conflicts where optimizing for one objective degrades performance on others.
Approach: They propose a reward-based criterion that approximates alignment conflicts via reward models.
Outcome: The proposed framework improves harmlessness and helpfulness scores by 23.07% over the vanilla dataset.
Mask Attention Networks: Rethinking and Strengthen Transformer (2021.naacl-main)

Copied to clipboard

Challenge: Existing research explores to enhance the two sublayers separately to improve the capability of Transformer for text representation.
Approach: They propose to combine SAN and Feed-Forward Networks to create a dynamic mask attention network with a learnable mask matrix which can model localness adaptively.
Outcome: The proposed model outperforms the original Transformer on translation and text summarization tasks.
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation (2025.acl-long)

Copied to clipboard

Challenge: Full-duplex spoken dialogue systems allow simultaneous bidirectional communication . low latency and natural interactions in full-duplice systems remains a challenge .
Approach: They propose a multi-stage post-training scheme that adapts a text large language model into a speech-text dialogue LLM.
Outcome: The proposed model can model human conversation behaviors with low latency and natural interactions with low delay.
DAGCN: Distance-based and Aspect-oriented Graph Convolutional Network for Aspect-based Sentiment Analysis (2024.findings-naacl)

Copied to clipboard

Challenge: Recent advances in sentiment analysis tend to interference from local factors such as irrelevant words and edges, hindering the precise identification of opinion words.
Approach: They propose a distance-based syntactic weight and Aspect-Fusion Attention to solve this problem.
Outcome: The proposed model outperforms state-of-the-art models on three public datasets and verify its effectiveness.
A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators (C18-1)

Copied to clipboard

Challenge: Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks.
Approach: They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image.
Outcome: The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics.
Learning to Detect Noisy Labels Using Model-Based Features (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to reduce label noise rely on heuristics and sample losses.
Approach: They propose a method that transfers the noise distribution to a clean set and trains a model to distinguish noisy labels from clean ones using model-based features.
Outcome: Empirically, the proposed approach improves over strong baselines on a wide range of tasks including text classification and speech recognition.
Internal Value Alignment in Large Language Models through Controlled Value Vector Activation (2025.acl-long)

Copied to clipboard

Challenge: Existing LLMs do not possess consistent values, but many have been developed to align them at the behavioral level, including supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF).
Approach: They propose a Controlled Value Vector Activation method that directly aligns the internal values of Large Language Models by interpreting how a value is encoded in their latent representations.
Outcome: The proposed method achieves highest success rate across 10 basic values without hurting model performance and fluency, and ensures target values even with opposite and potentially malicious input prompts.
Stable Language Guidance for Vision–Language–Action Models (2026.acl-long)

Copied to clipboard

Challenge: Existing vision-Language-Action models are notoriously brittle to linguistic perturbations.
Approach: They propose a probabilistic framework that disentangles physical affordance from semantic execution.
Outcome: The proposed framework disentangles physical affordance from semantic execution.
Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach (2026.acl-industry)

Copied to clipboard

Challenge: Literary translation requires balancing expression fluency with literary effect due to the scarcity of high-quality training data and the difficulty of capturing nuanced quality trade-offs.
Approach: They propose a multi-aspect iterative refinement framework that generates high-quality translation references and preference data through specialized LLM translators.
Outcome: The proposed models outperform the ground truth for SFT by 8.65 CEA100 points while leveraging an explicit reward model for GRPO yields an additional 1.51 point improvement.
Bridging by Word: Image Grounded Vocabulary Construction for Visual Captioning (P19-1)

Copied to clipboard

Challenge: Existing research on image captioning generates frequent n-grams with irrelevant words.
Approach: They propose to construct an image-grounded vocabulary incorporating visual information and relations among words into the decoding process directly.
Outcome: The proposed framework is compared with state-of-the-art models on MS COCO and Flickr30k and shows that it is more efficient than existing models.
Paper Abstract Writing through Editing Mechanism (P18-2)

Copied to clipboard

Challenge: a paper abstract writing system can automatically generate an abstract from a title . a typical recurrent neural network (RNN) based approach easily loses focus.
Approach: They propose a paper abstract writing system that automatically generates an abstract from a title.
Outcome: The proposed system passes Turing tests by junior domain experts and non-experts at a rate up to 80%.
Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for multi-hop reasoning ignore grounding on supporting facts of each step, which tends to generate inaccurate decompositions.
Approach: They propose an interpretable stepwise reasoning framework that incorporates supporting sentences and questions at each intermediate step and utilizes the inference of the current hop for the next until reasoning out the final result.
Outcome: The proposed model can boost performance and yield a better interpretable reasoning process without decomposition supervision.
AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator (2025.coling-main)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated superior performance in static medical question answering benchmarks, rivaling even human experts.
Approach: They propose a multi-agent framework emulating dynamic medical interactions between Doctor as player and NPCs including Patient and Examiner to assess the performance of LLM-driven Doctor agents in simulated clinical scenarios.
Outcome: The proposed framework emulates dynamic medical interactions between Doctor as player and NPCs including Patient and Examiner.
Two Languages Are Better than One: Bilingual Enhancement for Chinese Named Entity Recognition (2022.coling-1)

Copied to clipboard

Challenge: Existing studies focus on internal features of Chinese named entity recognition, but neglect other lingual modalities.
Approach: They propose a bilingual enhancement module for Chinese Named Entity Recognition . they integrate rich English information into Chinese representation and use it to learn the interaction between bilinguals and dependent information within Chinese.
Outcome: The proposed model can learn the interaction of bilinguals and dependent information within Chinese.
NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Tasks (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Graphical User Interface (GUI) and embodied navigation have driven progress, yet these domains have largely evolved in isolation, with disparate datasets and training paradigms.
Approach: They propose a visual-target trajectory collection pipeline that generates trajectories for GUI and embodied tasks using a single formulation.
Outcome: The proposed agent outperforms state-of-the-art agents in GUI navigation, spatial affordance prediction, and embodied navigation.
An Enhanced Knowledge Injection Model for Commonsense Generation (2020.coling-main)

Copied to clipboard

Challenge: a recent study shows that digging the relationship of concepts from scratch is non-trivial for commonsense generation tasks.
Approach: They use a retrieve-and-edit framework to retrieve a prototype with these concepts . they use qt and qq to generate commonsense questions at scale .
Outcome: The proposed method significantly improves the performance on commonsense generation tasks.
Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference (2025.acl-long)

Copied to clipboard

Challenge: Existing Large Vision-Language Models (LVLMs) learn visual capacity through visual instruction tuning.
Approach: They propose a method for LVLMs to be trained by selective layers tuning . they propose removing non-critical layers outside the visual region .
Outcome: The proposed approach preserves nearly 99% of visual performance and improves textual task results while reducing training time.
Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Event extraction is a task in natural language processing that involves identifying and extracting event information from unstructured text.
Approach: They propose a paradigm that combines schema paraphrasing with schema retrieval-augmented generation.
Outcome: The proposed paradigm retrieves paraphrased schemas and accurately generates targeted structures.
Unlocking Implicit Experience: Synthesizing Tool-Use Trajectories from Text (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) can be used to effectively utilize tools in multi-turn interactions, but acquiring diverse and realistic multi-step tool-use data remains a challenge.
Approach: They propose a text-based data synthesis pipeline that generates multi-turn tool-use trajectories from text corpora using relevance filtering, workflow tool extraction, trajectory grounding, and complexity refinement.
Outcome: The proposed model achieves 14.9% improvement on the BFCL V3 Multi-turn benchmark while significantly reducing inference latency and costs.
Code Reffix: A Benchmark for Reflection-Guided Code Repair with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on the repair generation capability of LLMs, lacking fine-grained evaluation of reflection.
Approach: They propose a benchmark with oracle reflections and a dual-task protocol to decouple evaluation of reflection from repair.
Outcome: The proposed benchmarks show that underperforming reflection capabilities remain a bottleneck for code repair.
Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineering (2025.acl-long)

Copied to clipboard

Challenge: Existing work finds that long CoT reasoning can be efficiently elicited by tuning on only a few examples and can easily transfer to other tasks.
Approach: They propose a representation engineering method to unleash the general long CoT reasoning capabilities of LLMs.
Outcome: The proposed method is effective in in-domain and cross-domain scenarios.
PAM: Enhancing General Alignment of Large Reasoning Models through Priority-Aware Metacognition (2026.acl-long)

Copied to clipboard

Challenge: Existing studies indicate that System-2 thinking alone does not transfer to the general alignment domain.
Approach: They propose to use priority-aware metacognition to help LRMs understand human preferences and monitor and regulate their thinking process.
Outcome: The proposed model improves general alignment performance by 10 points on helpfulness and harmless benchmarks.
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors .
Approach: They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details.
Outcome: The proposed method improves accuracy, inference efficiency, and real-time processing capabilities.
CheMM-R1: Enhancing Chemical Structure Recognition and Elucidation with Reasoning Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing multimodal large language models lack domain-specific expertise to perform chemical tasks.
Approach: They propose a benchmark dataset for evaluating multi-step multimodal reasoning capacities in the chemistry domain.
Outcome: The proposed model surpasses existing models in all CheMM-Bench tasks.
Revisiting Non-Autoregressive Translation at Scale (2023.findings-acl)

Copied to clipboard

Challenge: Extensive experiments on two advanced NAT models show scaling can improve translation performance.
Approach: They empirically examine the impact of scaling on NAT behaviors on a large-scale WMT dataset.
Outcome: The proposed model can achieve comparable performance with the scaling model while maintaining the superiority of decoding speed with standard NAT models.
WECA: A WordNet-Encoded Collocation-Attention Network for Homographic Pun Recognition (D18-1)

Copied to clipboard

Challenge: Homographic puns have a long history in human writing, widely used in written and spoken literature, which intended as jokes.
Approach: They propose a WordNet-encoded model to settle polysemy of homographic puns and a word weighted model for recognizing them.
Outcome: The proposed model can distinguish between homographic pun and non-homographic pun texts.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations