Papers by Qian Zheng

50 papers
HateModerate: Testing Hate Speech Detectors against Content Moderation Policies (2024.findings-naacl)

Copied to clipboard

Challenge: Existing studies on hate speech detection have failed to answer this question.
Approach: They propose a dataset for testing the behaviors of automated content moderators against content policies.
Outcome: The proposed dataset includes hateful and non-hateful examples matching the 41 community standards guideline policies of Facebook.
ReCode: Robustness Evaluation of Code Generation Models (2023.acl-long)

Copied to clipboard

Challenge: Existing work on robustness in text or code tasks has focused on classification, while robustness for code generation tasks is an uncharted area.
Approach: They propose a robustness evaluation benchmark for code generation models that customizes over 30 transformations specifically for code on docstrings, function and variable names, code syntax, and code format.
Outcome: The proposed model performs better on human annotators and on SOTA models with human annnotators.
HutCRS: Hierarchical User-Interest Tracking for Conversational Recommender System (2023.emnlp-main)

Copied to clipboard

Challenge: Existing CRSs assume that users like all attributes of the target item and dislike those unrelated to it, which can introduce bias in attribute-level feedback and impede the system’s ability to accurately identify the target items.
Approach: They propose a framework that allows users to explicitly acquire user preferences through natural language conversations by providing explicit answers (yes/no) for each attribute they require.
Outcome: The proposed framework portrays the conversation as a hierarchical interest tree that consists of two stages.
Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: emergence of tool agent paradigm has broadened capability boundaries of the Large Language Model (LLM) but effectiveness of tool agents limited due to parameter failure during execution .
Approach: They propose a parameter failure taxonomy to investigate parameter failure . they propose suggestions for standardizing tool return formats and improving error feedback mechanisms .
Outcome: The proposed model is based on a tool agent invocation chain and a mainstream tool agent . it shows that parameter name hallucination failure stems from inherent limitations .
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG systems that use pre-trained LLMs and retrievers often fail in specialized domains and applications.
Approach: They propose a self-aligned training framework that adapts general RAG models to specific domains solely through synthetic data.
Outcome: Experiments on specialized domain corpus, general LLM, and general retriever show that the self-aligned training framework outperforms human-annotated training data in specialized fields.
MemoBrain: Executive Memory as an Agentic Brain for Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are inherently long-horizon, causing reasoning traces and tool artifacts to accumulate and strain the working context of large language models.
Approach: They propose a model that constructs a dependency-aware memory over reasoning steps and captures salient intermediate states and their logical relations.
Outcome: The proposed model prunes invalid steps, folds completed sub-trajectories, and preserves a compact, high-salience reasoning backbone under a fixed context budget.
AWARE: Agentic Knowledge Warehousing for Contextual Intelligence (2026.findings-acl)

Copied to clipboard

Challenge: Large language models excel in information seeking tasks, but their knowledge is limited in coverage and timeliness.
Approach: They propose an agentic knowledge warehousing framework that transforms unstructured data into minimal, task-conditioned knowledge representations consumable by LLMs.
Outcome: Experiments on GAIA, WebWalker, and BrowseComp-Plus show improvements over baselines.
Enhancing Model Privacy in Federated Learning with Random Masking and Quantization (2025.findings-emnlp)

Copied to clipboard

Challenge: federated learning approaches are limited by the complexity of large language models and the need for specialized expertise to protect intellectual property.
Approach: They propose a federated learning approach that leverages random masking to obscure a subnetwork of model parameters and applies quantization to the remaining parameters.
Outcome: The proposed approach maintains strong model performance in federated learning settings and achieves enhanced protection of model parameters compared to baseline methods.
SEGMENT+: Long Text Processing with Short-Context Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks that increase context window do not guarantee robust performance across long input tasks.
Approach: They propose a framework that enables language models to handle extended inputs within limited context windows efficiently.
Outcome: The framework improves performance on long-document question-answering and Needle-in-a-Haystack tasks.
CR-UTP: Certified Robustness against Universal Text Perturbations on Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing certified robustness methods for certifying input-specific text perturbations have shown promise in certifyling UTPs, but masking only adversarial words can eliminate the attack.
Approach: They propose a method to certify a language model’s robustness against UTPs by using random smoothing.
Outcome: The proposed method achieves high certified accuracy under extensive masking and achieves state-of-the-art results in multiple settings.
AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse (2026.acl-demo)

Copied to clipboard

Challenge: Existing frameworks for building LLM-based agents treat agent behavior as static-knowledge gained during execution is not preserved for future use.
Approach: They propose a new paradigm that preserves successful task solutions as executable subagent code rather than textual experience.
Outcome: The proposed agent-based agent-driven paradigm preserves successful tasks as executable subagent code rather than textual experience.
StreamingEval: A Unified Evaluation Framework towards Realistic Streaming Video Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on streaming video understanding focuses on isolated aspects of visual understanding, but ignores practical deployability under realistic resource constraints.
Approach: They propose a framework to evaluate streaming video understanding capabilities under realistic constraints.
Outcome: StreamingEval benchmarks offline and online video models under a standardized protocol . it evaluates visual encoding efficiency, text decoding latency and task performance .
Pub-LawBench: Public-Oriented Benchmarking for LegalAI (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation frameworks focus on legal professionals, not legal professionals.
Approach: They propose a public-oriented LegalAI benchmark grounded in legal functionalism and genre analysis to address this gap.
Outcome: The proposed model evaluates 17 large language models on Pub-LawBench using simple prompts and Chain-of-Thought under a vanilla inference setting.
Sentiment Knowledge Enhanced Self-supervised Learning for Multimodal Sentiment Analysis (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies have used general approaches to alleviate the overfitting of supervised models based on video data with sentiment annotations.
Approach: They propose to capture common sentimental patterns in unlabeled videos using sentiment knowledge and non-verbal behavior to embed sentiment information into pre-trained multimodal representations.
Outcome: The proposed model outperforms the baseline and achieves new State-Of-The-Art (SOTA) results.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for temporal reasoning are limited and apply a fixed pipeline to all questions.
Approach: They propose an adaptive temporal reasoning method that dynamically executes reasoning steps based on context and task requirements.
Outcome: Experiments on two temporal QA benchmarks show the proposed method works.
Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains.
Approach: They propose several strategies for deploying RAG that balance performance and efficiency.
Outcome: The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy.
A Dual-View Analysis of Multiple Languages in Colonial Newspapers (2026.findings-acl)

Copied to clipboard

Challenge: Historical newspapers from the colonial period offer valuable evidence of how racializing language evolved over time.
Approach: They propose a contextual question answering and visual question answering task from colonial newspapers . they propose linguistic training for temporal word embedding with a compass to study racialization .
Outcome: The proposed tasks are limited for low-resource tasks, the authors show . the authors compare the results of two QA pairs from colonial newspapers to a compass .
BadFair: Backdoored Fairness Attacks with Group-conditioned Triggers (2024.findings-emnlp)

Copied to clipboard

Challenge: *BadFair* is a backdoored fairness attack methodology that discriminates and produces incorrect results for specific groups.
Approach: They propose a backdoored fairness attack methodology that discriminates and produces incorrect results for specific groups.
Outcome: The proposed model achieves 85% success rate in attacks aimed at target groups on average while only incurring a minimal accuracy loss.
HyCoRec: Hypergraph-Enhanced Multi-Preference Learning for Alleviating Matthew Effect in Conversational Recommendation (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to study the Matthew effect in Recommender Systems (RSs) however, it is amplified when the user interacts with the system over time.
Approach: They propose a paradigm to alleviate the Matthew effect in conversational recommendation by learning multi-aspect preferences.
Outcome: The proposed paradigm achieves state-of-the-art performance and superior of alleviating Matthew effect in conversational recommendation tasks.
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation (2025.acl-long)

Copied to clipboard

Challenge: Full-duplex spoken dialogue systems allow simultaneous bidirectional communication . low latency and natural interactions in full-duplice systems remains a challenge .
Approach: They propose a multi-stage post-training scheme that adapts a text large language model into a speech-text dialogue LLM.
Outcome: The proposed model can model human conversation behaviors with low latency and natural interactions with low delay.
Grounding Language Model with Chunking-Free In-Context Retrieval (2024.acl-long)

Copied to clipboard

Challenge: CFIC retrieval approach eliminates the need for document chunking and provides a more efficient and efficient method for RAG systems.
Approach: They propose a Chunking-Free In-Context retrieval approach specifically tailored for RAG systems . they employ auto-aggressive decoding to accurately identify specific evidence text .
Outcome: The proposed method is better than traditional methods on open question answering datasets.
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding (2022.acl-long)

Copied to clipboard

Challenge: Existing evaluation protocols for few-shot natural language understanding (NLU) tasks are inconsistent and hinder fair comparison and measuring progress.
Approach: They propose an evaluation framework that improves previous evaluation procedures in three key aspects, i.e., test performance, dev-test correlation, and stability.
Outcome: The proposed framework improves evaluation procedures in three key aspects, i.e., performance, dev-test correlation, and stability.
Factuality Beyond Coherence: Evaluating LLM Watermarking Methods for Medical Texts (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on detection-quality tradeoffs and overlook factual risks.
Approach: They propose a method that assesses factual accuracy and coherence . they use a factor-weighted score to prioritize factual accurate beyond coherency .
Outcome: The proposed method assesses factual accuracy and coherence in medical text . it shows current watermarking methods substantially compromise medical factuality .
ScEdit: Script-based Assessment of Knowledge Editing (2025.findings-acl)

Copied to clipboard

Challenge: Knowledge Editing (KE) has gained increasing attention, yet current evaluation frameworks do not integrate KE into real-world application scenarios.
Approach: They propose a script-based benchmark which encompasses both counterfactual and temporal edits and integrates token-level and text-level evaluation methods.
Outcome: The proposed method combines token-level and text-level evaluation methods with a new fact-based evaluation framework.
Conjunctive Prompt Attacks in Multi-Agent LLM Systems (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses do not reliably stop the attack because no single component appears malicious in isolation.
Approach: They study conjunctive prompt attacks where trigger key and adversarial template appear benign alone but activate harmful behavior when routing brings them together.
Outcome: The proposed model significantly improves performance over baselines while keeping false activations low.
Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization on Multi-party Conversation (2025.acl-long)

Copied to clipboard

Challenge: Mainstream speaker diarization systems rely only on acoustic information, making it challenging in complex aural environments.
Approach: They propose a multimodal approach that integrates audio, visual, and semantic cues to enhance speaker diarization.
Outcome: The proposed approach outperforms state-of-the-art methods on multi-party conversations . it integrates audio-visual-semantic cues into the clustering process for acoustic speaker embeddings .
Learning Algebraic Recombination for Compositional Generalization (2021.findings-acl)

Copied to clipboard

Challenge: Neural sequence models exhibit limited compositional generalization ability in semantic parsing tasks.
Approach: They propose an end-to-end neural model to learn algebraic recombination for compositional generalization.
Outcome: The proposed model is based on two realistic and comprehensive compositional generalization benchmarks.
HyperCRS: Hypergraph-Aware Multi-Grained Preference Learning to Burst Filter Bubbles in Conversational Recommendation System (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to analyze filter bubbles in the static recommendation environment are unable to burst them during user interactions.
Approach: They propose a paradigm to learn multi-grained user preferences during dynamic user-system interactions via natural language conversations to burst filter bubbles.
Outcome: The proposed paradigm achieves state-of-the-art performance and the superior of bursting filter bubbles in the conversational recommendation system.
Single LLM, Multiple Roles: A Unified Retrieval-Augmented Generation Framework Using Role-Specific Token Optimization (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies have optimized retrieval-augmented generation (RAG) across sub-tasks, but integrating these optimizations into a unified framework remains challenging.
Approach: They propose a unified retrieval-augmented generation framework that optimizes role-specific tokens for multi-task processing.
Outcome: The proposed framework achieves efficient multi-task processing through role-specific token optimization.
A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on graph structure learning or semantic reasoning, lacking the capability to capture the inherent differences between historical and non-historical events.
Approach: They propose a temporal knowledge graph reasoning framework that integrates both structural and semantic information to guide the reasoning process for different events.
Outcome: The proposed framework integrates structural and semantic information to predict future events . it can provide evidence for many downstream tasks, including situation analysis and political decision making .
Dial BeInfo for Faithfulness: Improving Factuality of Information-Seeking Dialogue via Behavioural Fine-Tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: Pretrained large language models (LLMs) are prone to hallucinations, that is, they generate incoherent or generic responses to queries.
Approach: They propose a method that applies 'behavioural tuning' on the LLMs to aid information-seeking dialogue by comparing three standard datasets.
Outcome: The proposed method improves accuracy on real-life conversations with real users by allowing the models to perform better on the data.
Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings (2023.emnlp-main)

Copied to clipboard

Challenge: Prior studies diagnose the anisotropy problem in sentence embeddings from pre-trained language models without fine-tuning.
Approach: They propose an unsupervised method that weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings.
Outcome: Empirical evaluations show that the proposed method can alleviate the anisotropy problem and improve various pre-trained models on the STS benchmarks.
Are All Prompt Components Value-Neutral? Understanding the Heterogeneous Adversarial Robustness of Dissected Prompt in LLMs (2026.eacl-long)

Copied to clipboard

Challenge: Existing studies treat prompts as flat text, overlooking their internal structure, and different components within a prompt contribute unequally to robustness.
Approach: They propose a framework that decomposes prompts into functional components and a method that selectively modifies components to expose component-wise vulnerabilities.
Outcome: The proposed framework exposes component-wise vulnerabilities while ensuring linguistic plausibility through perplexity-based filtering.
Jailbreaking LLMs with Arabic Transliteration and Arabizi (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are vulnerable to ‘jailbreak’ attacks, focusing on the Arabic language and its various forms.
Approach: They propose to use Arabic transliteration and chatspeak to generate unsafe content on platforms like OpenAI GPT-4 and Anthropic Claude 3 Sonnet.
Outcome: The proposed model could generate unsafe content on platforms like OpenAI GPT-4 and Anthropic Claude 3 Sonnet, highlighting the need for more comprehensive safety training across all language forms.
Reinforcing Agentic Search Via Reward Density Optimization (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic search, but its performance is often hindered by reward sparsity .
Approach: They propose a new research problem to improve the reward obtained per unit of exploration cost by using a system that decomposes long-horizon tasks into intermediate objectives and assigns process-level rewards to provide denser learning signals.
Outcome: The proposed framework outperforms strong baselines on several agentic search benchmarks and achieves comparable performance to that of advanced proprietary models.
ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025.acl-long)

Copied to clipboard

Challenge: Prior zero-shot TTS models only mimic the speaker’s voice without further control and adjustment capabilities while prior controllable TTS systems cannot perform speaker-specific voice generation.
Approach: They propose a style control module that captures codec representations corresponding to timbre, content, and style in a discrete decoupling codec space.
Outcome: The proposed system can fully clone the speaker's voice and perform speech-specific adjustment and control functions.
Boosting Long-Context Information Seeking via Query-Guided Activation Refilling (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for processing long contexts are ineffective due to their inherent context window limitations and the computational burden of extensive key-value activations.
Approach: They propose a method for processing long context information-seeking tasks via query-guided ACtivation REfilling (ACRE) a bi-layer KV Cache is constructed where the layer-1 cache compactly captures global information and the layer-2 cache provides detailed, localized information.
Outcome: The proposed method achieves significant improvements in both performance and efficiency on a variety of long-context information-seeking datasets.
Evaluating the Robustness and Accuracy of Text Watermarking Under Real-World Cross-Lingual Manipulations (2025.findings-emnlp)

Copied to clipboard

Challenge: a study focuses on evaluating watermarking methods for the English language . the literature for evaluating cross-lingual watermarks is scarce .
Approach: They evaluate representative watermarking methods in four different languages . they examine the quality of text under different watermark procedures .
Outcome: The proposed method is compared with other evaluation methods in four different languages.
MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on diagnostic reasoning based on internal model knowledge or static knowledge bases.
Approach: They propose a two-stage diagnostic reasoning framework that integrates multi-perspective evidence to generate a diagnostic prediction.
Outcome: The proposed method generates suspected diagnoses and reasoning traces from web search, SOAP-formatted case, and clinical case database.
SPEAK: Spiking Neurons as an Entropy-Aware Tokenizer for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing tokenizers fail to explicitly leverage historical tokenization results . large language models (LLMs) have demonstrated remarkable effectiveness across NLP tasks .
Approach: They propose a tokenizer that integrates spiking neurons to explicitly leverage historical tokenization results.
Outcome: The proposed tokenizer leverages historical tokenization results, but does not selectively leverage history based on contextual relevance.
DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for binaural audio synthesis are limited in phase estimation, which is crucial for spatial hearing.
Approach: They propose a method to explicitly address the Doppler effect of the moving speaker . it calculates the radial relative velocity of the speaker in spherical coordinates .
Outcome: The proposed method improves the representative WarpNet and BinauralGrad backbones in phase error metric and reaches a new state of the art (SOTA) it is compared with the current method which is limited in phase estimation .
Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to address the "lost-in-the-middle" problem suffer from high latency or suboptimal hand-crafted scaling strategies.
Approach: They propose a layer-specific positional embedding scaling method that assigns distinct scaling factors to each layer.
Outcome: Experiments show that the proposed method mitigates positional attention bias and delivers consistent improvements across multiple long-context benchmarks.
MADAWSD: Multi-Agent Debate Framework for Adversarial Word Sense Disambiguation (2025.emnlp-main)

Copied to clipboard

Challenge: Word sense disambiguation (WSD) is a fundamental yet challenging task in natural language processing.
Approach: a novel multi-agent Debate framework for adversarial word Sense disambiguation is proposed . the framework simulates a real-world debate environment where multiple agents engage in discussions about ambiguous words in the context of adversarials.
Outcome: The proposed framework integrates with existing LLMs and improves models in Chinese language . it shows that it can be used to improve models in the Chinese language and improve performance .
TrojFSP: Trojan Insertion in Few-shot Prompt Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Prompt tuning on a few data samples presents security issues, e.g., Trojan attacks.
Approach: They propose a method to transfer established data poisoning attacks directly to few-shot prompt tuning, a technique to address the poisoned imbalance issue.
Outcome: The proposed method achieves an ASR of over 99% while maintaining negligible decreases in CDA.
Mitigating Hallucinations in VLMs: Enhancing Visual Attention via Head-Wise Perturbation (2026.findings-acl)

Copied to clipboard

Challenge: Vision–Language Models (VLMs) have demonstrated strong capabilities in tasks that require joint understanding of text and images.
Approach: They propose a strategy that incorporates head-wise attention perturbation via continuous multiplicative noise coupled with a visual-guided loss focused on vision-sensitive text tokens to promote a more balanced attention distribution.
Outcome: The proposed approach outperforms baseline models on three benchmarks and consistently outperformed the baseline model.
Improving Visual-Semantic Embedding with Adaptive Pooling and Optimization Objective (2023.eacl-main)

Copied to clipboard

Challenge: Recent VSE models combine simple pooling methods with hard triplet loss to improve performance.
Approach: They propose an adaptive pooling strategy that allows the model to learn how to aggregate features through a combination of simple pooling methods.
Outcome: The proposed strategy outperforms current state-of-the-art systems on image-to-text and text-toimage retrieval.
Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarization (2023.findings-acl)

Copied to clipboard

Challenge: Current speaker diarization systems consider only acoustic information, resulting in performance degradation when encountering adverse acustic environment.
Approach: They propose methods to extract speaker-related information from conversational semantics in multi-party meetings.
Outcome: The proposed method improves on AISHELL-4 and AliMeeting datasets on speakers diarization and speaker-turn detection.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations