Papers by Qian Jiang

45 papers
UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook (2025.acl-long)

Copied to clipboard

Challenge: Existing neural audio codecs are not capable of handling multi-domain audio data . et al., 2023) integrate speech modality with text-based large language models .
Approach: They propose a unified audio codec with a single codebook to support multi-domain audio data . they propose combining a mix-of-experts strategy and a partitioned domain-adaptive codebook method .
Outcome: The proposed codec outperforms existing codecs on acoustic and semantic representation capabilities.
VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025.coling-main)

Copied to clipboard

Challenge: Existing multilingual TTS datasets are limited in speech generation fields due to lack of quality data.
Approach: They propose to use 30,000 hours of high-quality speech data across 3 languages . they filter out low-quality text-text pairs and concatenate short transcripts .
Outcome: The proposed dataset comprises 30,000 hours of high-quality speech data, across 3 languages with multiple speakers and styles, suitable for various speech tasks such as TTS and ASR.
Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: emergence of tool agent paradigm has broadened capability boundaries of the Large Language Model (LLM) but effectiveness of tool agents limited due to parameter failure during execution .
Approach: They propose a parameter failure taxonomy to investigate parameter failure . they propose suggestions for standardizing tool return formats and improving error feedback mechanisms .
Outcome: The proposed model is based on a tool agent invocation chain and a mainstream tool agent . it shows that parameter name hallucination failure stems from inherent limitations .
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks.
Approach: They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges.
Outcome: The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization.
Exploring Diverse Expressions for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications.
Approach: They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases.
Outcome: The proposed model gains significant diversity and improves quality over state-of-the-art datasets.
Few-Shot Multimodal Named Entity Recognition Based on Mutlimodal Causal Intervention Graph (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for multimodal named entity recognition are limited due to limited resources.
Approach: They propose a Few-shot Multimodal Named Entity Recognition task to address these relation types by constructing a multimodal graph and a new multimodal causal intervention strategy.
Outcome: The proposed model improves on two multimodal named entity recognition datasets.
Beyond Memorization: The Challenge of Random Memory Access in Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in Language Models (LMs) have shown their effectiveness in knowledge-intensive tasks.
Approach: They investigate whether a generative language model is able to access its memory sequentially or randomly.
Outcome: The proposed LMs are able to access memory sequentially or randomly.
WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)

Copied to clipboard

Challenge: aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is.
Approach: They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types.
Outcome: The proposed model disentangles ASR errors from event detection while maintaining ASR quality.
Focusing Condition: Inference-Time Self-Contrastive Steering Elicits Better Conditional Text Embeddings in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for extracting conditional text embeddings from large language models (LLMs) relying on prompts often fails to produce high-quality conditional embeddables, resulting in degradation of quality.
Approach: They propose a plug-and-play method that constructs unconditional general text embeddings and uses them to refine conditional text embeds.
Outcome: The proposed method improves performance of prompt-based methods on clustering, Semantic Textual Similarity, and triplet alignment datasets.
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models (2026.acl-long)

Copied to clipboard

Challenge: a recent study evaluated large audio-language models against jailbreak attacks . a new benchmark is being developed to evaluate LAM safety against jailbreaking attacks based on temporal and semantic nature of speech .
Approach: They propose a benchmark to evaluate LAM jailbreak vulnerabilities in adversarial audio prompts . they use a dataset of 1,495 adversarials to evaluate their performance .
Outcome: The proposed benchmark evaluates state-of-the-art LAMs against jailbreak attacks . it demonstrates that even small, semantically preserved perturbations can reduce safety .
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent (2025.acl-long)

Copied to clipboard

Challenge: Recent advances have underscored the potential of large language model (LLM)-based agents in financial decision-making.
Approach: They propose to evaluate LLM agents using 13 different LLMs as backbone models across various market environments and tasks.
Outcome: The proposed framework assesses the reasoning and decision-making capabilities of 13 different LLMs across various market environments and tasks.
Internalizing Multi-Agent Reasoning for Accurate and Efficient LLM-based Recommendation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent.
Approach: They propose a single-agent Trajectory-Aligned Recommender to integrate reasoning capabilities into a model by a multi-agend teacher system.
Outcome: The proposed model surpasses its teacher by 8.7% to 39.5% while eliminating iterative latency.
WAFFLE: Fine-tuning Multi-Modal Model for Automated Front-End Development (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown promise in generating source code, but two major challenges persist in UI-to-HTML code generation: (1) effectively representing HTML’s hierarchical structure for LLMs; and (2) bridging the gap between the visual nature of UI designs and the text-based format of HTML code.
Approach: They propose a structure-aware attention mechanism that uses a contrastive fine-tuning approach to align LLMs’ understanding of UI images and HTML code.
Outcome: The proposed model outperforms existing methods on the WebSight-Test and Design2Code benchmarks.
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
EvoR: Evolving Retrieval for Code Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing pipelines for retrieval-augmented code generation (RACG) use static knowledge bases with a single source, limiting adaptation capabilities of Large Language Models (LLMs) Extensive experiments demonstrate that EVOR achieves two to four times of execution accuracy compared to other methods such as Reflexion.
Approach: They propose a retrieval-augmented code generation pipeline that employs the synchronous evolution of queries and diverse knowledge bases.
Outcome: The proposed pipeline achieves two to four times of execution accuracy compared to other methods.
SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) language models are a dominant paradigm in the field of parallelism and non-causal modeling.
Approach: They propose a blockwise discrete diffusion model that preserves AR-compatible serving while enabling parallel intra-block generation.
Outcome: The proposed model achieves theoretical speedups over 5 and wall-clock speedup of 2.3 on H200 GPUs in latency-critical regimes.
Co-VQA : Answering by Interactive Sub Question Sequence (2022.findings-acl)

Copied to clipboard

Challenge: Existing approaches to Visual Question Answering (VQA) answer questions directly, but people usually decompose a complex question into a sequence of simple sub questions.
Approach: They propose a conversation-based VQA framework that decomposes questions into sub questions and answers them one-by-one.
Outcome: The proposed framework achieves state-of-the-art on VQA 2.0 and VQA-CP v2 datasets.
Saber: Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model in Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Diffusion language models (DLMs) offer advantages in parallel generation and bidirectional context modeling, but they face a critical trade-off between inference speed and output quality for tasks with strict structural constraints such as code generation.
Approach: They propose an efficient sampling algorithm that reduces the number of tokens unmasked per step based on the model’s evolving confidence.
Outcome: The proposed method improves Pass@1 accuracy by 1.9% while achieving 251.4% inference speedup.
TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal Restriction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge graph embedding methods restrict entities on hyper-ellipsoid surfaces, resulting in suboptimal knowledge graph completion.
Approach: They propose a score function that leverages relation-specific translations between head and tail entities to relax constraints on hyper-ellipsoid surfaces.
Outcome: The proposed method achieves state-of-the-art performance on link prediction and generalizes well to datasets in different domains and scales.
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for audio-centric interaction have impeded advancements in this field . AIR-Bench evaluates LALMs' ability to understand audio signals and interact with humans .
Approach: They propose a benchmark to evaluate the ability of large audio-language models to understand audio signals . they use 19 tasks with approximately 19k single-choice questions to examine single-task ability .
Outcome: The proposed framework evaluates the ability of large audio-language models to understand audio signals and interact with humans in the textual format.
EmoRes: Toward Adaptive Psychological Support via User-Agnostic Benchmark and Topic-Mining Agent (2026.findings-acl)

Copied to clipboard

Challenge: Large language models generate fragmented and emotionally inconsistent dialogues lacking the therapeutic structure necessary for reliable assessment.
Approach: They propose a framework that boosts psychological reasoning via a Topic-Mining Emotional Agent and a multi-perspective Self-Reflection Agent.
Outcome: The proposed framework improves topic continuity, emotional coherence, and clinical interpretability over baselines and validated by ablation studies and human evaluations.
FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting (2026.findings-acl)

Copied to clipboard

Challenge: FineState-Bench evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Approach: They propose a benchmark that evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Outcome: The proposed benchmark evaluates whether an agent can ground an instruction to the intended UI control and reach the exact target state.
Are All Prompt Components Value-Neutral? Understanding the Heterogeneous Adversarial Robustness of Dissected Prompt in LLMs (2026.eacl-long)

Copied to clipboard

Challenge: Existing studies treat prompts as flat text, overlooking their internal structure, and different components within a prompt contribute unequally to robustness.
Approach: They propose a framework that decomposes prompts into functional components and a method that selectively modifies components to expose component-wise vulnerabilities.
Outcome: The proposed framework exposes component-wise vulnerabilities while ensuring linguistic plausibility through perplexity-based filtering.
The Ranking Blind Spot: Decision Hijacking in LLM-based Text Ranking (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated strong performance in information retrieval tasks like passage ranking.
Approach: They propose two attacks that aim to force the LLM ranker to prefer a specific passage and rank it at the top.
Outcome: The proposed attacks aim to force the LLM ranker to prefer a specific passage and rank it at the top.
Mitigating Cultural Bias in LLMs via Multi-Agent Cultural Debate (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to evaluate large language models fail to address cultural bias in non-Western languages . Chinese prompting shifts bias toward East Asian perspectives rather than eliminating it, authors say .
Approach: They propose a Chinese–English bilingual benchmark and multi-agent vote frameworks that enable explicit "no bias" judgments.
Outcome: The proposed framework achieves 57.6% average No Bias Rate on Chinese-English benchmark and 86.0% on Arabic CAMeL benchmark.
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for speech editing still suffer from over-smoothing problem and lack of robustness due to stutter.
Approach: They propose a stutter-oriented automatic speech editing model that incorporates sutter information into the hidden sequence.
Outcome: The proposed model achieves state-of-the-art performance on a speech recording dataset . it can improve fluency of stuttering speech in terms of objective and subjective metrics.
ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025.acl-long)

Copied to clipboard

Challenge: Prior zero-shot TTS models only mimic the speaker’s voice without further control and adjustment capabilities while prior controllable TTS systems cannot perform speaker-specific voice generation.
Approach: They propose a style control module that captures codec representations corresponding to timbre, content, and style in a discrete decoupling codec space.
Outcome: The proposed system can fully clone the speaker's voice and perform speech-specific adjustment and control functions.
Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to mitigate catastrophic forgetting can be broadly categorized into data-based, architecture-based and learning-based methods.
Approach: They propose a subspace regularization method on LoRA structure that imposes constraints on direction of updating matrix’s null space.
Outcome: The proposed method reduces scale of output change while introducing minimal constraint on model capacity.
Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence (2025.findings-naacl)

Copied to clipboard

Challenge: Existing frameworks for semi-supervised text mining with lightweight models are limited by label data scarcity.
Approach: They propose a framework for semi-supervised text mining with lightweight models . it incorporates online distillation to train lightweight student models by imitating the Teacher model .
Outcome: The proposed framework exhibits notable performance enhancements over existing frameworks.
Chameleon: A Language Model Adaptation Toolkit for Automatic Speech Recognition of Conversational Speech (D19-3)

Copied to clipboard

Challenge: Language model adaptation (LMA) is a promising solution for conversational speech recognition systems.
Approach: They propose to use language model adaptation techniques to adapt language models to conversational speech recognition.
Outcome: The proposed toolkit compares state-of-the-art language model adaptation techniques in conversational speech recognition tasks.
Optimizing Cross-Client Domain Coverage for Federated Instruction Tuning of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Federated domain-specific instruction tuning (FedDIT) for large language models (LLMs) aims to enhance performance in specialized domains using distributed private and limited data.
Approach: They introduce an algorithm that explicitly maximizes cross-client domain coverage through diversity-oriented client center selection and retrieval-based augmentation.
Outcome: The proposed algorithm achieves performance gains of 29.19% and domain coverage improvements of 4.82%-21.36% over 11 baselines.
Know Thy Enemy: Securing LLMs Against Prompt Injection via Diverse Data Synthesis and Instruction-Level Chain-of-Thought Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM)-integrated applications face security vulnerabilities from prompt injection (PI) attacks.
Approach: They propose a model enhancement method that synthesizes diverse training data and employs instruction-level chain-of-thought fine-tuning to enable LLMs to effectively identify and reject malicious instructions regardless of their source or position in the context.
Outcome: The proposed method outperforms baselines in three critical dimensions while maintaining utility performance without degradation.
KoCo-Bench: Can Large Language Models Leverage Domain Knowledge in Software Development? (2026.acl-long)

Copied to clipboard

Challenge: Existing domain-specific code benchmarks focus on assessing what knowledge LLMs possess rather than how they acquire and apply new knowledge.
Approach: They propose a benchmark to evaluate domain specialization methods in real-world software development.
Outcome: KOCO-bench is a new benchmark for evaluating domain specialization methods in real-world software development.
CRYPTOGRU: Low Latency Privacy-Preserving Text Analysis With GRU (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to combine HE and GC in RNNs suffer from long inference latency due to the slow activation functions.
Approach: They propose a hybrid structure of HE and GC gated recurrent unit network, for low-latency secure inferences.
Outcome: The proposed structure improves the secure inference latency by up to 138 over one of the state-of-the-art secure networks on the Penn Treebank dataset.
GraphIE: A Graph-Based Framework for Information Extraction (N19-1)

Copied to clipboard

Challenge: Most modern Information Extraction (IE) systems are implemented as sequential taggers and model local dependencies.
Approach: They propose a framework that operates over a graph representing a broad set of dependencies between textual units.
Outcome: The proposed framework outperforms the state-of-the-art sequence tagging model on three different tasks.
TrojFSP: Trojan Insertion in Few-shot Prompt Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Prompt tuning on a few data samples presents security issues, e.g., Trojan attacks.
Approach: They propose a method to transfer established data poisoning attacks directly to few-shot prompt tuning, a technique to address the poisoned imbalance issue.
Outcome: The proposed method achieves an ASR of over 99% while maintaining negligible decreases in CDA.
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to retrieve evidences from corpus are difficult due to table-text discrepancy and data sparsity problem.
Approach: They propose an optimized OpenQA Table-Text Retriever to retrieve tabular and textual evidences from tabular resources.
Outcome: The proposed OpenQA Table-Text Retriever significantly outperforms existing methods on QA tasks.
The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation.
Approach: They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers.
Outcome: The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests.
Leveraging Contextual Information for Effective Entity Salience Detection (2024.findings-naacl)

Copied to clipboard

Challenge: Prior work on salient entity detection focused on machine learning models that require heavy feature engineering.
Approach: They propose to fine-tune medium-sized language models with a cross-encoder style architecture to achieve significant performance gains over feature engineering approaches.
Outcome: The proposed model fine-tunes medium-sized pre-trained language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches.
Fine-grained Entity Typing without Knowledge Base (2021.emnlp-main)

Copied to clipboard

Challenge: Existing work on fine-grained entity typing (FET) relies on knowledge bases as distant supervision, but lack of or incompleteness of KB can hinder training.
Approach: They propose a two-step framework that trains FET models without accessing any knowledge base.
Outcome: The proposed framework achieves competitive performance with respect to the models trained on the original KB-supervised datasets.
Active Retrieval Augmented Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Generative language models (LMs) have a tendency to hallucinate and create inaccurate output.
Approach: They propose a method which iteratively uses a prediction of the upcoming sentence to anticipate future content.
Outcome: The proposed method achieves superior or competitive performance on all tasks . iteratively uses a prediction of the upcoming sentence to anticipate future content .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations