Papers by Qiang Yang

35 papers
OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction (2025.acl-long)

Copied to clipboard

Challenge: Existing methods focus on replicating dialogues in textual form, neglecting the role’s voice traits as a crucial effect in interaction, which tends to be more immersive experiences in realistic scenarios.
Approach: They propose a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency.
Outcome: The proposed model exhibits role-specific personality traits and vocal traits throughout the interaction, enabling a mixture of speech and language responses.
Beyond the Final Actor: Modeling the Dual Roles of Creator and Editor for Fine-Grained LLM-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to detect large language models (LLMs) use binary or ternary classifications, which can only distinguish pure human/LLM text or collaborative text at best.
Approach: They propose a fine-grained method that characterizes distinct signatures of creator and editor by using Rhetorical Structure Theory to construct a logic graph for creator's foundation and extracting Elementary Discourse Unit (EDU)-level features for the editor's style.
Outcome: The proposed method outperforms 12 baselines in identifying fine-grained types with low false alarms, offering a policy-aligned solution for LLM regulation.
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)

Copied to clipboard

Challenge: generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap.
Approach: They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback .
Outcome: The proposed system significantly improves image reasoning and generation quality.
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are becoming more popular and are gaining widespread use in artificial intelligence.
Approach: They propose a unified framework that addresses both privacy preservation and model compression in federated settings.
Outcome: The proposed framework maintains competitive performance comparable to full-sized LLMs while ensuring robust privacy protection through its federated architecture.
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing legal language models struggle with dynamic courtroom interactions, resulting in overfitting to standardized legal tasks.
Approach: They propose a new adversarial evolutionary approach for agents that performs dynamic knowledge learning and evolution through structured adversarials in a simulated courtroom program.
Outcome: The proposed approach outperforms existing LLM-based models in three critical dimensions: cognitive agility, professional knowledge, and logical rigor.
EventRAG: Enhancing LLM Generation with Event Knowledge Graphs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to text generation often neglect event structures that shape real-world narratives.
Approach: They propose a framework that integrates structured event semantics with iterative retrieval and inference to enhance text generation.
Outcome: Experiments on UltraDomain and MultiHopRAG show that the proposed framework outperforms baseline RAG systems in generation effectiveness, logical consistency, and multi-hop reasoning accuracy.
An Auxiliary Task Boosted Multi-task Learning Method for Service Account Retrieval with Limited Human Annotation (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches to service account retrieval have limited human annotation, resulting in labor-intensive and time-consuming tasks.
Approach: They propose an Auxiliary task Boosted Multi-Task Learning method which introduces multiple auxiliary tasks and enhances the performance of the main task, service account retrieval.
Outcome: The proposed method improves the performance of the main task, service account retrieval.
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed.
Approach: They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting.
Outcome: The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data.
RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners (2024.lrec-main)

Copied to clipboard

Challenge: Existing solutions to reasoning tasks require extensive human annotations or fail in scenarios with inconsistent responses.
Approach: They propose a new method that enables LLMs to self-rank their responses without additional resources.
Outcome: The proposed method improves reasoning performance of ChatGPT and GPT-4 with 13% improvement over existing methods.
Dual Attention Model for Citation Recommendation (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for recommending citations suffer from severe information loss . citation recommender methods do not consider the section of the paper for which the user is writing and for which they need to find a citation .
Approach: They propose a novel embedding-based neural network to recommend citations during manuscript preparation.
Outcome: The proposed method can recommend citations during manuscript preparation.
FedCoT: Federated Chain-of-Thought Distillation for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as a transformative force in artificial intelligence, demonstrating exceptional proficiency across various tasks.
Approach: They propose a federated framework for the Chain-of-Thought distillation of knowledge from LLMs to SLMs, while adhering to privacy requirements.
Outcome: The proposed framework ensures secure knowledge transfer from an LLM on a high-powered server to an SLM on resource-constrained client while adhering to privacy requirements.
Logical Consistency as a Bridge: Improving LLM Hallucination Detection via Label Constraint Modeling between Responses and Self-Judgments (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for hallucination detection focus on implicit neural uncertainty or explicit symbolic reasoning, ignoring factual hallucinosities.
Approach: They propose a framework that bridges neural features and symbolic judgments for hallucination detection by leveraging a "meta-judgment" process to map symbolic labels back into the feature space.
Outcome: Extensive experiments on 4 public datasets, across 4 LLMs, against 8 baselines demonstrate the superiority of LaaB.
CLGSI: A Multimodal Sentiment Analysis Framework based on Contrastive Learning Guided by Sentiment Intensity (2024.findings-naacl)

Copied to clipboard

Challenge: Recent studies have focused on contrastive learning, but lack detailed learning of the distribution of sample pairs with different sentiment intensity differences in the contrastive training representation space.
Approach: They propose a framework for multimodal sentiment analysis based on contrastive learning guided by sentiment intensity (CLGSI) it selects positive and negative sample pairs based upon sentiment intensity differences and assigns corresponding weights accordingly.
Outcome: The proposed framework extracts common features between different modalities and then uses them to predict sentiment intensity.
A Black-Box Attack on Code Models via Representation Nearest Neighbor Search (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for generating adversarial code examples face challenges such as limted availability of substitute variables and the creation of adversarials with noticeable perturbations.
Approach: They propose a search seed based on historical attacks to find adversarial substitutes . they employ a pre-trained variable name encoder to map the search seed to a continuous vector space .
Outcome: The proposed approach outperforms baseline methods in terms of ASR and QT.
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)

Copied to clipboard

Challenge: Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization .
Approach: They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume.
Outcome: Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks (2025.findings-emnlp)

Copied to clipboard

Challenge: Despite advances in improving large language model (LLM) to refuse to answer malicious instructions, LLMs remain vulnerable to jailbreak attacks where attackers generate instructions with distributions differing from safety alignment corpora.
Approach: They propose a framework that leverages embedding space distribution analysis to generate jailbreak-like instructions.
Outcome: The proposed framework shows significant decreases in attack success rate on Qwen2.5, Llama3.1, and Llma3.2 without compromising their utility.
TrNews: Heterogeneous User-Interest Transfer Learning for News Recommendation (2021.eacl-main)

Copied to clipboard

Challenge: Existing content-based recommendations fail when new users use them or a new article is created.
Approach: They propose a model to transfer knowledge from a source corpus to a target corpus and use it to generate representations for unseen users in the future.
Outcome: The proposed model can be used to generate representations for unseen users in the future.
The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluations of LLMs' moral reasoning capabilities rely on single-step evaluations, ignoring how models adapt to evolving ethical challenges.
Approach: They propose a framework to evaluate evolving moral judgments of large language models (LLMs) using multi-step moral dilemma questionnaires.
Outcome: The proposed framework enables a fine-grained analysis of how LLMs adjust their moral reasoning across escalating dilemmas.
Chinese Idiom Paraphrasing (2023.tacl-1)

Copied to clipboard

Challenge: Chinese idioms are hard to understand by children and non-native speakers due to their non-compositionality and metaphorical meaning.
Approach: They propose a task to rephrase idiom-containing sentences to non-idiomatic ones under the premise of preserving the original sentence’s meaning.
Outcome: The proposed method has better performance than baselines based on the established dataset.
Adaptive Gating in Mixture-of-Experts based Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models employ a fixed gating network where each token is computed by the same number of experts.
Approach: They propose a flexible training strategy that allows tokens to be processed by a variable number of experts based on expert probability distribution.
Outcome: The proposed model reduces training time and inference quality while maintaining sparsity while maintaining inference accuracy.
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Recent research in large language models (LLMs) has focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLM to small language models at downstream clients.
Approach: They propose a parameter-efficient federated mutual knowledge transfer framework for large and small language models that allows for token alignment and selective knowledge transfer between client-side LLMs and a server-side SLM.
Outcome: The proposed framework enhances the performance of both LLMs and SLMs with clients' unique domain insights while preserving the server's LLM and client's unique domain insight.
Aspect and Sentiment Aware Abstractive Review Summarization (C18-1)

Copied to clipboard

Challenge: Abstractive summarization is a task that generates short and concise summaries of user generated reviews.
Approach: They propose an interactive attention mechanism to learn the representations of context and aspect words within reviews, acted as an encoder.
Outcome: The proposed model achieves impressive results compared to other strong competitors on a real-life dataset.
FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models (LLMs) suffer from a performance bottleneck . Existing approaches like Offsite-Tuning (OT) secure the LLMs IP .
Approach: They propose a framework that replaces weak adapters with a unified, powerful Proxy Small Language Model (SLM) they propose 'resource-friendly' compression and 'robust optimization' to handle data heterogeneity.
Outcome: Experiments show that FedProxy outperforms OT and centralized fine-tuning methods.
Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval? (2026.findings-acl)

Copied to clipboard

Challenge: Rapid advances in multimodal large language models have revolutionized cross-modality understanding.
Approach: They propose a method that uses whitening transformations to adjust MLLM representation spaces . they propose ML models that are dominated by textual semantics and visual semantics .
Outcome: The proposed approach improves zero-shot multimodal retrieval performance without fine-tuning efforts.
Plug-and-Play Data Module for Code RL: Adaptive Ambiguity Replay (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reinforcement learning (RL) rely on static, in-epoch metrics that overlook training dynamics, often introducing low-utility or outdated data.
Approach: They propose a plug-and-play module that prioritizes cross-epoch ambiguous samples to neutralize the noise from stale experiences.
Outcome: Extensive experiments on nine LLMs show that Adaptive Ambiguity Replay outperforms state-of-the-art baselines on real-world code editing tasks.
Chameleon: A Language Model Adaptation Toolkit for Automatic Speech Recognition of Conversational Speech (D19-3)

Copied to clipboard

Challenge: Language model adaptation (LMA) is a promising solution for conversational speech recognition systems.
Approach: They propose to use language model adaptation techniques to adapt language models to conversational speech recognition.
Outcome: The proposed toolkit compares state-of-the-art language model adaptation techniques in conversational speech recognition tasks.
PrivNet: Safeguarding Private Attributes in Transfer Learning for Recommendation (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing research focuses on the recommendation performance of the target domain while ignores the privacy leakage of the source domain.
Approach: They propose to learn a privacy-aware neural representation by improving target performance while protecting source privacy.
Outcome: The proposed model can disentangle the knowledge benefitting the transfer from leaking the privacy.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning (D19-1)

Copied to clipboard

Challenge: Existing methods to extract aspects and sentiments are limited due to lack of annotated sequence data.
Approach: They propose a Selective Adversarial Learning method to align latent correlation vectors . they propose tagging a set of aspect boundary tags and sentiment tags to create a joint label space .
Outcome: The proposed method can learn weights for words to achieve fine-grained adaptation.
Model-based Large Language Model Customization as Service (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model services require users to upload data for fine-tuning . current methods for customization are noisy and require sensitive domain data .
Approach: *Llamdex is a framework that facilitates LLM customization as a service . client uploads pre-trained domain-specific *models* rather than data .
Outcome: *Llamdex* framework improves domain-specific accuracy by up to 26% over state-of-the-art private data synthesis methods .
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)

Copied to clipboard

Challenge: Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency.
Approach: They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process.
Outcome: The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing.
Unified Hallucination Detection for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: despite significant strides in multimodal tasks, MLLMs are plagued by the critical issue of hallucination.
Approach: They propose a meta-evaluation benchmark to facilitate evaluation of advancements in hallucination detection methods.
Outcome: The proposed framework validates hallucinations robustly and provides strategic insights . MHaluBench is a meta-evaluation benchmark designed to facilitate evaluation .
Learn to Cross-lingual Transfer with Meta Graph Learning Across Heterogeneous Languages (2020.emnlp-main)

Copied to clipboard

Challenge: Existing mPLM-based methods focus on designing costly model pre-training while ignoring equally crucial downstream adaptation.
Approach: They propose a meta graph learning method that extracts meta-knowledge from historical CLT experiences to learn to cross-lingual transfer.
Outcome: The proposed method can learn to cross-lingual transfer by extracting meta-knowledge from historical CLT experiences (tasks) it can also capture intrinsic language relationships to explicitly guide cross-linguistic transfer.
RLShield: Dynamic Jailbreak Detection for LLMs via Reinforced Adaptive Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to detect jailbreak prompts rely on static model components or fixed decision thresholds.
Approach: They propose a dynamic jailbreak detection framework that employs reinforcement learning for adaptive threshold selection.
Outcome: Experimental results show that the framework outperforms baselines in detection performance while maintaining high computational efficiency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations