Papers by Zhuo Chen

39 papers
Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing zero-shot text-to-speech systems struggle in challenging scenarios such as tongue twisters, repeated words, code-switching, and cross-lingual synthesis.
Approach: They propose a dataset that leverages preference alignment techniques to improve performance . they also extend the Direct Preference Optimization framework to accommodate diverse TTS architectures .
Outcome: The proposed dataset improves intelligibility, similarity, and audio quality for multiple models across domains.
DET: A Dual-Encoding Transformer for Relational Graph Embedding (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to graph representation only consider the local neighbors, sacrificing the Transformer’s ability to attend to elements at any distance.
Approach: They propose a dual-encoding Transformer architecture that uses a structural encoder and a semantic encoder to seek for semantically relevant nodes.
Outcome: The proposed architecture achieves superior performance compared to state-of-the-art attention-based methods on complex relational graphs like KGs and citation networks.
PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inference (2026.acl-long)

Copied to clipboard

Challenge: Existing pruning methods ignore prefill-decode (PD) disaggregation in practice.
Approach: They propose a pruning method that is highly integrated with prefill-decode (PD) disaggregation, enabling more precise pruning of blocks.
Outcome: The proposed method achieves strong performance in both PD disaggregation and PD unified settings, and can be extended to other non-block pruning methods.
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)

Copied to clipboard

Challenge: SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation.
Approach: They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps .
Outcome: The proposed model outperforms general-purpose audio LLMs in episode-level evaluation.
Graph Enhanced Contrastive Learning for Radiology Findings Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings.
Approach: They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information .
Outcome: The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method .
Noise-powered Multi-modal Knowledge Graph Representation Framework (2025.coling-main)

Copied to clipboard

Challenge: Current efforts to integrate MMKG with pretraining are scarce.
Approach: They propose a method that integrates multi-modal entity features into MMKGs using a Transformer-based architecture equipped with modality-level noise masking.
Outcome: The proposed method achieves SOTA performance across ten datasets.
HiSVD: Principled Low-Rank Approximation of LLMs via Hierarchical Modeling of Information Capacity and Spectral Structure (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating layer importance ignore the fine-grained influence of spectral distribution shape.
Approach: They propose a hierarchical rank allocation framework with two stages to address this gap . they propose SVD-based lowrank approximation that exploits spectral heterogeneity .
Outcome: Experiments show that HiSVD outperforms state-of-the-art methods on LLMs .
Towards Reliable Large Audio Language Model (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound.
Approach: They propose to use training-free and training-based methods to enhance LALM reliability to different extents.
Outcome: The proposed methods improve the reliability of large audio language models to different extents.
Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigm (2024.findings-acl)

Copied to clipboard

Challenge: In-context learning of large-language models has achieved remarkable success in the field of natural language processing . however, the single-step chain-of-thought prompting approach faces challenges such as attention diffusion and inadequate performance in complex tasks like text-to-SQL.
Approach: They propose a workflow paradigm method to enhance the attention and problem-solving scope of large-language models through decomposition.
Outcome: The proposed method outperforms existing methods on three datasets and improves the upper limit of LLM-based approaches.
Integrating Data Validation with Large Language Models for Regulation-Guided Tabular Anomaly Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing tabular anomaly detection methods focus on detecting anomalies based on data distribution without considering regulatory compliance.
Approach: They propose a task that leverages regulations to detect anomalies in tabular data . they also develop three new datasets to address this task .
Outcome: The proposed method outperforms baselines on three new datasets.
Med-SRAF: A Multi-Agent Framework for Medical Reasoning via Semantic Routing and Agentic Fusion (2026.findings-acl)

Copied to clipboard

Challenge: Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence .
Approach: They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges.
Outcome: The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks.
ArkRepoBench: A Repository-Level Code Completion Benchmark for HarmonyOS Development (2026.findings-acl)

Copied to clipboard

Challenge: Despite the maturity of LLM-based code assistance for mainstream languages, the capabilities of ArkTS are largely unexplored.
Approach: They propose to benchmark repository-level code completion for ArkTS using 7,519 samples from 20 official HarmonyOS repositories.
Outcome: The proposed benchmark covers multiple difficulty levels and categorizes completion instances into Single-File, Cross-Filled Independent, and Cross-Filed Dependent settings based on dependency analysis.
Know the Known and the Unknown: Reasonable Answer Generation with Knowledge-Informed Citations (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches focus on generating multi-level citations linked to specific references, making it verifiable and trustworthy.
Approach: They propose a new data construction pipeline and a benchmark to improve citation granularity and awareness of unknown information.
Outcome: The proposed model improves on the existing benchmark and data construction pipeline and provides citation granularity and awareness of unknown information.
ADEPT-SQL: A High-performance Text-to-SQL Application for Real-World Enterprise-Level Databases (2025.acl-demo)

Copied to clipboard

Challenge: et al., 2017) address domain-specific knowledge barriers, schemas complexity, and computational costs of large LLMs.
Approach: They propose a domain-adapted Text2SQL system that addresses critical deployment challenges in professional fields.
Outcome: The proposed system achieves 97% execution accuracy on real-world databases . it is faster than existing systems and has a higher performance than existing ones.
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question .
Approach: They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance .
Outcome: The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered .
From Implicit Exploration to Structured Reasoning: Guideline and Refinement for LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing models rely on implicit exploration, which leads to unstable reasoning paths and lack of error correction.
Approach: They propose a framework that shifts from implicit exploration to structured reasoning through guideline and refinement.
Outcome: The proposed model outperforms strong baselines on the Big-Bench Hard benchmark.
From Conversation to Evaluation: Benchmarking LLMs on Development Knowledge via SimpleDevQA (2026.findings-acl)

Copied to clipboard

Challenge: Existing Dev Knowledge QA benchmarks are limited in development knowledge scope and often not built from real user queries.
Approach: They conduct preliminary analysis of real user–LLM dialogues from WildChat to investigate the importance of Dev Knowledge QA in AI-assisted software development scenarios.
Outcome: The proposed benchmark is based on real user–LLM dialogues from WildChat.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering (2024.findings-acl)

Copied to clipboard

Challenge: Domain-specific question answering (QA) requires a comprehensive understanding of a specific domain to answer specialized questions.
Approach: They propose a new alignment objective to align the LLM preference with different human preferences uniformly to optimize LLM performance in real-world, domain-specific QA settings.
Outcome: The proposed pipeline is superior for real-scenario domain-specific question answering with LLMs.
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)

Copied to clipboard

Challenge: GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages.
Approach: They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement.
Outcome: The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3.
Structured and Abstractive Reasoning on Multi-modal Relational Knowledge Images (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on understanding and reasoning with abstractive information from the visual modality have not explored the use of STructured and Abstractive Reasoning (STAR) on such data.
Approach: They propose an automatic STAR data engine to synthesize images with MMRK to build multi-modal instructions with reliable chain-of-thought thinking for various STAR tasks.
Outcome: The proposed framework outperforms GPT-4o in STAR and improves performance across 8 open-source MLLMs.
Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to integrate external knowledge into LLMs focus on specific problems, lacking a comprehensive exploration of the generalization and capability boundaries of SKP.
Approach: They propose a new paradigm for structural knowledge prompting to integrate external structural knowledge into LLMs by incorporating structural representations.
Outcome: The proposed benchmark SUBARU enables the evaluation of the generalization capabilities of SKP from four perspectives.
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)

Copied to clipboard

Challenge: E-commerce search relevance is a critical component of retrieval systems.
Approach: They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies.
Outcome: The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain.
LawBench: Benchmarking Legal Knowledge of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: LegalBench evaluated 20 LLMs in 162 legal tasks in 20 countries and jurisdictions.
Approach: They present a comprehensive evaluation of 21 popular Large Language Models and the first comparative analysis of the empirical results.
Outcome: The proposed benchmarks are based on the Bloom’s cognitive taxonomy and are compared to 21 popular LLMs.
Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect the knowledge boundary of Vision Large Language Models (VLLMs) are expensive and require indiscriminate retrieval to address questions that require real-time information or are knowledge-intensive.
Approach: They propose a method that fine-tunes a VLLM on an automatically constructed dataset for boundary identification.
Outcome: The proposed method reduces indiscriminate retrieval while maintaining or improving the performance of a VLLM on an automatically constructed dataset.
ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction (2026.findings-acl)

Copied to clipboard

Challenge: Empirical evaluations on state-of-the-art MLLMs reveal a significant performance gap . ML models lack the fine-grained cross-modal reasoning required to bridge visual discontinuities.
Approach: They propose a benchmark that renders fragmented documents directly from Markdown to facilitate evaluation of VRDU tasks.
Outcome: The proposed benchmark renders fragmented documents directly from Markdown.
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)

Copied to clipboard

Challenge: Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions.
Approach: They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset.
Outcome: The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality.
Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning (2025.findings-acl)

Copied to clipboard

Challenge: Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL).
Approach: They propose a solution that takes multiple compositions as inputs and constrains disentangled primitive features to be general across compositions.
Outcome: The proposed architecture significantly improves performance on three popular CZSL benchmarks and has been verified by solid ablation studies.
Self-Improvement Programming for Temporal Knowledge Graph Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods implicitly model time constraints by learning time-aware embeddings of questions and candidate answers, which is far from understanding the question comprehensively.
Approach: They propose a temporal-based temporal programming method that leverages the in-context learning ability of Large Language Models to understand combinatory time constraints in questions.
Outcome: The proposed method outperforms existing methods on multiTQ and CronQuestions datasets and is highly efficient on multi-level questions.
Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion (2024.lrec-main)

Copied to clipboard

Challenge: Existing MMKGC methods overlook the imbalance problem of modality information among entities, resulting in inadequate modal fusion and inefficient utilization of the raw modality.
Approach: They propose to integrate structural, visual, and textual information of entities into the discriminant models to predict the missing triples.
Outcome: The proposed model outperforms 19 recent methods and achieves state-of-the-art results on three public MMKGC benchmarks.
Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval (2024.emnlp-industry)

Copied to clipboard

Challenge: Generative retrieval (GR) is a transformative paradigm in search and recommender systems . however, data sparsity and long-tailed distribution hinder the full utilization of GR .
Approach: They propose a method to reduce the "Hourglass" phenomenon in RQ-SID where codebook tokens become overly concentrated.
Outcome: The proposed methods improve retrieval efficiency and generalization capabilities.
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)

Copied to clipboard

Challenge: End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems.
Approach: They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring.
Outcome: The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures.
Using Interpretation Methods for Model Enhancement (2023.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks for enhancing neural models with interpretation methods and gold rationales have not been fully explored.
Approach: They propose a framework for utilizing interpretation methods and gold rationales to enhance neural models.
Outcome: The proposed framework outperforms gradient-based methods in low-resource settings on a variety of tasks.
ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent research has neglected instances-level prompt variations and their implications on subjective evaluations.
Approach: They propose a framework to evaluate and comprehend prompt sensitivity in large language models.
Outcome: The proposed framework evaluates and comprehends prompt sensitivity in large language models.
FinHEAR: Human Expertise and Adaptive Risk-Aware Temporal Reasoning for Financial Decision-Making (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models often overlook key behavioral patterns underlying human financial behavior.
Approach: FinHEAR is a multi-agent framework for human expertise and Adaptive Risk-aware reasoning.
Outcome: FinHEAR outperforms baseline models in trend forecasting and decision-making.
Evolutionary Negative Module Pruning for Better LoRA Merging (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating multiple low-rank Adaptation experts into a single backbone are limited by negative modules.
Approach: They propose a plug-and-play LoRA pruning method to locate and exclude negative modules prior to merging.
Outcome: The proposed method boosts the performance of existing merging algorithms across languages and vision domains.
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval Augmented Generation can be used to process long contexts in Open-Domain Question-Answering tasks.
Approach: They propose a method to cover longer contexts in Open-Domain Question-Answering tasks by using a small encoder language model and cross-attention with origin inputs.
Outcome: The proposed method can cover longer contexts while keeping the computing requirements close to the baseline.
T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step (2024.acl-long)

Copied to clipboard

Challenge: Existing studies evaluate the tool utilization ability of large language models based on the final output or only consider the single-step tool calling.
Approach: They propose a new approach to evaluate the tool utilization capability of large language models (LLMs) they decompose the tool usage into multiple sub-processes, including instruction following, planning, reasoning, retrieval, understanding, and review.
Outcome: The proposed model exhibits consistency with the outcome-oriented evaluation and provides a more fine-grained analysis of the capabilities of LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations