Papers by Che Zhang

40 papers
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL (2025.coling-main)

Copied to clipboard

Challenge: Existing multi-hop retrieval of open-domain text-to-SQL tasks is not applicable due to the tendency to retrieve tables similar to those already retrieved but irrelevant to the question.
Approach: They propose a multi-hop table retrieval with removal task to retrieve unretrieved tables from open-domain text-to-SQL databases.
Outcome: The proposed method improves performance 5.7% over the previous state-of-the-art methods on open-domain text-to-SQL datasets.
Python is Not Always the Best Choice: Embracing Multilingual Program of Thoughts (2024.emnlp-main)

Copied to clipboard

Challenge: Program of Thoughts (PoT) is an approach characterized by its executable intermediate steps, which ensure the accuracy of the logical calculations in the reasoning process.
Approach: They propose a task and model agnostic approach which harnesses strength and diversity from various languages to achieve better performance across all tasks.
Outcome: The proposed approach outperforms Python Self-Consistency in almost all tasks and models and achieves comparable or superior performance on ChatGPT.
DAC: Decomposed Automation Correction for Text-to-SQL (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to improve text-to-SQL performance are hard to detect errors in SQL directly.
Approach: They propose to use decomposed correction to improve text-to-SQL performance . they first detect errors based on decompose subtasks, then use it to correct them .
Outcome: The proposed method improves text-to-SQL performance by 1.4% compared with previous methods .
RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generation (2024.emnlp-demo)

Copied to clipboard

Challenge: Xia et al., 2018) demonstrate that a large language model can generate and maintain high-quality code documentation.
Approach: They propose a large language model powered open-source framework for generating, maintaining, and updating code documentation.
Outcome: The proposed framework generates high-quality documentation for the entire project.
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach: They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome: The proposed model achieves comparable performance to standard dense models with more parameters.
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training (2024.emnlp-main)

Copied to clipboard

Challenge: Existing speculative decoding methods require additional model structure and training processes to assist the model for draft token generation.
Approach: They propose a make some noise training framework that introduces some noise at the input for the model to learn the denoising task.
Outcome: The proposed model improves inference speed by 2.3-2.7x times without compromising model performance.
Abacus-SQL: A Text-to-SQL System Empowering Cross-Domain and Open-Domain Database Retrieval (2025.acl-demo)

Copied to clipboard

Challenge: Existing text-to-SQL systems often lack retrieval capabilities for open-domain databases, requiring users to manually filter relevant databases.
Approach: They propose to use database retrieval technology to locate the required databases in an open-domain database environment and enhance system cross-domain transferability through data augmentation methods.
Outcome: The proposed system performs excellently in multi-turn text-to-SQL tasks, validating the proposed approach’s effectiveness.
Two-Stage Regularization-Based Structured Pruning for LLMs (2026.acl-long)

Copied to clipboard

Challenge: Structural pruning is a promising solution for large language models . prior structured pruning methods remove unimportant parameters based on certain metrics .
Approach: They propose a structural pruning method that iteratively learns the weights of transformer layers by adding their l1-norm to the loss function.
Outcome: The proposed pruning method outperforms strong layer-wise pruning methods without requiring retraining.
Enhancing Numerical Reasoning with the Guidance of Reliable Reasoning Processes (2024.acl-long)

Copied to clipboard

Challenge: Numerical reasoning is an essential ability for NLP systems to handle numeric information.
Approach: They propose a numerical reasoning method that generates reliable reasoning processes by decomposing the answer formula and aim to train models to generate the process with synthesized data.
Outcome: The proposed method improves on all five datasets with an average improvement of 1.8% compared with baselines and gpt-3.5-turbo.
M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought (2024.acl-long)

Copied to clipboard

Challenge: MCoT requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning.
Approach: They propose a benchmark to address the challenges of MCoT, and evaluate it using vision large language models.
Outcome: The proposed benchmark addresses the above challenges and shows that current models still struggle to reason in M3CoT.
DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Chain-of-Thought prompting has improved the reasoning capabilities of Large Language Models (LLMs) but it is ineffective or detrimental to the performance on reasoning tasks in Smaller Language Model (SLMs) with less than 10 billion parameters.
Approach: They propose a Dialogue-guided Chain-of-Thought method to improve the reasoning capabilities of Large Language Models (LLMs) by generating intermediate reasoning steps in a dialogue format to guide the model to the final answer.
Outcome: The proposed method can achieve significant performance gains over state-of-the-art competitors on four arithmetic reasoning datasets.
KwaiChat: A Large-Scale Video-Driven Multilingual Mixed-Type Dialogue Corpus (2025.findings-naacl)

Copied to clipboard

Challenge: Currently, video-based dialogue systems rely on a single dialogue type, hindering their versatility in practical applications.
Approach: They propose to generate video-driven multilingual mixed-type dialogues using KwaiChat . they propose to create a video-based multilingual mix of 4 dialogue types, 30 domains, 4 languages, 13 topics .
Outcome: The proposed model performs best on KwaiChat but is not perfect in this situation.
On Safety Risks in Experience-Driven Self-Evolving Agents (2026.findings-acl)

Copied to clipboard

Challenge: Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduces underexplored safety risks.
Approach: They investigate how experience accumulation and utilization in self-evolving agents affect safety performance across web-based and embodied environments.
Outcome: The findings expose inherent limitations of current self-evolving agents and call for more principled strategies to ensure safe and reliable adaptation.
Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety (2026.acl-long)

Copied to clipboard

Challenge: OpenAI introduces deliberative alignment (DA) to enhance safety of its o-series models, but effectiveness of this approach in open-source LLMs is understudied.
Approach: They propose a case-augmented deliberative alignment method for large language models . they propose to use reinforcement learning on self-generated safety reasoning chains .
Outcome: The proposed method avoids narrowly enumerated rules and allows broader adaptability.
Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue (2023.findings-emnlp)

Copied to clipboard

Challenge: E-commerce pre-sales dialogues elicit user needs and preferences for items . large language models lack domain-specific knowledge for accurate recommendations .
Approach: They propose two collaboration strategies to integrate CRS and large language models in pre-sales dialogues.
Outcome: The proposed methods can be very effective in some cases, the authors say .
Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show remarkable success in end-to-end task-oriented dialog systems . however, most models rely on large training data, which is difficult to scalable for new domains with limited labeled data.
Approach: They propose a shared-private network which exploits the relevance between the target domain and each domain.
Outcome: The proposed model outperforms existing methods on multi-domain dialogue by 13.9% on average.
DialogBench: Evaluating LLMs as Human-like Dialogue Systems (2024.naacl-long)

Copied to clipboard

Challenge: Existing benchmarks only evaluate LLMs' abilities for task completion as assistant AI.
Approach: They propose a dialogue evaluation benchmark that contains 12 dialogue tasks to evaluate LLMs' capabilities as human-like dialogue systems.
Outcome: The proposed benchmark contains 12 tasks to evaluate LLMs' capabilities . it shows that instruction tuning improves human likeness, but not as human-like systems .
Adversarial Attack against Cross-lingual Knowledge Graph Alignment (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies on cross-lingual entity alignment under adversarial attacks have not been conducted.
Approach: They propose to use adversarial attack techniques to perturb cross-lingual entity alignment under adversarials.
Outcome: The proposed model hides the attacked entities in dense regions in two KGs, and reduces the gradient vanishing issues in the process of adversarial attacks for further improving the attack effectiveness.
Concise and Precise Context Compression for Tool-Using Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods suffer from key information loss and difficulty in adjusting the length of compressed sequences based on documentation lengths.
Approach: They propose two strategies for compressing tool documentation into concise and precise summary sequences for tool-using language models.
Outcome: The proposed approach achieves comparable performance to the upper-bound baseline under 16x compression ratio.
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding (2021.acl-long)

Copied to clipboard

Challenge: Existing pre-training tasks for text and layout are effective in visually-rich document understanding tasks.
Approach: They propose to combine pre-training tasks with a multi-modal model to model interaction between text, layout and image in a single multi-module framework.
Outcome: The proposed model outperforms LayoutLM by a large margin on visual-rich document understanding tasks.
Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits (2025.coling-main)

Copied to clipboard

Challenge: Existing data on MBTI personality detection are based on self-reported labels and fail to capture the full range of population personality traits.
Approach: They construct a manually annotated MBTI personality detection dataset with soft labels under the guidance of psychologists and use them to identify the task.
Outcome: The MBTIBench is the first manually annotated MBti personality detection dataset with soft labels under the guidance of psychologists.
Scaling Laws for Code: A More Data-Hungry Regime (2026.acl-long)

Copied to clipboard

Challenge: Code Large Language Models (LLMs) are revolutionizing software engineering, but scaling laws are primarily analyzed on Natural Language (NL).
Approach: They fit Chinchilla law and Farsser law to test scaling laws for code . they find code is more data-hungry and requires higher data-to-parameter ratio .
Outcome: The proposed scaling laws show that the more expressive Farsser law offers greater accuracy and scales with model size.
Inductive-Deductive Strategy Reuse for Multi-Turn Instructional Dialogues (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods target instruction dialogues as learning goal and fine-tune user simulators to pose instructions.
Approach: They propose to use real instruction dialogues to model complex dialogue flows and pose high-quality instructions.
Outcome: The proposed method generates diverse, in-depth, and insightful instructions for a given dialogue history.
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)

Copied to clipboard

Challenge: End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity.
Approach: They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends.
Outcome: The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity.
MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System (2023.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for multi-modal sarcasm detection have some shortcomings . a new framework can leverage multi-grained cues from multiple perspectives for multimodal detection .
Approach: They propose a correction dataset that removes spurious cues and re-annotates the unreasonable samples.
Outcome: The proposed framework outperforms the existing benchmarks in multi-modal sarcasm detection.
RoT: Enhancing Table Reasoning with Iterative Row-Wise Traversals (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in reasoning large language models (RLLMs) have significantly enhanced reasoning capabilities, leading to brilliant performance on table reasoning.
Approach: They propose a method which performs iterative row-wise table traversal, allowing for reasoning extension and reflection-based refinement at each traversal.
Outcome: Experiments show that the proposed method outperforms RLLMs on WikiTableQuestions and TableBench by 4.3% and achieves state-of-the-art results with comparable models.
Beyond Examples: Towards Automated Thought-level In-Context Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: In-context learning (ICL) struggles with complex reasoning due to superficial, example-level implicit imitation.
Approach: They propose an automated method that shifts from surface-level examples to more guidance-oriented thought patterns.
Outcome: The proposed method achieves 80.6% accuracy on MATH and 62.5% on AMC, surpassing GPT-4o’s 77.2% and 57.5% accuracy.
MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on classifying cardiac conditions using ECG data but have overlooked ECG report generation, which is time-consuming and requires clinical expertise.
Approach: They propose a Multimodal ECG Instruction Tuning framework that extends the capability of large language models (LLMs) for the task.
Outcome: The proposed framework outperforms open-source LLMs and LLM backbones across two large-scale ECG datasets.
Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing work on 3D radiograph report generation focuses on 2D images, but 3D medical images provide more comprehensive diagnostic information.
Approach: They propose a comprehensive training recipe for building high-performing VLMs for 3DRRG using a publicly available 3D CT-report dataset.
Outcome: The proposed model achieves superior performance across different model sizes and input 3D medical image resolutions.
MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference (2025.naacl-long)

Copied to clipboard

Challenge: Long-context Multimodal Large Language Models (MLLMs) require substantial computational resources as their multimodal Key-Value (KV) cache grows with increasing input lengths, challenging memory and time efficiency.
Approach: They propose a dynamic multimodal KV cache allocation strategy that dynamically allocating KV size based on attention entropy to better adapt to multimodal interactions.
Outcome: The proposed model achieves up to 72% KV cache memory reduction and 2.82 faster decoding speeds while maintaining or enhancing performance on various multimodal tasks in a long context.
Pandora’s Box or Aladdin’s Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) has emerged as a promising approach to address hallucinations in large language models (LLMs).
Approach: They define seven distinct noise types from a linguistic perspective and establish a Noise RAG Benchmark (NoiserBench) they propose to evaluate noise that is beneficial to LLMs and noise that's harmful to LRMs.
Outcome: The proposed framework consists of seven distinct noise types from a linguistic perspective and includes multiple datasets and reasoning tasks.
E-ViC: Reasoning Beyond Text via Embodied Visual Chain for Spatial Intelligence (2026.acl-long)

Copied to clipboard

Challenge: Existing Vision-Language Models (VLMs) lack spatial reasoning, despite text-based CoTs . e-ViC reframes spatial intelligence as a verifiable, tool-using capability, argues a new study.
Approach: They propose a framework that moves reasoning beyond text into the visual domain . they ground reasoning in pixel-level interactions to enable human-like "look-and-confirm" strategies .
Outcome: The proposed framework outperforms existing Vision-Language Models with an average gain of 10.1%.
LLaMA-Berry: Pairwise Optimization for Olympiad-level Mathematical Reasoning via O1-like Monte Carlo Tree Search (2025.naacl-long)

Copied to clipboard

Challenge: LLaMA-Berry is an advanced mathematical reasoning framework to enhance the problem-solving ability of large language models (LLMs).
Approach: They propose a Monte Carlo Tree Search and Self-Refine framework to optimize reasoning paths and a pairwise reward model to evaluate different paths globally.
Outcome: The proposed framework overcomes inefficiencies and limitations of step-wise and greedy search algorithms, enabling more efficient exploration of solution spaces.
AutoCAP: Towards Automatic Cross-lingual Alignment Planning for Zero-shot Chain-of-Thought (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to cross-lingual chain-of-thought integrate reasoning knowledge from different languages, but they still rely on manual language specification and weight allocation.
Approach: They propose an automatic cross-lingual alignment planning framework that integrates reasoning knowledge from different languages.
Outcome: The proposed framework surpasses existing methods that require manual effort to integrate languages.
Language Anisotropic Cross-Lingual Model Editing (2023.findings-acl)

Copied to clipboard

Challenge: Existing work studies monolingual model editing, which lacks cross-lingual transferability to perform editing simultaneously across languages.
Approach: They propose a framework to naturally adapt monolingual model editing approaches to the cross-lingual scenario using parallel corpus.
Outcome: The proposed framework adapts monolingual model editing approaches to the cross-lingual scenario using parallel corpus and amplifies different subsets of parameters for each language.
Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQL (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have explored selecting relevant demonstrations from a human-labeled demonstration pool, but these methods lack diversity and incur high labeling costs.
Approach: They propose a method that iteratively fuses demonstrations to create a diverse demonstration pool based on human labeling or even from scratch with LLMs, reducing labeling costs.
Outcome: The proposed method achieves an average improvement of 2.1% based on existing labeling and 5.5% from scratch on mainstream datasets.
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to address catastrophic forgetting and knowledge transfer in large language models (LLMs) ignore potential of aligning the two modules to effectively address catastrophic forgetting and knowledge transfers simultaneously.
Approach: They propose a Shared Attentive Learning & Selection module to align the PET learning and selection modules to address catastrophic forgetting and knowledge transfer simultaneously.
Outcome: Experiments on two CL benchmarks show that the proposed framework is superior when scaled to different model sizes, different model architectures and unseen tasks.
MULTITAT: Benchmarking Multilingual Table-and-Text Question Answering (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing TATQA datasets are limited to English, leading to drawbacks . existing datasets overlook challenges of multilingual TAT-QA and do not reflect real-world multilingual scenarios .
Approach: They propose a multilingual TATQA dataset that can be translated into 10 languages . they use data from 3 mainstream TATQ datasets and analyze the results .
Outcome: The proposed dataset outperforms other baselines by an average of 3.3 .
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing studies overlook the multi-turn instruction following ability of large language models (LLMs) Extensive experiments show that Parrot improves current LLMs by up to 7.2% in multi- turn instruction following.
Approach: They propose a method for collecting multi-turn instructions that feature human-like queries, such as anaphora and ellipsis, and a context-aware preference optimization strategy to further enhance LLMs for complex queries.
Outcome: The proposed method improves existing LLMs by up to 7.2% in multi-turn instruction following.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations