Papers by Zili Wang
Few-shot Query-Focused Summarization with Prefix-Merging (2022.emnlp-main)
Copied to clipboard
| Challenge: | Query-focused summarization has been considered as an important extension for text summarizing . lack of large-scale datasets hinders its development . |
| Approach: | They propose to integrate text summarization and question answering into a prefix-based pretraining strategy for few-shot learning in query-focused summarizing. |
| Outcome: | The proposed prefix-based pretraining outperforms fine-tuning on query-focused summarization. |
Personalized Large Language Model Assistant with Evolving Conditional Memory (2025.coling-main)
Copied to clipboard
| Challenge: | With the rapid development of large language models, personalized large language model assistants like ChatGPT are limited in personalized services. |
| Approach: | They propose a plug-and-play framework that could facilitate personalized large language model assistants with evolving conditional memory. |
| Outcome: | The proposed framework can preserve the knowledge and experience from the history dialogue with the user, which can be applied to future tailored responses that better align with the users' preferences. |
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing performance through increased use of expert knowledge often result in diminishing sparsity during expert selection. |
| Approach: | They propose a framework that integrates the computational processes of MoE with the concept of knowledge transferring in multi-task learning. |
| Outcome: | The proposed framework outperforms existing methods under identical conditions concerning the number of experts. |
UniICL: An Efficient ICL Framework Unifying Compression, Selection, and Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve reasoning abilities of Large Language Models (LLMs) have limitations due to excessive growth in context length, causing large hardware burden. |
| Approach: | They propose a novel Unified ICL framework that unifies demonstration compression, demonstration selection, and final response generation. |
| Outcome: | The proposed framework unifies demonstration compression, demonstration selection, and final response generation. |
Separating Context and Pattern: Learning Disentangled Sentence Representations for Low-Resource Extractive Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Context information is one of the key factors for extractive summarization, but other factors can be used to identify sentence importance. |
| Approach: | They propose to disentangle context and pattern factors for extractive summarization . they separate context and patterns for a better generalization ability in low-resource setting . |
| Outcome: | The proposed model can be used in the zero-shot setting or fine-tuned in the few-shot settings. |
Multi-matrix Factorization Attention (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing variants for Multi-Head Attention (MHA) fail to maintain strong performance under stringent Key-Value cache (KV cache) constraints. |
| Approach: | They propose to use multi-matrix factorization attention and MFA-Key-reuse attention architectures to increase model capacity under tight KV cache constraints. |
| Outcome: | The proposed architecture outperforms existing methods while reducing KV cache usage by 56% and 93.7% in large-scale experiments. |
Event Graph based Sentence Fusion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence fusion is a conditional generation task that merges related sentences into a coherent text. |
| Approach: | They propose to build an event graph from the input sentences to capture related events in a structured way and use the constructed event graph to guide sentence fusion. |
| Outcome: | The proposed method achieves state-of-the-art on two datasets . it is based on the input sentences and shows that it is effective . |
Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedback (2024.findings-acl)
Copied to clipboard
Zhangqian Bi, Yao Wan, Zheng Wang, Hongyu Zhang, Batu Guan, Fangxin Lu, Zili Zhang, Yulei Sui, Hai Jin, Xuanhua Shi
| Challenge: | Large Language Models (LLMs) generate code for given contexts, such as incomplete code, class, data structure, or project-specific information. |
| Approach: | They propose a compiler feedback-based code generation approach that leverages static analysis to identify mismatches between the generated code and the project's context. |
| Outcome: | The proposed model outperforms retrieval-based code generation baselines and significantly outperfies the existing large language models. |
SSEGCN: Syntactic and Semantic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis (2022.naacl-main)
Copied to clipboard
| Challenge: | Aspect-based Sentiment Analysis (ABSA) aims to predict sentiment polarity towards aspects in sentences . a novel model for ABSA is proposed, but how to harness it is still a challenge . |
| Approach: | They propose a syntactic and semantic enhanced Graph Convolutional Network (SSEGCN) model for ABSA task using aspect-aware attention mechanism and self-attention. |
| Outcome: | The proposed model outperforms state-of-the-art methods on benchmark datasets. |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
A Closer Look into Mixture-of-Experts in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Mixture-of-experts (MoE) architectures are gaining increasing attention for their unique properties and remarkable performance. |
| Approach: | They propose a mixture-of-experts architecture that allows for model scaling without sacrificing computational efficiency. |
| Outcome: | The proposed model increases model size without sacrificing computational efficiency . the proposed model is modular and can be used by a broad spectrum of practitioners . |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)
Copied to clipboard
Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang
| Challenge: | Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence. |
| Approach: | They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included . |
| Outcome: | The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model. |
CIRAG: Construction–Integration Retrieval and Adaptive Generation for Multi-hop Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for iterative retrieval-augmented generation (iRAG) suffer from greedy single-path expansion and granularity–demand mismatch . |
| Approach: | They propose a model that constructs candidate triples and history-conditionally integrates them to distill core triples to generate the next-hop query. |
| Outcome: | The proposed model mitigates the greedy single-path expansion and granularity–demand mismatch by preserving multiple plausible evidence chains. |
Faster and Better LLMs via Latency-Aware Test-Time Scaling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. |
| Approach: | They propose two approaches to achieve latency-optimal TTS by branch-wise parallelism and sequence-wise parallelism. |
| Outcome: | The proposed approach achieves latency-optimal TTS for large models . branch-wise parallelism and sequence-wise parallelism are key approaches . |
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT (2020.coling-main)
Copied to clipboard
| Challenge: | Existing extractive summarization models generate summaries by selecting salient sentences, but there is a gap between the human-written gold summary and oracle sentence labels. |
| Approach: | They propose to extract fact-level semantic units for better extractive summarization by incorporating a hierarchical structure into the model and incorporate it with BERT using a Hierarchical graph mask. |
| Outcome: | The proposed model achieves state-of-the-art on the CNN/DaliyMail dataset. |
RefGPT: Dialogue Generation of GPT, by GPT, and for GPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capability to resolve a wide range of NLP tasks by fine-tuning high-quality instruction data. |
| Approach: | They propose a method to generate huge truthful and customized dialogues without worrying about factual errors caused by the model hallucination. |
| Outcome: | The proposed method solves the model hallucination in dialogue generation by restricting the LLMs to leverage the given reference instead of reciting their own knowledge to generate dialogues. |