Papers by Dongsheng Wang
CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes. |
| Approach: | They propose a benchmark to evaluate LLMs' ability to perform codeflow by reusing existing functions over multiple turns. |
| Outcome: | The proposed benchmarks show that LLMs perform significantly worse in multi-turn codeflow scenarios and that their performance inversely correlates with dependency complexity. |
MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims (D19-1)
Copied to clipboard
Isabelle Augenstein, Christina Lioma, Dongsheng Wang, Lucas Chaves Lima, Casper Hansen, Christian Hansen, Jakob Grue Simonsen
| Challenge: | Existing efforts to verify factual claims are limited by small datasets or artificially constructed datasets. |
| Approach: | They propose to use the largest publicly available dataset of naturally occurring factual claims for automatic claim verification. |
| Outcome: | The proposed model outperforms baseline models and evidence pages significantly. |
DocLLM: A Layout-Aware Generative Language Model for Multimodal Document Understanding (2024.acl-long)
Copied to clipboard
Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, Xiaomo Liu
| Challenge: | Documents with rich layouts are a significant portion of enterprise corpora and document AI is still a challenge. |
| Approach: | They propose a lightweight extension to traditional large language models for reasoning over visual documents that takes into account both textual semantics and spatial layout. |
| Outcome: | The proposed model outperforms existing large language models on 14 out of 16 datasets and generalizes well to 4 out of 5 previously unseen datasets. |
TTPA: Token-level Tool-use Preference Alignment Training Framework with Fine-grained Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tool-learning methods often overlook fine-grained optimization of internal tool call details. |
| Approach: | They propose a training paradigm for constructing token-level tool-use preference datasets . reversed dataset construction is a method for creating high-quality, multi-turn tool-user datasets by reversing the generation flow. |
| Outcome: | a new training paradigm improves tool-using performance and generalizes results. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack immersion and adaptability, resulting in limited character orchestration and on-the-fly character introduction. |
| Approach: | They propose an LLM-based framework that allows actors to interact with users in an ongoing narrative. |
| Outcome: | The proposed framework outperforms commercial LLMs in character consistency, environment grounding, and narrative coherence. |
PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning (2026.findings-acl)
Copied to clipboard
Ruixiang Feng, Yuntao Wen, Silin Zhou, Ke Shi, Yifan Wang, Ran Le, Zhenwei An, Zongchao Chen, Chen Yang, Guangyue Peng, Yiming Jia, Dongsheng Wang, Tao Zhang, Lisi Chen, Yang Song, Shen Gao, Shuo Shang
| Challenge: | Existing LRMs often suffer from "overthinking" and excessively long reasoning traces . a dual-level framework for length compression of LRM is proposed . |
| Approach: | They propose a framework for prefix-protected and difficulty-aware compression under hierarchical supervision. |
| Outcome: | The proposed framework reduces token usage while improving accuracy on math benchmarks. |
PEPE: Long-context Extension for Large Language Models via Periodic Extrapolation Positional Encodings (2025.findings-emnlp)
Copied to clipboard
Jikun Hu, Dongsheng Guo, Yuli Liu, Qingyao Ai, Lixuan Wang, Xuebing Sun, Qilei Zhang, Quan Zhou, Cheng Luo
| Challenge: | Long-context extension attempts to extend contextual window in pre-trained LLMs . primary method involves expanding initial positional encodings, disrupting positional learning . |
| Approach: | They propose a new extension strategy based on Rotary Position Embedding to extend contextual window in pre-trained large language models. |
| Outcome: | The proposed method can extend the contextual window in pre-trained large language models . expansion disrupts positional encodings learned during pre-training, authors show . |
LLM-based Rumor Detection via Influence Guided Sample Selection and Game-based Perspective Analysis (2025.acl-long)
Copied to clipboard
Zhiliang Tian, Jingyuan Huang, Zejiang He, Zhen Huang, Menglong Lu, Linbo Qiao, Songzhu Mei, Yijie Wang, Dongsheng Li
| Challenge: | Existing methods for rumor detection on social media are limited by limited modeling capacity and insufficient training corpora. |
| Approach: | They propose an SFT-based rumor detection model with Influence guided Sample selection and Game-based multi-perspective analysis to address these issues. |
| Outcome: | The proposed model outperforms existing SOTA on three datasets. |
CoCoLex: Confidence-guided Copy-based Decoding for Grounded Legal Text Generation (2025.acl-long)
Copied to clipboard
Santosh T.y.s.s, Youssef Tarek Elkhayat, Oana Ichim, Pranav Shetty, Dongsheng Wang, Zhiqiang Ma, Armineh Nourbakhsh, Xiaomo Liu
| Challenge: | LLMs can provide key benefits to the Legal domain, but their adoption has been hindered by their tendency to generate unfaithful, ungrounded, or hallucinatory outputs. |
| Approach: | They propose a Confidence-guided copy-based decoding strategy that dynamically interpolates the model produced vocabulary distribution with a distribution derived based on copying from the context. |
| Outcome: | The proposed method outperforms existing context-aware decoding methods on five legal benchmarks. |
Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks (2023.emnlp-main)
Copied to clipboard
Haoqi Zheng, Qihuang Zhong, Liang Ding, Zhiliang Tian, Xin Niu, Changjian Wang, Dongsheng Li, Dacheng Tao
| Challenge: | Text classification tasks often encounter few-shot scenarios with limited labeled data, and addressing data scarcity is crucial. |
| Approach: | They propose a self-evolution learning (SE) based mixup approach for data augmentation in text classification which generates more adaptive and model-friendly pseudo samples for the model training. |
| Outcome: | The proposed approach can generate more adaptive and model-friendly pseudo samples for the model training. |
GRACE: Gradient-guided Controllable Retrieval for Augmenting Attribute-based Text Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for controlling the generation of pre-trained language models infuse domain bias into the generation process, making it difficult to generate out-of-domain texts. |
| Approach: | They propose a retrieval-augmented generation framework that uses retrieval to generate fluent sentences with high attribute relevance. |
| Outcome: | The proposed method can generate fluent sentences with high attribute relevance while keeping domain bias out of the model. |
Zero-Shot Spoken Language Understanding via Large Language Models: A Preliminary Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promising results in zero-shot settings, which motivates us to explore prompt-based methods. |
| Approach: | They propose a two-stage framework which transforms the SLU task into a question-answering problem by directly prompting LLMs. |
| Outcome: | The proposed framework can be built by directly prompting LLMs to understand user needs without training data. |
Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency (2024.lrec-main)
Copied to clipboard
Toyin D. Aguda, Suchetha Siddagangappa, Elena Kochkina, Simerjot Kaur, Dongsheng Wang, Charese Smiley
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general domain datasets, but their effectiveness on domain specific datasets remains under-explored. |
| Approach: | They compare the annotations produced by three LLMs against expert annotators and crowdworkers. |
| Outcome: | The proposed models outperform expert crowdworkers and crowd-sourced annotators on domain specific datasets. |
Empathetic and Emotionally Positive Conversation Systems with an Emotion-specific Query-Response Memory (2022.findings-emnlp)
Copied to clipboard
Zhiliang Tian, Yinliang Wang, Yiping Song, Chi Zhang, Dongkyu Lee, Yingxiu Zhao, Dongsheng Li, Nevin L. Zhang
| Challenge: | Existing emotional conversation systems output responses according to either a given emotion or the user’s emotion reflected in the input queries. |
| Approach: | They propose to generate empathetic responses catering to the user’s emotions while leading the conversation to be emotionally positive by abstracting the conversation corpus and extracting the different responding strategies for different users’ emotions and conversational topics into a memory. |
| Outcome: | The proposed model surpasses the baseline methods in appropriateness, diversity, and generating emotionally positive responses. |
Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches that reduce expert activations lead to severe model performance degradation. |
| Approach: | They propose a framework that optimizes budget allocation coordinately at layer and token levels to minimize model performance degradation. |
| Outcome: | The proposed framework achieves 1.15 prefill and 1.34 decode speedups on DeepSeek-V2-Lite at half of the original budget. |
KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) is a critical task to predict missing facts among entities. |
| Approach: | They propose a knowledge-constrained generative re-ranking method based on generative large language models for KGC that can predict missing facts among entities. |
| Outcome: | The proposed method achieves state-of-the-art performance on four datasets and 9.0% and 11.1% compared to the previous methods. |
Hierarchical Safety Realignment: Lightweight Restoration of Safety in Pruned Large Vision-Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent work has shown that pruning can reduce model performance, but it can also lead to degradation in safety performance. |
| Approach: | They propose a hierarchical safety realignment approach to prune large vision-Language Models . they quantify contribution of each attention head to safety and restore neurons . |
| Outcome: | The proposed approach achieves significant safety improvements in LVLMs pruned post pruning. |
MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generation (2025.acl-industry)
Copied to clipboard
Hsin-Ling Hsu, Cong-Tinh Dao, Luning Wang, Zitao Shuai, Thao Nguyen Minh Phan, Jun-En Ding, Chun-Chieh Liao, Pengfei Hu, Xiaoxue Han, Chih-Ho Hsu, Dongsheng Luo, Wen-Chih Peng, Feng Liu, Fang-Ming Hung, Chenwei Wu
| Challenge: | Existing systems focus primarily on assessment rather than treatment planning. |
| Approach: | They propose a framework that structures LLM reasoning to align with real-life workflows. |
| Outcome: | The proposed framework outperforms baseline approaches in assessment accuracy and treatment plan quality. |
Knowledge Injection Exists in MoE? Exploring Expert-Aware Contrast Decoding in MoE for Mitigating LLMs’ Hallucinations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to mitigate hallucinations include prompt engineering and model optimization, but lack domain generalization and potential errors in fine-tuning data may exacerbate the hallucism. |
| Approach: | They propose an expert-aware adaptive contrast decoding that uses expert differences in MoE’s higher layers to mitigate hallucinations on QA tasks. |
| Outcome: | The proposed method outperforms baseline models on four datasets Large language models (LLMs) show strong performance but suffer from hallucinations, limiting their application. |
Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocation (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate remarkable capabilities but their ability to autonomously execute complex real-world tasks remains limited. |
| Approach: | They propose a parallel tool invocation framework that decomposes tasks into parallel tool-using subtasks while aggregating results for subsequent decisions. |
| Outcome: | The proposed method significantly improves task performance while reducing token consumption and inference time. |
VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimization (2024.naacl-long)
Copied to clipboard
Dongsheng Zhu, Daniel Tang, Weidong Han, Jinghui Lu, Yukun Zhao, Guoliang Xing, Junfeng Wang, Dawei Yin
| Challenge: | Current MMLMs show impressive zero-shot abilities in multi-modal tasks, but their performance depends heavily on the quality of instructions. |
| Approach: | They propose a novel approach to advancing multi-modal language models in zero-shot learning by evaluating and optimizing instructional texts through In-Context Learning. |
| Outcome: | The proposed approach improves zero-shot performance in multi-modal tasks by evaluating and optimizing instructional texts. |