Papers by Min Tang
DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive (AR) decoding in large language models is latency-bounded by strictly sequential token generation. |
| Approach: | They propose a diffusion-based drafter that proposes multi-token candidates and then verifies them in parallel by the target model. |
| Outcome: | The proposed drafter generates multi-token proposals in a single forward pass while remaining compatible with standard AR verifiers. |
CHIFRAUD: A Long-term Web Text Dataset for Chinese Fraud Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Detecting fraudulent online text is essential as they exploit human greed and deceive individuals. |
| Approach: | They propose to build a long-term dataset of Chinese fraudulent texts collected over 12 months. |
| Outcome: | The proposed dataset includes 59,106 entries extracted from billions of web pages and includes large language model-based detectors and pre-trained language model approaches. |
From Charts to Code: A Hierarchical Benchmark for Multimodal Models (2026.acl-long)
Copied to clipboard
Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu, Zijian Zhang, Yifei Tao, Dongxing Mao, Yang Wan, Jingru Tan, Min Zeng, Min Li, Alex Jinpeng Wang
| Challenge: | Chart2Code is a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Approach: | They introduce Chart2Code, a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Outcome: | The proposed benchmark is the first to scale task complexity while capturing diverse scenarios. |
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve neural language models perform poorly on emerging data. |
| Approach: | They propose a lexical-level masking strategy to post-train a neural language model using static data from past years. |
| Outcome: | The proposed method outperforms existing methods on two pre-trained language models, two classification tasks, and four benchmark datasets. |
ORPP: Self-Optimizing Role-playing Prompts to Enhance Language Model Capabilities (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing research has explored model-driven strategies for prompt optimization, but these methods suffer from high computational overhead or require strong optimization capabilities from the model itself, which limits their broad applicability. |
| Approach: | They propose a framework that optimizes and generates role-playing prompts by limiting the prompt search space to role-player scenarios. |
| Outcome: | The proposed framework matches and surpasses existing prompt optimization methods in terms of performance. |
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval (2024.emnlp-industry)
Copied to clipboard
Xin Zhang, Yanzhao Zhang, Dingkun Long, Wen Xie, Ziqi Dai, Jialong Tang, Huan Lin, Baosong Yang, Pengjun Xie, Fei Huang, Meishan Zhang, Wenjie Li, Min Zhang
| Challenge: | Existing models for text retrieval are based on a multi-stage process that involves retrieving documents from a large corpus. |
| Approach: | They propose to build a multilingual text representation model and a cross-encoder reranker from scratch for text retrieval. |
| Outcome: | The proposed models outperform the state-of-the-art models on long-context retrieval benchmarks. |
Revealing and Mitigating the Local Pattern Shortcuts of Mamba (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that Mamba excels in tasks that involve localized key information but faces challenges with tasks that require handling distributed key information. |
| Approach: | They propose to introduce a global gate module into Mamba to address this problem by adding 4M extra parameters to the model. |
| Outcome: | The proposed model outperforms attention-based models on synthetic and synthetic tasks with only 4M extra parameters. |
IS-CoT: Breaking the Long-form Generation Collapse via Interleaved Structural Thinking (2026.acl-long)
Copied to clipboard
Zechen Sun, Yuyang Sun, Zecheng Tang, Juntao Li, Wenpeng Hu, Wenliang Chen, Zhunchen Luo, Guotong Geng, Min Zhang
| Challenge: | Existing models with reasoning capabilities suffer from a severe length collapse in open-ended writing . |
| Approach: | They propose a framework that embeds a dynamic plan-write-reflect cycle into the generation process and train a model with interleaved reasoning traces. |
| Outcome: | The proposed framework achieves state-of-the-art performance on long-form benchmarks compared to other models on the same dataset. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Enhancing Chain-of-Thought Reasoning via Neuron Activation Differential Analysis (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing external components of CoT, but lack internal explanations for the quality of the model's outputs. |
| Approach: | They propose an efficient method to identify reasoning-critical neurons by analyzing their activation patterns under reasoning chains of varying quality. |
| Outcome: | The proposed method shows that neurons in the feed-forward layers are critical in the generation of high-quality reasoning chains. |
Can Diffusion Model Achieve Better Performance in Text Generation ? Bridging the Gap between Training and Inference ! (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for text generation use a discrete data embedding module to map the data into the continuous space. |
| Approach: | They propose two methods to bridge the gap between training and inference by mapping the discrete text into the continuous space. |
| Outcome: | The proposed methods can achieve 100 200 speedup with better performance on 6 generation tasks. |
DUAL RM: Beyond Rule-based Preference Reward Modeling via Meta-Reward (2026.acl-long)
Copied to clipboard
Xiaobo Liang, Wanfu Wang, Qipeng Huang, Yuyang Ding, Zecheng Tang, Yixin Ji, Qianben Chen, Zhe Zhao, Kehai Chen, Juntao Li, Min Zhang
| Challenge: | Existing preference-based reward modeling methods face a recursive dependency where each verifier requires a meta-verifier, leading to continuous and costly dependence on human annotation. |
| Approach: | They propose a dual RM that couples discriminative and generative reward models under a non-parametric meta-reward. |
| Outcome: | The proposed model achieves strong performance across major preference benchmarks and even when trained exclusively on language modality, it exhibits robust cross-modal transfer on Omni-RewardBench. |
The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate their utility in character simulations, but they pose a risk of generating unsafe content. |
| Approach: | They propose a method which dynamically adjusts safety-utility preferences based on the degree of risk coupling and guides the model to generate responses biased toward utility or safety. |
| Outcome: | The proposed method improves safety metrics while maintaining utility. |
Weak-to-Strong Honesty Alignment via Learning-to-Rank Supervision (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to enhance honesty with prompt engineering and fine-tuning are limited by annotated data. |
| Approach: | They propose a framework that enhances honesty through weak-to-strong generalization by training weak LLMs under weak supervision to improve their honesty. |
| Outcome: | The proposed framework improves honesty in large models even with limited label data. |
Multimodal Invariant Sentiment Representation Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal sensing ignore significant sentiment distribution imbalances and cross-modal sentiment conflicts, hindering performance improvement. |
| Approach: | They propose a method to learn stable multimodal invariant sentiment representations by incorporating distributional discrepancies and sentiment conflicts into the model training. |
| Outcome: | The proposed method improves MSA performance and achieves new state-of-the-art. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Learning from Cognition: Enhancing RL Efficiency for LLM Reasoning via Hierarchical Metacognitive Decomposition and Refinement (2026.acl-long)
Copied to clipboard
Zexu Sun, Yongcheng Zeng, Erxue Min, Heyang Gao, Bokai Ji, Dugang Liu, Xing Tang, Xiuqiang He, Xu Chen
| Challenge: | Recent advances in Large Language Models have demonstrated notable inferential capacities via reinforcement learning (RL) however, “zero-RL” approaches relying on fixed prompt templates introduce substantial sampling inefficiencies for weak LLMs. |
| Approach: | They propose a hierarchical metacognitive RL framework that decomposes zero-accuracy problems into subproblems and prompts the policy to refine answers by referencing previous wrong solutions. |
| Outcome: | The proposed framework improves sample utilization and sample efficiency and accelerates convergence compared to baselines. |
CMD: a framework for Context-aware Model self-Detoxification (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of text detoxification fail to achieve a decent balance between effectiveness and generation quality. |
| Approach: | They propose a text detoxification framework that pays attention to both context and detoxification process. |
| Outcome: | Experiments on various LLMs show that the proposed framework can yield the best performance compared to baselines. |
DoCIA: An Online Document-Level Context Incorporation Agent for Speech Translation (2025.findings-acl)
Copied to clipboard
Xinglin Lyu, Wei Tang, Yuang Li, Xiaofeng Zhao, Ming Zhu, Junhui Li, Yunfei Lu, Min Zhang, Daimeng Wei, Hao Yang, Min Zhang
| Challenge: | Document-level context is crucial for speech translation due to noise from ASR . incorporating document-level contextual information into ST remains a challenge . |
| Approach: | They develop an online framework that integrates document-level context into machine translation . they use document-based modules to integrate document- level context into ST . |
| Outcome: | The proposed framework outperforms baselines in sentence and discourse metrics . it can correct ASR transcription errors and improve translation performance . |
Augmenting Multi-Agent Communication with State Delta Trajectory (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multi-agent systems based on large language models (LLMs) have shown to be effective in downstream tasks. |
| Approach: | They propose a protocol that transfers both natural language tokens and token-wise state transition trajectory from one agent to another. |
| Outcome: | The proposed protocol can transfer both natural language tokens and token-wise state transition trajectory from one agent to another. |
META-LORA: Memory-Efficient Sample Reweighting for Fine-Tuning Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Supervised fine-tuning (SFT) is widely adopted for tailoring large language models (LLMs) to specific downstream tasks. |
| Approach: | They propose a memory-efficient method for automatic sample reweighting that learns to re-weight fine-tuning samples by minimizing the loss on a small, high-quality validation set. |
| Outcome: | Meta-LoRA learns to reweight fine-tuning samples by minimizing the loss on a small, high-quality validation set through an end-to-end bi-level optimization framework based on meta-learning. |
Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling (2025.acl-long)
Copied to clipboard
Junlin Li, Guodong Du, Jing Li, Sim Kuan Goh, Wenya Wang, Yequan Wang, Fangming Liu, Ho-Kin Tang, Saleh Alharbi, Daojing He, Min Zhang
| Challenge: | Large Language Models (LLMs) are a cornerstone in artificial intelligence due to their exceptional performance. |
| Approach: | They propose a training-free approach that integrates existing MLLMs for effective multimodal expansion while retaining their original performance. |
| Outcome: | The proposed approach can expand LLMs' multimodal capabilities while retaining original performance. |
DataSciBench: An LLM Agent Benchmark for Data Science (2026.findings-acl)
Copied to clipboard
Dan Zhang, Sining Zhoubian, Min Cai, Fengzu Li, Lekang Yang, Wei Wang, Tianjiao Dong, Ziniu Hu, Jie Tang, Yisong Yue
| Challenge: | Existing benchmarks focus on single task, simple evaluation metrics, and readily available ground truth (GT) DataSciBench is built on curated, natural, and challenging prompts with complex evaluation criteria and uncertain GT. |
| Approach: | They propose a benchmark for evaluating Large Language Models in data science that integrates LLM-based self-consistency and human verification to ensure accuracy. |
| Outcome: | The proposed framework outperforms open-source models in all metrics and offers rigorous insights into LLM strengths and weaknesses. |
E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
Jinchang Hou, Chang Ao, Haihong Wu, Xiangtao Kong, Zhigang Zheng, Daijia Tang, Chengming Li, Xiping Hu, Ruifeng Xu, Shiwen Ni, Min Yang
| Challenge: | despite the rapid development of Large Language Models, there is no dedicated benchmark for evaluating LLMs in Chinese K-12 education. |
| Approach: | They propose to develop a benchmark specifically tailored for Chinese K-12 education. |
| Outcome: | EVAL is the first evaluation benchmark specifically tailored for Chinese K-12 education. |
Proxy-Driven Robust Multimodal Sentiment Analysis with Incomplete Data (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing model structures to handle uncertain missingness, but models still face challenges when dealing with uncertain missing data. |
| Approach: | They propose a data-centric robust multimodal sentiment analysis method, Proxy-Driven Robust Multimodal Fusion, which maps unimodal data to the latent space of Gaussian distributions to capture core features and structure. |
| Outcome: | The proposed method outperforms existing models in noise resistance and achieves state-of-the-art performance on multiple benchmark datasets. |
A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss (P18-1)
Copied to clipboard
| Challenge: | extractive models can obtain sentence-level attention with high ROUGE scores but less readable. abstractive models generate novel words and phrases not copied from the source text. |
| Approach: | They propose to combine extractive and abstractive models to achieve a unified model that generates readable paragraphs with word-level attention. |
| Outcome: | The proposed model achieves state-of-the-art ROUGE scores while being the most informative and readable summarization on the CNN/Daily Mail dataset in a solid human evaluation. |
Rethinking Negative Instances for Generative Named Entity Recognition (2024.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models are constrained by a pre-defined label set and require extensive human annotations, which limits their flexibility and adaptability to unseen tasks. |
| Approach: | They propose a Generative NER system that shows improved zero-shot performance across unseen entity domains by introducing contextual information and delineating label boundaries. |
| Outcome: | The proposed model outperforms state-of-the-art methods in zero-shot evaluation. |
DaNet: Dual-Aware Enhanced Alignment Network for Multimodal Aspect-Based Sentiment Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods assume a direct alignment between images and aspects, matching the entire image with a corresponding aspect. Existing algorithms assume 'direct alignment' between images, introducing noise. |
| Approach: | They propose a Dual-Aware Enhanced Alignment Network (DaNet) that can enhance fine-grained multimodal aspect-image alignment and denoising. |
| Outcome: | The proposed system outperforms existing methods in three subtasks and is available on https://github.com/***/DaNet. |
SR-RAG: Verifiable Multi-Hop Reasoning via On-the-fly Symbolic Graph Construction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing paradigms for multi-hop reasoning suffer from high construction costs and limited adaptability to dynamic knowledge. |
| Approach: | They propose a symbolic reasoning framework for multi-hop question answering that integrates the advantages of both paradigms by dynamically generating sub-questions, performing information retrieval and symbolic encoding based on an on-the-fly graph and using a symbol verifier to validate intermediate reasoning steps. |
| Outcome: | The proposed framework significantly improves accuracy and robustness on multiple multi-hop benchmarks and a medical dataset. |
L-CiteEval: A Suite for Evaluating Fidelity of Long-context Models (2025.acl-long)
Copied to clipboard
| Challenge: | Long-context models (LCMs) have seen remarkable advancements in recent years, facilitating tasks like long-document QA. |
| Approach: | They propose an out-of-the-box suite that can assess both generation quality and fidelity in long-context understanding tasks. |
| Outcome: | The proposed suite can assess both generation quality and fidelity in long-context understanding tasks. |
Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work finds that long CoT reasoning can be efficiently elicited by tuning on only a few examples and can easily transfer to other tasks. |
| Approach: | They propose a representation engineering method to unleash the general long CoT reasoning capabilities of LLMs. |
| Outcome: | The proposed method is effective in in-domain and cross-domain scenarios. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
Mitigating Language Confusion through Inference-time Intervention (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to address the problem of language confusion are incontext learning and supervised fine-tuning (SFT) however, they consume context window space and require extensive data collection. |
| Approach: | They propose a language-sensitive intervention that detects and assesses language confusion without additional complex mechanisms. |
| Outcome: | The proposed method detects language confusion and assesses content quality without additional complex mechanisms. |
Efficient Sparse Attention needs Adaptive Token Release (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide array of text-centric tasks, however, their ‘large’ scale introduces significant computational and storage challenges, particularly in managing the key-value states of the transformer, which limits their wider applicability. |
| Approach: | They propose to release resources from caches and rebuild key-value states by a lightweight controller module to approximate an ideal top-K sparse attention. |
| Outcome: | The proposed method achieves a significant throughput improvement of 221.8% over full attention and a model with 7 billion tokens. |
Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models (2025.acl-long)
Copied to clipboard
Suhang Wu, Jialong Tang, Chengyi Yang, Pei Zhang, Baosong Yang, Junhui Li, Junfeng Yao, Min Zhang, Jinsong Su
| Challenge: | Existing methods for terminology translation struggle with interference from irrelevant noise. |
| Approach: | They propose a Locate-and-Focus method that locates terminologies within utterances to construct translation knowledge by minimizing irrelevant information for ST models. |
| Outcome: | The proposed method locates terminologies within utterances and enhances the success rate of terminology translation while maintaining robust general translation performance. |
Open-ended Long Text Generation via Masked Language Modeling (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained autoregressive language models have dominated OPen-ended Long Text Generation (Open-LTG) however, the low inference efficiency of AR impedes their usability. |
| Approach: | They propose a representative iterative non-autoregressive (NAR) decoding strategy to improve inference efficiency for Open-LTG. |
| Outcome: | The proposed model can generate short text and collapse for long text modeling. |