Papers by Dong Du
Language Models as Inductive Reasoners (2024.eacl-long)
Copied to clipboard
| Challenge: | Inductive reasoning is a core component of human intelligence. |
| Approach: | They propose a task to induce natural language rules from natural language facts using natural language as representation for knowledge instead of formal language. |
| Outcome: | The proposed task surpasses baselines in both automatic and human evaluations. |
Disentangled Multi-span Evolutionary Network against Temporal Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge Graphs neglect internal structural interactions between subgraphs and ignore potential smooth features that do not lead to semantic changes. |
| Approach: | They propose to use a disentangled multi-span evolutionary network to capture local neighbor features while perceiving historical neighbor semantic information. |
| Outcome: | Extensive experiments show that the proposed model outperforms the state-of-the-art in TKG reasoning by 22.7%. |
The Impact of Reasoning Step Length on Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Long reasoning steps in LLMs improve reasoning abilities, but the correlation between their effectiveness and the length of reasoning steps remains largely unknown. |
| Approach: | They conducted experiments that expand and compress the rationale reasoning steps within CoT demonstrations while keeping all other factors constant. |
| Outcome: | The results show that lengthening the reasoning steps in prompts significantly enhances LLMs’ reasoning abilities across multiple datasets. |
CodeArena: A Collective Evaluation Platform for LLM Code Generation (2025.acl-demo)
Copied to clipboard
Mingzhe Du, Anh Tuan Luu, Bin Ji, Xiaobao Wu, Yuhao Qing, Dong Huang, Terry Yue Zhuo, Qian Liu, See-Kiong Ng
| Challenge: | Large Language Models (LLMs) have reshaped code generation, but persistent challenges impede accurate assessment. |
| Approach: | They propose an online evaluation framework tailored for large language models to assess their coding capabilities. |
| Outcome: | a new evaluation framework for large language models (LLMs) provides unbiased, unbiased evaluations and open access to solutions and test cases. |
Measuring the Instability of Fine-Tuning (2023.acl-long)
Copied to clipboard
| Challenge: | Many previous studies have investigated fine-tuning pre-trained language models on downstream tasks with varying random seeds, but they only used the standard deviation of performance scores (SD) as their measure, which is a narrow characterization of instability. |
| Approach: | They propose a systematic evaluation framework for the standard deviation of performance scores (SD) and six other measures quantifying instability of different granularity levels. |
| Outcome: | The proposed framework will be used to evaluate the validity of these measures and to improve them. |
FinCall-Surprise: A Large Scale Multi-modal Benchmark for Earning Surprise Prediction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models for earnings surprise prediction rely on expensive, proprietary data. |
| Approach: | They propose to use textual transcripts and audio recordings to build a dataset for earnings surprise prediction. |
| Outcome: | The proposed dataset includes 2,688 unique conference calls from 2019 to 2021. |
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations (2023.acl-long)
Copied to clipboard
Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong, Jingfei Du, Ann Lee, Vedanuj Goswami, Changhan Wang, Juan Pino, Benoît Sagot, Holger Schwenk
| Challenge: | SpeechMatrix is a large-scale multilingual corpus of speech-to-speech translations mined from real speech of European Parliament recordings. |
| Approach: | They present a large-scale multilingual corpus of speech-to-speech translations mined from real speech of European Parliament recordings. |
| Outcome: | The proposed model can train bilingual models on 136 language pairs with 418 thousand hours of speech. |
A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sparse Autoencoders (SAEs) can disentangle complex features into more interpretable components. |
| Approach: | They propose to use Sparse Autoencoders to disentangle LLM features into more interpretable components. |
| Outcome: | The proposed method disentangles complex features into more interpretable components. |
A Survey of Post-Training Scaling in Large Language Models (2025.acl-long)
Copied to clipboard
Hanyu Lai, Xiao Liu, Junjie Gao, Jiale Cheng, Zehan Qi, Yifan Xu, Shuntian Yao, Dan Zhang, Jinhua Du, Zhenyu Hou, Xin Lv, Minlie Huang, Yuxiao Dong, Jie Tang
| Challenge: | Large language models (LLMs) have demonstrated proficiency in understanding and generating human natural languages. |
| Approach: | They propose a framework for scaling large language models using supervised fine-tuning, RLxF and test-time compute methodologies. |
| Outcome: | The proposed model can be used to understand and generate human natural languages. |
Investigating Value-Reasoning Reliability in Small Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | sLLMs have been widely deployed in practical applications, but little attention has been paid to their value-reasoning abilities, particularly in terms of reasoning reliability. |
| Approach: | They propose a systematic evaluation framework for assessing the Value-Reasoning Reliability of small Large Language models (sLLMs) . framework includes three core tasks: Repetition Consistency task, Interaction Stability task, and Open-ended Expression Consistencies task. |
| Outcome: | The proposed framework incorporates self-reported confidence scores to evaluate the model’s value reasoning reliability from two perspectives: the model's self awareness of its values, and its value-based decision-making. |
Type Enhanced BERT for Correcting NER Errors (2023.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is the task of identifying spans that belong to particular categories, such as person, location, organization, etc. |
| Approach: | They propose a method that integrates named entity’s type information into BERT by an adapter layer and integrates it into a gazetteer. |
| Outcome: | The proposed method outperforms baselines in multiple corpus. |
Over-Generation and Compaction: A Prompting Strategy for Procedural Text Adaptation with Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing prompting strategies for large language models often yield superficial or erroneous adaptations due to alignmentinduced biases and the inherent complexity of procedural editing. |
| Approach: | They propose an overgenerationandcompaction prompting strategy that leverages the model’s latent knowledge and compacts them into concise, coherent adaptations. |
| Outcome: | The proposed approach improves adaptation consistency and feasibility compared to baseline prompting methods without additional fine-tuning or curated training resources. |
From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalities (2025.findings-acl)
Copied to clipboard
Shixin Jiang, Jiafeng Liang, Jiyuan Wang, Xuan Dong, Heng Chang, Weijiang Yu, Jinhua Du, Ming Liu, Bing Qin
| Challenge: | MLLMs are able to integrate multiple modalities into a single model to tackle complex tasks in real-world scenarios. |
| Approach: | They propose a comprehensive survey of Omni-MLLMs to address the challenges and opportunities of multimodal modeling. |
| Outcome: | The proposed model can integrate multiple modalities into a single model and provide novel perspectives. |
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline (2024.findings-emnlp)
Copied to clipboard
Yifan Xu, Xiao Liu, Xinghan Liu, Zhenyu Hou, Yueyan Li, Xiaohan Zhang, Zihan Wang, Aohan Zeng, Zhengxiao Du, Zhao Wenyi, Jie Tang, Yuxiao Dong
| Challenge: | Large language models (LLMs) have shown excellent mastering of human language but struggle in real-world applications that require mathematical problem-solving. |
| Approach: | They propose a pipeline to train a general Math-Critique model from the LLM itself to provide feedback signals and employ rejective fine-tuning and direct preference optimization over the Llm's own generations for data collection. |
| Outcome: | The proposed pipeline outperforms existing LLMs that could be two times larger. |
Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of Explainability (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Vision-Language Models have demonstrated remarkable capabilities in processing both visual and textual information. |
| Approach: | They examine the challenge of alignment and misalignment in LVLMs through an explainability lens. |
| Outcome: | The findings highlight the need for standardized evaluation protocols and in-depth explainability studies. |
Disentangling the Roles of Representation and Selection in Data Pruning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for data pruning involve many different design choices, which have not been systematically studied. |
| Approach: | They decompose data pruning into two key components: data representation and selection algorithm . theoretical and empirical results highlight crucial role of representations . |
| Outcome: | The proposed method can be used to train models with less data. |
Your Reasoning Model is Secretly a Reward Model - Optimization-Free Verification from Experience (2026.acl-long)
Copied to clipboard
| Challenge: | Existing verifiers operate on the surface text or on confidence proxies derived from token probabilities, which can be brittle. |
| Approach: | They propose a training-free, non-parametric verifier that summarizes each reasoning trace by an activation delta and compares it to two class centroids computed from labeled experience. |
| Outcome: | The proposed model improves selection and reranking on large and less-calibrated models. |
SciEvent: Benchmarking Multi-domain Scientific Event Extraction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on scientific information extraction relies on entity-relation extraction in narrow domains . current models struggle in domains such as sociology and humanities . |
| Approach: | They propose a multi-domain benchmark for scientific abstract annotations using a unified event extraction schema. |
| Outcome: | The proposed benchmark includes 500 abstracts across five research domains with manual annotations of event segments, triggers, and fine-grained arguments. |
VLMGuard-R1: Proactive Safety Alignment for VLMs via Reasoning-Driven Prompt Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | integrating vision and language models with safety standards is essential to mitigate multimodal complexity . integrating visual inputs with vision and text unveils subtle threats beyond the reach of conventional safeguards . |
| Approach: | They propose a framework that combines vision and language to provide a multimodal reasoning-driven prompt rewriting. |
| Outcome: | The proposed framework outperforms baseline models on five benchmarks with six VLMs. |
More Than Spoken Words: Nonverbal Message Extraction and Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on extracting NMs from small-scale well-structured corpora such as movie scripts wherein NM is enclosed in parentheses by scriptwriters, which greatly decreases the difficulty of extraction. |
| Approach: | They propose to extract nonverbal messages (NMs) from written text and NMs from spoken text by using a semi-supervised learning algorithm. |
| Outcome: | The extracted NMs can generate more relevant, valid, and factually consistent NM than the purely supervised generator. |
ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment (2025.emnlp-main)
Copied to clipboard
Zhipeng Bian, Jieming Zhu, Qijiong Liu, Wang Lin, Guohao Cai, Zhaocheng Du, Jiacheng Sun, Zhou Zhao, Zhenhua Dong
| Challenge: | Large language models and diffusion models have opened new possibilities for AI-generated content . personalized cover image generation remains underexplored despite its critical role in boosting user engagement on digital platforms. |
| Approach: | They propose a framework that integrates MLLM-based prompting with personalized preference alignment to generate high-quality, contextually relevant covers. |
| Outcome: | The proposed framework improves image quality, semantic fidelity, and personalization, leading to stronger user appeal and offline recommendation accuracy in downstream tasks. |
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows (2022.emnlp-main)
Copied to clipboard
| Challenge: | Despite recent progress in dialogue evaluation, how to develop automatic metrics remains an open problem. |
| Approach: | They propose a consensus-based framework for dialog evaluation using segment act flows . they propose to crowdsource a large-scale dataset for it to be evaluated . |
| Outcome: | The proposed framework can reach the best or comparable correlation with human evaluation. |
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (2024.acl-long)
Copied to clipboard
Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
| Challenge: | Large language models (LLMs) can only handle texts a few thousand tokens long, limiting their applications on longer sequence inputs, such as books, reports, and codebases. |
| Approach: | They propose a bilingual, multi-task benchmark for long context understanding that extends context windows and more sophisticated memory mechanisms to improve models' long context capabilities. |
| Outcome: | The proposed model outperforms open-source models but struggles on longer contexts. |
Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders (2025.emnlp-main)
Copied to clipboard
| Challenge: | Sparse Autoencoders (SAEs) have recently emerged as powerful tools for interpreting and steering the internal representations of large language models (LLMs). |
| Approach: | They propose a method that identifies the most influential latents by incorporating output-side gradient information. |
| Outcome: | The proposed method identifies the most influential latents by incorporating output-side gradient information. |
FinChart-Bench: Benchmarking Financial Chart Comprehension in Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | FinChart-Bench is the first benchmark specifically focused on real-world financial charts. |
| Approach: | They propose a benchmark specifically focused on real-world financial charts. |
| Outcome: | The proposed benchmark evaluates 26 state-of-the-art LVLMs on FinChart-Bench. |
Improving LLM Reasoning through Interpretable Role-Playing Steering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for role-playing rely on prompt engineering, which lacks stability and interpretability. |
| Approach: | They propose a framework that extracts latent representations from role-play prompts and constructs a steering vector that can be injected into the model's residual stream with controllable intensity. |
| Outcome: | The proposed framework extracts latent representations from role-play prompts, selects the most relevant features based on activation patterns, and constructs a steering vector that can be injected into the model’s residual stream with controllable intensity. |
Assessing the Reliability of Word Embedding Gender Bias Measures (2021.emnlp-main)
Copied to clipboard
| Challenge: | Various measures have been proposed to quantify human-like social biases in word embeddings, but they can suffer from measurement error. |
| Approach: | They propose to assess the reliability of word embedding gender bias measures by examining their reliability across different choices of random seeds, scoring rules and words. |
| Outcome: | The proposed measures can suffer from measurement error, and the results inform better design of word embedding gender bias measures. |
Q-PRM: Adaptive Query Rewriting for Retrieval-Augmented Generation via Step-level Process Supervision (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to rewriting queries often lack supervision signals for intermediate steps . existing approaches rely on outcome-supervised training or heuristic rules to guide the rewrite process . |
| Approach: | They propose a query rewriting framework that generates process-level supervision signals for intermediate steps. |
| Outcome: | a new query rewriting framework outperforms existing approaches on open-domain QA benchmarks. |
FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics (2025.coling-main)
Copied to clipboard
| Challenge: | Despite the success of fine-tuning Pre-trained Language Models, they remain susceptible to out-of-distribution input. |
| Approach: | They propose a novel approach that fine-tunes Pre-trained Language Models by transFerring Training dynamics (FTFT) FTFT uses more efficient reference models and aggressive early stopping . |
| Outcome: | The proposed approach improves the robustness of fine-tuned PLMs while reducing training costs. |