Papers by Dongyang Chen
DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language Models (2024.findings-acl)
Copied to clipboard
Taolin Zhang, Qizhou Chen, Dongyang Li, Chengyu Wang, Xiaofeng He, Longtao Huang, Hui Xue’, Jun Huang
| Challenge: | Large language models (LLMs) have shown impressive results, but still suffer from hallucination, i.e., the generation of false information. |
| Approach: | They propose a task of sequential model editing that aims to rectify mistakes continuously. |
| Outcome: | The proposed method significantly outperforms baselines in single-turn and sequential editing. |
AdaTooler-V: Adaptive Tool-Use for Images and Videos (2026.findings-acl)
Copied to clipboard
Chaoyang Wang, Kaituo Feng, Dongyang Chen, Zhongyu Wang, Zhixun Li, Sicheng Gao, Meng Meng, Xu Zhou, Manyuan Zhang, Yuzhang Shang, Xiangyu Yue
| Challenge: | Existing models exhibit blind tool-use reasoning patterns, which significantly increases inference overhead and degrades model performance. |
| Approach: | They propose an MLLM that performs adaptive tool-use by determining whether a visual problem truly requires tools. |
| Outcome: | The proposed model outperforms existing methods in visual reasoning tasks. |
QueueEDIT: Structural Self-Correction for Sequential Model Editing in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models (LLMs) can be effective for correcting factual inaccuracies but can still suffer from hallucinations. |
| Approach: | They propose a queue-based self-correction framework that addresses parameter bias during sequential model editing. |
| Outcome: | The proposed framework outperforms baseline models while maintaining competitive performance in single-turn editing. |
Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to correct outdated or erroneous knowledge in large language models (LLMs) are slow and cumbersome, resulting in catastrophic knowledge forgetting and degradation of model performance. |
| Approach: | They propose a RetriEval-augmented ContInuous Prompt lEarning method that converts knowledge statements into short and informative continuous prompts, prefixed to the LLM’s input query embedding. |
| Outcome: | The proposed method improves the performance of large language models (LLMs) while maintaining the overall performance of the model. |
You Can Have a Second Chance: Unbiased and Multi-bit Watermarking for Diffusion Language Models with Regret-based Remasking (2026.acl-long)
Copied to clipboard
| Challenge: | Existing sequential LLMs cannot be directly applied to DLMs, as their generation order is arbitrary. |
| Approach: | They propose a stability-aware constraint that allows watermarking only in stable contexts and a bit-controlled, unbiased modulation to preserve the original DLM output distribution. |
| Outcome: | The proposed scheme achieves stable watermarking with minimal quality impact while maintaining high detection accuracy and multi-bit capacity. |
BELLE: A Bi-Level Multi-Agent Reasoning Framework for Multi-Hop Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies on multi-hop question answering employ specific methods regardless of question types . complexity of multihop question answerrs often exceeds knowledge boundaries of LLMs . |
| Approach: | They propose a framework that uses chain-of-thought prompting to prompt LLMs to answer multi-hop questions. |
| Outcome: | The proposed framework outperforms baseline models in multi-hop QA scenarios. |
PE: A Poincare Explanation Method for Fast Text Hierarchy Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on feature interactions neglects underlying linguistic information in feature representations. |
| Approach: | They propose a method for modeling feature interactions with hyperbolic spaces using Poincare Explanation. |
| Outcome: | The proposed method is able to model feature interactions with hyperbolic spaces in a time efficient manner. |
PwnGPT: Automatic Exploit Generation Based on Large Language Models (2025.acl-long)
Copied to clipboard
Wanzong Peng, Lin Ye, Xuetao Du, Hongli Zhang, Dongyang Zhan, Yunting Zhang, Yicheng Guo, Chen Zhang
| Challenge: | Automated exploit generation (AEG) is the automatic discovery and exploitation of vulnerabilities against unknown targets. |
| Approach: | They propose an automatic exploit generation framework that automatically solves pwn challenges by using large language models. |
| Outcome: | The proposed framework improves the completion rate of exploits on the openAI o1-preview model and the GPT-4o model. |
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)
Copied to clipboard
Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
| Challenge: | Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation. |
| Approach: | They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem. |
| Outcome: | The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance. |
AMATA: Adaptive Multi-Agent Trajectory Alignment for Knowledge-Intensive Question Answering (2026.acl-long)
Copied to clipboard
Taolin Zhang, Dongyang Li, Chen Chen, Qizhou Chen, Jiuheng Wan, Xiaofeng He, Chengyu Wang, Richang Hong
| Challenge: | Empirical results show that AMATA outperforms baseline approaches, knowledge-augmented frameworks, and LLMs on knowledge-intensive QA benchmarks. |
| Approach: | They propose an Adaptive Multi-Agent Trajectory Alignment framework that integrates external knowledge to improve response interpretability and factual grounding. |
| Outcome: | The proposed framework outperforms baseline approaches, knowledge-augmented frameworks, and LLM-based trajectory systems on five established knowledge-intensive QA benchmarks. |