Papers by Zhijie Deng
UniCM: A Unified Consistency Model For Efficient Multimodal Generation and Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Consistency models (CMs) have shown promise in the efficient generation of both image and text. |
| Approach: | They propose to use a discrete token for both image and text generation to achieve a unified denoising perspective. |
| Outcome: | The proposed model outperforms SD3 on GenEval and Image Reward while being 1.5 faster at long-sequence generating speed. |
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing MoE methods require a constant top-k routing for all tokens, which is restrictive because of the number of experts required for feature abstraction. |
| Approach: | They propose a token-adaptive routing method that allows different tokens to select a different number of experts. |
| Outcome: | a new method can reduce average expert load while achieving superior performance. |
SIFT: Grounding LLM Reasoning in Contexts via Stickers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using a new approach, we can improve the pass@1 accuracy of LLM reasoning in large language models. |
| Approach: | They propose a method that leverages increasing inference-time compute to ground LLM reasoning in contexts. |
| Outcome: | The proposed approach improves pass@1 accuracy of DeepSeek-R1 on AIME2024 from 78.33% to **85.67%** and that on Aime2025 from 69.8% to **77.33%**. |
Fast Quiet-STaR: Thinking Without Thought Tokens (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have achieved impressive performance across a range of tasks, but further gains require more than scaling up model sizes or training data. |
| Approach: | They propose a method that gradually reduces the number of thought tokens . this method allows models to internalize more abstract reasoning processes . |
| Outcome: | The proposed framework preserves the benefits of token-level reasoning while reducing computational cost. |
OFFSIDE: Benchmarking Unlearning Misinformation in Multimodal Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for MU are limited by a lack of image diversity and coarse-grained unlearning targets. |
| Approach: | They propose a benchmark to evaluate misinformation unlearning in MLLMs . OFFSIDE supports advanced unlearning targets such as fine-grained unlearning and visual rumor removal. |
| Outcome: | OFFSIDE supports advanced unlearning targets, such as fine-grained unlearning and visual rumor removal. |
SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning (2025.findings-acl)
Copied to clipboard
Junkai Chen, Zhijie Deng, Kening Zheng, Yibo Yan, Shuliang Liu, PeiJun Wu, Peijie Jiang, Jia Liu, Xuming Hu
| Challenge: | Existing methods for MU forget quality and model utility are not fully explored for safety in MLLMs. |
| Approach: | They propose a safety unlearning benchmark for MLLMs to measure over-forgetting . they propose MU methods to forget quality and model utility . |
| Outcome: | The proposed method reduces over-forgetting by 79.5% while maintaining forget quality and model utility. |
Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models can be used to produce text that is coherent, well-written, and persuasive . some individuals have misused LLMs for nefarious purposes, such as creating fake news articles or engaging in cheating . |
| Approach: | They propose to incorporate a Bayesian surrogate model to improve query efficiency . they propose to select typical samples based on Bayes' uncertainty and interpolate scores . |
| Outcome: | The proposed method significantly outperforms existing approaches under a low query budget. |
TPS-Bench: Evaluating AI Agents’ Tool Planning & Scheduling Abilities in Compounding Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | Large language model (LLM) agents have demonstrated strong problem-solving competence across domains like research and coding. |
| Approach: | They propose to use a tool repository to analyze the ability of large language model agents to solve complex problems. |
| Outcome: | The proposed model outperforms open-source and closed-source models in task completion rate and efficiency. |
Unveiling Uncertainty: A Deep Dive into Calibration and Performance of Multimodal Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Multimodal large language models combine visual and textual data for tasks like image captioning and visual question answering. |
| Approach: | They propose temperature scaling and iterative prompt optimization to calibrate MLLMs and enhance model reliability. |
| Outcome: | The proposed techniques improve MLLMs and improve model reliability. |