Papers by Junlin Liu
AMO-Bench: Large Language Models Still Struggle in High School Math Competitions (2026.findings-acl)
Copied to clipboard
Junlin Liu, Shengnan An, Shuang Zhou, Dan Ma, Yehao Lin, Xinxuan Lv, Xuanlin Wang, Xiaoyu Li, Ziwen Wang, Xuezhi Cao, Xunliang Cai
| Challenge: | Existing benchmarks for mathematical reasoning are becoming less effective due to performance saturation. |
| Approach: | They propose to use a mathematical reasoning benchmark with Olympiad difficulty to evaluate top-tier LLMs. |
| Outcome: | The proposed benchmarks are cross-validated by experts to meet IMO difficulty standards and entirely original problems to prevent performance leakages from data memorization. |
Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow (2026.findings-acl)
Copied to clipboard
Yangyang Zhong, Yanmei Gu, Zhengqing Zang, Xiaomeng Li, Yuqi Ding, Xibei Jia, Yuting Shen, Zhenzhong Lan, Liwang Zhu, Weiping Liu, Junlin Zhou, Haisheng Liu, Zhong Xin Yu, Pengxin Luo, Donglian Qi, Yunfeng Yan, Junbo Zhao
| Challenge: | Autoregressive (AR) language models dominate modern natural language processing due to strong likelihood-based training objectives and reliable left-to-right decoding. |
| Approach: | They characterize MDLM behavior along two dimensions: parallelism strength and generation order . authors propose a Generate-then-Edit paradigm that mitigates dependency loss . |
| Outcome: | The proposed model improves on tasks that require "backward information" the Generate-then-Edit paradigm improves parallel decoding efficiency while reducing dependency loss. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
D-QRELO: Training- and Data-Free Delta Compression for Large Language Models via Quantization and Residual Low-Rank Approximation (2026.findings-acl)
Copied to clipboard
Junlin Li, Shuangyong Song, Guodong DU, Ngai Wong, Xuebo Liu, Yongxiang Li, Min Zhang, Jing Li, Xuelong Li
| Challenge: | Existing methods for fine-tuned large language models fail on fine-scale datasets . large data scale amplifies delta parameter magnitude, singular values, and entropy, causing compression errors. |
| Approach: | They propose a training- and data-free delta compression method that captures dominant delta structure and compensates residual low-rank approximation to recover fine-grained details from smaller residual error. |
| Outcome: | The proposed method outperforms existing methods on large-scale datasets on dense and MoE architectures. |
CARER: Contextualized Affect Representations for Emotion Recognition (D18-1)
Copied to clipboard
| Challenge: | Existing methods to model emotion-relevant content are based on rule-based and statistics-based approaches. |
| Approach: | They propose a semi-supervised graph-based algorithm to produce rich structural descriptors . they use word embeddings to evaluate the algorithm on emotion recognition tasks . |
| Outcome: | The proposed method outperforms state-of-the-art methods on emotion recognition tasks. |
Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling (2025.acl-long)
Copied to clipboard
Junlin Li, Guodong Du, Jing Li, Sim Kuan Goh, Wenya Wang, Yequan Wang, Fangming Liu, Ho-Kin Tang, Saleh Alharbi, Daojing He, Min Zhang
| Challenge: | Large Language Models (LLMs) are a cornerstone in artificial intelligence due to their exceptional performance. |
| Approach: | They propose a training-free approach that integrates existing MLLMs for effective multimodal expansion while retaining their original performance. |
| Outcome: | The proposed approach can expand LLMs' multimodal capabilities while retaining original performance. |
From Personal to Collective: On the Role of Local and Global Knowledge in LLM Personalization (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are the backbone of modern AI systems supporting a wide range of applications. |
| Approach: | They propose a Local–Global knowledge framework that augments user-specific signals with a global knowledge encoding collective behavioral trends. |
| Outcome: | The proposed framework outperforms existing methods on five personalization benchmarks. |