Papers by Jingren Zhou
FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point (2025.findings-acl)
Copied to clipboard
Ke Yi, Jianwei Zhang, Zhiying Xu, Xinlong Yang, Yang Zhou, Minmin Sun, Zengke Liu, Tong Zhang, Junyang Lin, Jingren Zhou
| Challenge: | Auto-regressive decoding is a memory-bound job, meaning decoding performance is limited by the bandwidth rather than the computational capabilities of the GPU. |
| Approach: | They propose a framework that supports lossless weight-only quantization inference and validate it on Qwen and LLaMA Models. |
| Outcome: | The proposed framework achieves the highest efficiency with lossless accuracy on Qwen and LLaMA Models across various modalities. |
Towards General Agentic Intelligence via Environment Scaling (2026.findings-acl)
Copied to clipboard
Runnan Fang, Shihao Cai, Baixuan Li, Jialong Wu, Guangyu Li, Wenbiao Yin, Xinyu Wang, Xiaobin Wang, Liangcai Su, Zhen Zhang, Shibin Wu, Zhengwei Tao, Yong Jiang, Pengjun Xie, Ningyu Zhang, Fei Huang, Wentao Zhang, Jingren Zhou
| Challenge: | Diverse real-world APIs require precise, robust function-calling intelligence, which needs agents to develop these capabilities through interaction in varied environments. |
| Approach: | They propose a framework that scales up environments to enable agentic intelligence . they use a two-phase agent fine-tuning strategy to first endow agents with basic agentic capabilities, then specializing them for domain-specific contexts. |
| Outcome: | Experiments on -bench, -Bench, and ACEBench show that the model significantly enhances the models’ function-calling capability. |
mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding (2024.findings-emnlp)
Copied to clipboard
Anwen Hu, Haiyang Xu, Jiabo Ye, Ming Yan, Liang Zhang, Bo Zhang, Ji Zhang, Qin Jin, Fei Huang, Jingren Zhou
| Challenge: | Existing Multimodal Large Language Models lack general structure understanding abilities for text-rich document images. |
| Approach: | They propose to use unified structure learning to boost the performance of MLLMs by encoding structure information into text-rich images. |
| Outcome: | The proposed model achieves state-of-the-art on 10 visual document understanding benchmarks. |
mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understanding (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have improved document understanding performance but generate thousands of visual tokens for a single document image, leading to excessive GPU memory and slower inference times. |
| Approach: | They propose a high-resolution document compression module to generate 324 tokens for a single document image. |
| Outcome: | The proposed module reduces first token latency by more than 50% and improves document comprehension performance. |
ProcessBench: Identifying Process Errors in Mathematical Reasoning (2025.acl-long)
Copied to clipboard
Chujie Zheng, Zhenru Zhang, Beichen Zhang, Runji Lin, Keming Lu, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | Existing models fail to generalize to more challenging math problems, authors say . existing benchmarks related to assessing language models' reasoning process are limited . |
| Approach: | They propose a tool to measure language models' ability to identify erroneous steps in reasoning . they use two types of models: process reward models and critic models . |
| Outcome: | The proposed model outperforms existing models in evaluating language models' reasoning process . the best open-source model has demonstrated the critique capability competitive with the proprietary model . |
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)
Copied to clipboard
Hao Xiang, Tianyi Tang, Yang Su, Bowen Yu, An Yang, Fei Huang, Yichang Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Jingren Zhou, Junyang Lin, Le Sun
| Challenge: | Existing benchmarks focus on character-centric approach and fail to reflect real-world applications. |
| Approach: | RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds. |
| Outcome: | RMTBench features 80 diverse characters and over 8,000 dialogue rounds. |
AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models require substantial storage space to perform tasks such as text generation and video generation. |
| Approach: | They propose to compress large language models using integer replacements for floating-point numbers, in a process known as Quantization. |
| Outcome: | The proposed model allows for quantization of up to 75% decoder layers with 1 bit while maintaining performance levels comparable to those of the models with floating parameters. |
Evidence-Augmented Policy Optimization with Reward Co-Evolution for Long-Context Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Evidence-Augmented Policy Optimization (EAPO) improves long-context reasoning performance . Xu et al., 2025): large language models are a critical part of NLP . |
| Approach: | They propose an Evidence-Augmented Reasoning paradigm that uses a group-relative reward to improve evidence quality. |
| Outcome: | EAPO significantly improves long-context reasoning performance compared to baselines. |
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models (2025.acl-long)
Copied to clipboard
Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | Existing Mixture-of-Experts training frameworks use a micro-batch to calculate LBL . micro-batches are restricted to a single sequence, preventing expert specialization . |
| Approach: | They propose to use a global-batch to loosen the load balance constraint for MoEs models . they propose to synchronize fi across micro-batches and then use it to calculate the LBL . |
| Outcome: | The proposed global-batch LBL improves the domain specialization of experts . the micro-battery LBL is almost at the sequence level, and the router is pushed to distribute the token evenly . |
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs (2025.emnlp-main)
Copied to clipboard
Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang, Hao-Ran Wei, Fei Huang, Bowen Yu, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou
| Challenge: | Recent advances in large language models showcase varied multilingual capabilities across tasks . previous assessments focused on fundamental natural language processing (NLP) or isolated capability-specific tasks. |
| Approach: | They propose a multilingual multitask benchmark to assess multilingual capabilities . they use a large-scale benchmark covering fundamental and capability-specialized datasets . |
| Outcome: | The proposed benchmark compares models and tasks across languages and tasks and examines knowledge transfer from English to other languages. |
Nested Browser-Use Learning for Agentic Information Seeking (2026.acl-long)
Copied to clipboard
Baixuan Li, Jialong Wu, Wenbiao Yin, Kuan Li, Zhongwang Zhang, Huifeng Yin, Zhengwei Tao, Liwen Zhang, Pengjun Xie, Jingren Zhou, Yong Jiang, Wentao Zhang, Zhiqiang Gao
| Challenge: | Existing information-seeking (IS) agents rely on the web for their information acquisition. |
| Approach: | They propose a browser-action framework that decouples interaction control from page exploration through a nested structure. |
| Outcome: | Empirical results show that NestBrowse offers clear benefits in practice. |
The Lessons of Developing Process Reward Models in Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Zhenru Zhang, Chujie Zheng, Yangzhen Wu, Beichen Zhang, Runji Lin, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | a recent study shows that process reward models can make mistakes, leading to wrong conclusions. |
| Approach: | They propose a consensus filtering mechanism that integrates MC estimation with LLM-as-a-judge to improve model performance and data efficiency. |
| Outcome: | The proposed model outperforms existing open-source alternatives and provides practical guidelines for future research. |
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for table-to-text generation suffer from poor faithfulness and low coverage. |
| Approach: | They propose a method that combines Autoregressive and Non-Autoregressive generation to generate a table-to-text from a key-value table using a skeleton and an edit-based non-autoregressively generation model. |
| Outcome: | The proposed method outperforms the existing methods on WikiPerson and WikiBio datasets on coverage and faithfulness. |
ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models (2023.emnlp-demo)
Copied to clipboard
Chenliang Li, He Chen, Ming Yan, Weizhou Shen, Haiyang Xu, Zhikai Wu, Zhicheng Zhang, Wenmeng Zhou, Yingda Chen, Chen Cheng, Hongzhu Shi, Ji Zhang, Fei Huang, Jingren Zhou
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities to comprehend human intentions, engage in reasoning, and design planning-like behavior. |
| Approach: | They propose a framework that equips large language models with tool-use capabilities . they propose LLaMA and Chat-GLM as controllers, and a model-based agent framework . |
| Outcome: | The proposed framework equips open-source LLMs with tool-use capabilities . it provides a user-friendly system library with a customizable engine design . |
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)
Copied to clipboard
Hao Xiang, Bowen Yu, Hongyu Lin, Keming Lu, Yaojie Lu, Xianpei Han, Ben He, Le Sun, Jingren Zhou, Junyang Lin
| Challenge: | Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data. |
| Approach: | They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements. |
| Outcome: | The proposed algorithm outperforms baselines in human preference alignment and reward optimization. |
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension (2024.acl-long)
Copied to clipboard
Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou
| Challenge: | Existing benchmarks for audio-centric interaction have impeded advancements in this field . AIR-Bench evaluates LALMs' ability to understand audio signals and interact with humans . |
| Approach: | They propose a benchmark to evaluate the ability of large audio-language models to understand audio signals . they use 19 tasks with approximately 19k single-choice questions to examine single-task ability . |
| Outcome: | The proposed framework evaluates the ability of large audio-language models to understand audio signals and interact with humans in the textual format. |
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition (2024.acl-long)
Copied to clipboard
Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou
| Challenge: | supervised fine-tuning (SFT) is a technique used to enhance multiple abilities in large language models. |
| Approach: | They propose to study the interplay of data composition between mathematical reasoning, code generation, and general human-aligning abilities during supervised fine-tuning. |
| Outcome: | The proposed model improves math reasoning and code generation with increasing data amount . the proposed model size and SFT strategies can be used to learn multiple skills with different scaling patterns. |
Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to fine tune LLMs produce unsafe responses and unreliable reasoning, but this solution introduces substantial time and space overhead due to the separate models required. |
| Approach: | They propose to insert extra parameters into transformer architecture to predict calibration signals along with original LLM output. |
| Outcome: | The proposed model reduces time and space costs while enabling seamless online deployment. |
Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment (2024.acl-long)
Copied to clipboard
| Challenge: | Existing work cheaply emulates LLMs, allowing users to create profiles for their preferred characters. |
| Approach: | They propose a self-alignment method that encourages an instruction-following LLM to simulate role-play dialogues as a variant of reading comprehension. |
| Outcome: | The proposed model outperforms open-source role-play benchmarks and the roleplay subset of MT-Bench in multiple parameters. |
WebAnchor: Anchoring Agent Planning to Stabilize Long-Horizon Web Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL)-based agents struggle with long-horizon planning and strategy coherence. |
| Approach: | They propose a reinforcement learning framework that decouples planning and execution. |
| Outcome: | The proposed framework outperforms baseline and first-step RL frameworks on four benchmarks. |
Retrieval Heads are Dynamic (2026.acl-long)
Copied to clipboard
Yuping Lin, Zitao Li, Yue Xing, Pengfei He, Yingqian Cui, Yaliang Li, Bolin Ding, Jingren Zhou, Jiliang Tang
| Challenge: | Recent studies have identified "retrieval heads" in Large Language Models responsible for extracting information from input contexts. |
| Approach: | They propose to examine retrieval heads from a dynamic perspective . they establish that retrieval head activation is highly dynamic and functionally irreplaceable . |
| Outcome: | The proposed model's hidden state encodes a predictive signal for future retrieval head patterns, indicating an internal planning mechanism. |
Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing ensemble methods for Large Language Models focus on reward model ranking of outputs, leading to significant computation overhead. |
| Approach: | They propose a reward-guided routing method distilling rewards on training queries to train a routing function. |
| Outcome: | The proposed method outperforms the best single model and ranks first on 44% of tasks. |
Automated Profile Inference with Language Model Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing privacy protections for large language models (LLMs) are limited due to the potential for malicious applications. |
| Approach: | They propose an automated profile inference framework that can extract personal information from public online activities by an adversary with the help of large language model (LLM) based agents. |
| Outcome: | The proposed framework is highly effective and efficient and the inferred attributes are both identifiable and sensitive, posing significant privacy risks. |
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections (2022.emnlp-main)
Copied to clipboard
Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, He Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si
| Challenge: | Existing pre-trained vision-language models suffer from inefficiency and linguistic signal overwhelmed by long visual sequences in cross-modal alignment. |
| Approach: | They propose a vision-language foundation model with cross-modal skip-connections that can be pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives. |
| Outcome: | The proposed model achieves state-of-the-art results on a wide range of vision-language downstream tasks, including image captioning, image-text retrieval, visual grounding and visual question answering. |
BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents (2026.findings-acl)
Copied to clipboard
Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou
| Challenge: | Existing work on confidence in LLMs is limited. |
| Approach: | They propose to use confidence scores to determine model answer quality and encourage model to try again until it reaches satisfactory confidence level. |
| Outcome: | The proposed methods significantly reduce token consumption while demonstrating competitive performance compared to baseline fixed budget methods. |
Learning Relation Alignment for Calibrated Cross-modal Retrieval (2021.acl-long)
Copied to clipboard
| Challenge: | despite advances in multimodal pre-training, cross-modal retrieval remains challenging . lack of relation consistency impairs contextualized representation of image-text pairs . |
| Approach: | They propose a new metric to quantify the relation consistency by measuring the semantic distance between linguistic and visual relations. |
| Outcome: | The proposed method boosts the performance of prevailing models on Flickr30k and MS COCO datasets by a considerable margin. |