Papers by Jie Luo

MMedAgent: Learning to Use Medical Tools with Multi-modal Agent (2024.findings-emnlp)

Challenge:	Currently, most research focuses on the bidding algorithms used within auction mechanisms.
Approach:	They propose a personalized valuation framework that integrates Large Language Models to incorporate personalized semantic preference into users valuation process.
Outcome:	The proposed framework incorporates Large Language Models to incorporate personalized semantic preference into users valuation process.

Copied to clipboard

Binxu Li, Tiankai Yan, Yuanting Pan, Jie Luo, Ruiyang Ji, Jiayuan Ding, Zhe Xu, Shilong Liu, Haoyu Dong, Zihao Lin, Yixin Wang

AssistedDS: Benchmarking How External Domain Knowledge Assists LLMs in Automated Data Science (2025.findings-emnlp)

Challenge:	Multi-modal Large Language Models (MLLMs) exhibit limited generality and often fall short when compared to specialized models.
Approach:	They propose a multi-modal medical agent that picks the most suitable medical tools based on user inputs.
Outcome:	The proposed agent performs better than open-source models and the closed-source model, GPT-4o.

Copied to clipboard

An Luo, Xun Xian, Jin Du, Fangqiao Tian, Ganghua Wang, Ming Zhong, Shengchun Zhao, Xuan Bi, Zirui Liu, Jiawei Zhou, Jayanth Srinivasa, Ashish Kundu, Charles Fleming, Mingyi Hong, Jie Ding

Robustness in NLP

Challenge:	Large language models (LLMs) have advanced the automation of data science workflows, yet it remains unclear whether they can critically leverage external domain knowledge as human data scientists do in practice.
Approach:	They propose a benchmark to evaluate how large language models handle external domain knowledge in tabular prediction tasks.
Outcome:	The proposed model evaluates whether it can critically leverage external domain knowledge as human data scientists do in practice.

UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models (2026.acl-demo)

Copied to clipboard

Qundong Shi, Jie Zhou, Biyuan Lin, Junbo Cui, Guoyang Zeng, Yixuan Zhou, Ziyang Wang, Xin Liu, Zhen Luo, Yudong Wang, Zhiyuan Liu

Distant Supervised Relation Extraction with Separate Head-Tail CNN (D19-55)

Challenge:	Existing evaluation frameworks for audio foundation models are heavily reliant on English, making it difficult to objectively assess models’ performance on Chinese.
Approach:	They propose a unified framework that supports 10 languages, 14 task categories, 24 models, and 36 benchmarks with one-command evaluation and real-time leaderboards.
Outcome:	The proposed framework supports 10 languages, 14 task categories, 24 models, and 36 benchmarks with one-command evaluation and real-time leaderboards.

Copied to clipboard

Rui Xing, Jie Luo

Information Extraction & Text Mining

Challenge:	Distant supervised relation extraction suffers from mislabeling problem due to strong assumption . et al., 2009: distant supervision can be used to extract relations between entities .
Approach:	They propose a neural relation extraction framework which uses convolution and pooling to extract better semantic features of sentences.
Outcome:	The proposed framework improves relation extraction performance on a widely used dataset.

Improving the Robustness of Summarization Models by Detecting and Removing Input Noise (2023.findings-emnlp)

Copied to clipboard

Kundan Krishna, Yao Zhao, Jie Ren, Balaji Lakshminarayanan, Jiaming Luo, Mohammad Saleh, Peter Liu

Robustness in NLP

Challenge:	Abstractive summarization models are typically evaluated using test data that is identically distributed as training data.
Approach:	They propose a method to detect and remove input noise from documents to be summarized without extra training or auxiliary models.
Outcome:	The proposed method recovers a large fraction of the loss in performance, sometimes as large as 11 ROUGE-1 points, without extra training, auxiliary models, or prior knowledge of the type of noise.

ExpanRL: Hierarchical Reinforcement Learning for Course Concept Expansion in MOOCs (2020.aacl-main)

Copied to clipboard

Jifan Yu, Chenyu Wang, Gan Luo, Lei Hou, Juanzi Li, Jie Tang, Minlie Huang, Zhiyuan Liu

Challenge:	Existing methods for concept expansion in MOOCs are inefficient because of the diversity of MOOC courses and rapid updates.
Approach:	They propose an end-to-end hierarchical reinforcement learning (HRL) model for concept expansion in MOOCs that employs a two-level mechanism of seed selection and concept expansion.
Outcome:	The proposed model improves on nine real MOOC datasets and maintains competitive performance under different settings.

Visual Prompt Tuning for Few-Shot Text Classification (2022.coling-1)

Copied to clipboard

Jingyuan Wen, Yutian Luo, Nanyi Fei, Guoxing Yang, Zhiwu Lu, Hao Jiang, Jie Jiang, Zhao Cao

Enhancing Argument Structure Extraction with Efficient Leverage of Contextual Information (2023.findings-emnlp)

Challenge:	Existing work on pretraining models for text classification uses image encoders instead of visual prompts.
Approach:	They propose a method to deploy large-scale pre-trained models in the prompt-tuning paradigm in few-shot learning.
Outcome:	The proposed method outperforms the most recent prompt-tuning methods on five public text classification datasets.

Copied to clipboard

Yun Luo, Zhen Yang, Fandong Meng, Yingjie Li, Jie Zhou, Yue Zhang

Responsible & Trustworthy NLP

Challenge:	Argument structure extraction (ASE) aims to identify the discourse structure of arguments within documents.
Approach:	They propose an Efficient Context-aware ASE model that fully exploits contextual information by augmenting modeling capacity and augmenting training data.
Outcome:	The proposed model can extract argumentative discourse structure from documents and reduce reliance on specific words or less informative sentences.

MOOCCube: A Large-scale Data Repository for NLP Applications in MOOCs (2020.acl-main)

Copied to clipboard

Jifan Yu, Gan Luo, Tong Xiao, Qingyang Zhong, Yuquan Wang, Wenzheng Feng, Junyi Luo, Chenyu Wang, Lei Hou, Juanzi Li, Zhiyuan Liu, Jie Tang

Information Extraction & Text Mining

Challenge:	Massive open online courses (MOOCs) are a popular educational platform for advanced research.
Approach:	They propose to use MOOCCube to build a large-scale data repository of over 700 MOOC courses, 100k concepts, 8 million student behaviors with an external resource.
Outcome:	The proposed datasets show that they can facilitate research in MOOCs.

XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners (2024.naacl-long)

Copied to clipboard

Yun Luo, Zhen Yang, Fandong Meng, Yingjie Li, Fang Guo, Qinglin Qi, Jie Zhou, Yue Zhang

Responsible & Trustworthy NLP

Challenge:	Existing methods for active learning rely on model uncertainty or disagreement to pick unlabeled data, leading to over-confidence in superficial patterns and lack of exploration.
Approach:	They propose to use a bi-directional encoder and a uni-directional decoder to generate and score an explanation for low-resource text classification.
Outcome:	The proposed model improves on 9 strong baselines on six datasets and can generate explanations for its predictions.

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding (2026.findings-acl)

Copied to clipboard

Jie Zhang, Qilang Ye, Hao Zhou, Haochen Liang, Fei Luo

Visual Data in NLP

Challenge:	Existing methods for video retrieval rely on embedding-based full-corpus scanning, but there is a bottleneck in semantic asymmetry and computational redundancy.
Approach:	They propose a multi-agent framework that rethinks retrieval as cooperative reasoning . they parse raw videos into a structured semantic library, enabling explicit attribute-level indexing .
Outcome:	The proposed framework bridges the granularity mismatch gap by parsing raw videos into a structured semantic library . it employs a Logic-aware Debate mechanism with a strict veto protocol . the proposed framework achieves competitive performance without task-specific fine-tuning .

Dynamic Scaling of Unit Tests for Code Reward Modeling (2025.acl-long)

Copied to clipboard

Zeyao Ma, Xiaokang Zhang, Jing Zhang, Jifan Yu, Sijia Luo, Jie Tang

Green & Sustainable NLP

Challenge:	Existing large language models struggle to produce accurate responses on the first attempt for complex reasoning tasks like code generation.
Approach:	They propose a lightweight yet effective unit test generator that scales unit tests based on problem difficulty.
Outcome:	The proposed approach significantly improves performance on three benchmarks.

A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Challenge:	Existing multi-modal neural machine translation models do not fully exploit fine-grained semantic correspondences between semantic units of different modalities.
Approach:	They propose a graph-based multi-modal fusion encoder that exploits fine-grained semantic correspondences between different modalities.
Outcome:	The proposed encoder significantly extends the conventional text-based translation by taking images as additional inputs.

Copied to clipboard

Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun

Open-Set Living Need Prediction with Large Language Models (2025.findings-acl)

Challenge:	Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach:	They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome:	The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.

Copied to clipboard

Xiaochong Lan, Jie Feng, Yizhou Sun, Chen Gao, Jiahuan Lei, Xinleishi Xinleishi, Hengliang Luo, Yong Li

Teaching Your Models to Understand Code via Focal Preference Alignment (2025.emnlp-main)

Challenge:	Existing approaches to living need prediction treat it as a closed-set classification problem, severely limiting their ability to capture diversity and complexity of living needs.
Approach:	They propose a system leveraging large language models for unrestricted need prediction that leverages Maslow's hierarchy of needs to align predictions with human living needs.
Outcome:	The proposed system outperforms closed-set approaches on need-based life service recall by an average of 19.37% on real-world datasets.

Copied to clipboard

Jie Wu, Haoling Li, Xin Zhang, Xiao Liu, Yangyu Huang, Jianwen Luo, Yizhen Zhang, Zuchao Li, Ruihang Chu, Yujiu Yang, Scarlett Li

Programming Languages in NLP

Challenge:	Existing methods for supervised fine-tuning focus on unit test feedback to construct preference pairs.
Approach:	They propose a preference alignment framework that mimics human iterative debugging to refine Code LLMs.
Outcome:	Experiments show that Preference Learning improves on BigCodeBench and BigCodeBind tasks.

Unlocking Continual Learning Abilities in Language Models (2024.findings-emnlp)

Copied to clipboard

Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu

UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs (2024.acl-demos)

Challenge:	Existing approaches to learning models (LMs) incorporate old task data or task-wise inductive bias into LMs, but old data and accurate task information are often unavailable or costly to collect.
Approach:	They propose a rehearsal-free method that updates model parameters with large magnitudes . they found that the L1-normalized magnitude distribution is different when different task data is used .
Outcome:	The proposed method improves accuracy and performance on four CL benchmarks.

Copied to clipboard

Chaoqun He, Renjie Luo, Shengding Hu, Ranchi Zhao, Jie Zhou, Hanghao Wu, Jiajie Zhang, Xu Han, Zhiyuan Liu, Maosong Sun

CAP: Controllable Alignment Prompting for Unlearning in LLMs (2026.acl-long)

Challenge:	Existing evaluation platforms are complex and poorly modularized, hindering seamless incorporation into researcher’s workflows.
Approach:	They propose a lightweight evaluation framework characterized by lightweight, comprehensiveness, modularity, and efficiency that integrates models, data, and metrics into a unified evaluation workflow.
Outcome:	The proposed evaluation framework is lightweight, comprehensive, modular, and efficient.

Copied to clipboard

Zhaokun Wang, Jinyu Guo, Jingwen Pu, Hongli Pu, Meng Yang, Xunlei Chen, Jie Ou, Wenyi Li, Guangchun Luo, Wenhong Tian

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules (2023.findings-emnlp)

Challenge:	Existing methods for modifying parameters are unsystematic and rely on empirical experience.
Approach:	They propose a controllable alignment prompting for unlearning framework that decouples unlearning into a learnable prompt optimization process via reinforcement learning.
Outcome:	The proposed framework achieves precise, controllable unlearning without updating model parameters.

Copied to clipboard

Chaojun Xiao, Yuqi Luo, Wenbin Zhang, Pengle Zhang, Xu Han, Yankai Lin, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou

A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Challenge:	Large language models (LLMs) have been successful on NLP tasks but require huge parameter sizes and computational resources.
Approach:	They propose a parameter-efficient acceleration method that enhances computational efficiency through plug-and-play compression plugins.
Outcome:	The proposed method saves 53% computational costs using only 0.9% additional parameters with a performance drop of less than 2%.

Copied to clipboard

Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo

Responsible & Trustworthy NLP

Challenge:	Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach:	They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome:	The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.

TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios (2025.findings-acl)

Copied to clipboard

Xiaokang Zhang, Sijia Luo, Bohan Zhang, Zeyao Ma, Jing Zhang, Yang Li, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-Li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)

Challenge:	TableLLM is a robust large language model capable of handling tabular data manipulation tasks.
Approach:	They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy.
Outcome:	The proposed model has 8 billion parameters and is capable of handling tabular data tasks.

Copied to clipboard

Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang

CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis (2025.acl-long)

Challenge:	Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence.
Approach:	They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included .
Outcome:	The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model.

Copied to clipboard

Bohan Zhang, Xiaokang Zhang, Jing Zhang, Jifan Yu, Sijia Luo, Jie Tang

Reasoning

Challenge:	Existing inference scaling methods rely heavily on the quality of candidate responses . however, they are unable to produce correct answers when all candidates are flawed .
Approach:	They propose a CoT-based inference scaling strategy that leverages CoT reasoning to synthesize superior answers by analyzing complementary information from multiple candidate responses.
Outcome:	The proposed method improves performance on four benchmark datasets with seven policy models.

LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)

Copied to clipboard

Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen

HoWToBench: Holistic Evaluation for LLM’s Capability in Human-level Writing using Tree of Writing (2026.acl-long)

Challenge:	a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented.
Approach:	They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs).
Outcome:	The proposed library is based on extensive experiments in a variety of evaluation settings.

Copied to clipboard

Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Irene Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang

Challenge:	Evaluating the writing capabilities of large language models remains a significant challenge due to the multidimensional nature of writing skills and the limitations of existing metrics.
Approach:	They propose to model the aggregation weights of sub-features in a tree-structured workflow and propose a Chinese writing benchmark that mitigates biases.
Outcome:	The proposed tree-of-writing (ToW) measures the writing capabilities of large language models (LLMs) in Chinese and shows that it mitigates biases and achieves a 0.93 Pearson correlation with human judgments.

Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Models (2026.acl-long)

Copied to clipboard

Shaonan Liu, Guo Yu, Xiaoling Luo, Shiyi Zheng, Jie Liu, Wenting Chen, Linlin Shen