Papers by Xi Zhao

AS-ES Learning: Towards efficient CoT learning in small models (2024.findings-acl)

Challenge:	Large language models (LLMs) have attracted considerable attention from academic and industrial communities due to their outstanding performance in various natural language processing tasks.
Approach:	They propose a Contrastive Learning Framework for Human Alignment to evaluate the noise within the data and dynamically adjust the training process.
Outcome:	The proposed framework surpasses other algorithms in terms of reward model scores, automatic evaluations, and human assessments on the widely used dataset "Helpful and Harmless"

Copied to clipboard

Nuwa Xi, Yuhan Chen, Sendong Zhao, Haochun Wang, GongZhang GongZhang, Bing Qin, Ting Liu

Responsible & Trustworthy NLP

Challenge:	Existing methods to induce Chain-of-Thought (CoT) in LLMs are limited and do not consider the importance of efficiently utilizing existing CoT data.
Approach:	They propose a new training paradigm which exploits the inherent information in CoT for iterative generation.
Outcome:	The proposed training paradigm surpasses direct seq2seq training on CoT-extensive tasks without data augmentation or altering the model itself.

Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)

Copied to clipboard

Mingkang Zhu, Xi Chen, Zhongdao Wang, Bei Yu, Hengshuang Zhao, Jiaya Jia

Inter-Passage Verification for Multi-evidence Multi-answer QA (2025.findings-acl)

Challenge:	Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting.
Approach:	They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content.
Outcome:	The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning.

Copied to clipboard

Bingsen Chen, Shenji Wan, Xi Ye, Chen Zhao

Information Retrieval

Challenge:	Existing multi-answer question answering systems struggle to retrieve and synthesize a large number of evidence passages.
Approach:	They propose a multi-answer question answering framework that generates a large set of passages and then processes each passage individually to generate an initial high-recall but noisy answer set.
Outcome:	The proposed framework outperforms baselines on the QAMPARI and RoMQA datasets, achieving an average F1 score improvement of 11.17%.

Conditioned Masked Language and Image Modeling for Image-Text Dense Retrieval (2022.findings-emnlp)

Copied to clipboard

Ziyang Luo, Yadong Xi, Rongsheng Zhang, GongZheng Li, Zeng Zhao, Jing Ma

UniCoRN: Unified Cognitive Signal ReconstructioN bridging cognitive signals and human language (2023.acl-long)

Challenge:	Large-scale two-stream pre-trained models like CLIP have achieved tremendous success in image-text retrieval.
Approach:	They propose a cross-modal framework for image-text retrieval using two-stream pre-trained models . they embed images and texts into instance representations with two separate encoders . experimental results on MSCOCO and Flickr30k reveal the effectiveness of their framework .
Outcome:	The proposed framework improves image-text retrieval performance on two popular cross-modal retrieval benchmarks.

Copied to clipboard

Nuwa Xi, Sendong Zhao, Haochun Wang, Chi Liu, Bing Qin, Ting Liu

Challenge:	Existing studies focus on decoding word-level fMRI volumes from a restricted vocabulary.
Approach:	They propose an open-vocabulary task to bridge fMRI time series and human language . they use a pre-trained language model to construct a robust encoder for cognitive signals .
Outcome:	The proposed task bridges fMRI time series and human language with a baseline model.

Analyzing Chain-of-thought Prompting in Black-Box Large Language Models via Estimated V-information (2024.lrec-main)

Copied to clipboard

Zecheng Wang, Chunshan Li, Zhao Yang, Qingbin Liu, Yanchao Hao, Xi Chen, Dianhui Chu, Dianbo Sui

SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis (2025.findings-naacl)

Challenge:	Chain-of-Thought (CoT) prompting and large language models (LLMs) have shown great potential in improving performance on challenging reasoning tasks.
Approach:	They propose a new metric which extends the concept of pointwise V-information to black-box models and quantifies label-relevant new information introduced by CoT prompting.
Outcome:	The proposed metric extends the concept of pointwise V-information to black-box models, quantifying label-relevant new information introduced by CoT prompting beyond pre-existing label information.

Copied to clipboard

Hengxing Cai, Xiaochen Cai, Junhan Chang, Sihang Li, Lin Yao, Wang Changxin, Zhifeng Gao, Hongshuai Wang, Li Yongge, Mujie Lin, Shuwen Yang, Jiankun Wang, Mingjun Xu, Jin Huang, Xi Fang, Jiaxi Zhuang, Yuqi Yin, Yaqi Li, Changhong Chen, Zheng Cheng, Zifeng Zhao, Linfeng Zhang, Guolin Ke

Challenge:	Existing benchmarks fail to adequately evaluate the proficiency of Large Language Models (LLMs) Existing standards do not cover the skills needed to evaluate LLMs in scientific literature analysis.
Approach:	They propose a benchmark to evaluate the proficiency of large language models in scientific literature analysis.
Outcome:	SciAssess evaluates 11 LLMs on multiple tasks across scientific fields.

ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)

Copied to clipboard

Jiaming Zhou, Shiyao Wang, Shiwan Zhao, Jiabei He, Haoqin Sun, Hui Wang, Cheng Liu, Aobo Kong, Yujie Guo, Xi Yang, Yequan Wang, Yonghua Lin, Yong Qin

ChatHLS: Towards Systematic Design Automation and Optimization for High-Level Synthesis (2026.acl-long)

Challenge:	Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0.
Approach:	They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes.
Outcome:	The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation.

Copied to clipboard

Runkai Li, Jia Xiong, Xiuyuan He, Jieru Zhao, Jiaqi Lv, Haowen Fang, Lei Qi, Xi Wang

Reasoning

Challenge:	High-Level Synthesis (HLS) is a hardware design tool that can be used to design hardware from C-like languages, but its widespread adoption is limited by strict coding constraints and design-specific optimizations.
Approach:	They propose a multi-agent HLS design framework that leverages specialized LLMs for automated debugging and directive tuning.
Outcome:	The proposed framework outperforms Gemini-3-pro in debugging and speedups across various HLS kernels and neural network accelerators.

Imperfect also Deserves Reward: Multi-Level and Sequential Reward Modeling for Better Dialog Management (2021.naacl-main)

Copied to clipboard

Zhengxu Hou, Bang Liu, Ruihui Zhao, Zijing Ou, Yafei Liu, Xi Chen, Yefeng Zheng

Dialogue Systems & Conversational Agents

Challenge:	Existing research on taskoriented dialog systems mainly includes pipeline and end-to-end methods due to its non-differentiable nature.
Approach:	They propose a multi-level reward modeling approach that factorizes a reward into a three-level hierarchy: domain, act, and slot.
Outcome:	The proposed approach significantly improves performance and speed of training in a wide range of dialog systems.

Datasets for Scientific Literature Understanding: A Survey (2026.findings-acl)

Copied to clipboard

Yuanzhe Zhang, Xun Zhao, Maodi Hu, Xi Sun, Donghuan Song, Zhixiong Zhang

Challenge:	Empowering machines to understand scientific literature is crucial for accelerating scientific discovery and advancing the AI for Science paradigm.
Approach:	They propose a systematic taxonomy that organizes resources spanning structural understanding, text understanding, multimodal understanding and pre-training/instruction fine-tuning.
Outcome:	The proposed taxonomy organizes resources spanning structural understanding, text understanding, multimodal understanding and pre-training/instruction fine-tuning.

Enhancing Text-to-SQL Capabilities of Large Language Models through Tailored Promptings (2024.lrec-main)

Copied to clipboard

Zhao Tan, Xiping Liu, Qing Shu, Xi Li, Changxuan Wan, Dexi Liu, Qizhi Wan, Guoqiong Liao

Programming Languages in NLP

Challenge:	Large language models with prompting have achieved encouraging results on many natural language processing tasks due to the absence of task-tailored promptings.
Approach:	They propose three promptings specifically designed for Text-to-SQL: SL-prompt, CC-promped, and SL+CC prompt.
Outcome:	The proposed promptings achieve execution accuracy of 86.2% and test-suite accuracy of 76% . the granularity of schema linking and the order of clause generation have great impact on performance, which are considered little in previous research.

MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields (2023.findings-emnlp)

Copied to clipboard

Jiaying Lu, Yongchen Qian, Shifan Zhao, Yuanzhe Xi, Carl Yang

Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging (2024.emnlp-main)

Challenge:	Existing multimodal classification systems use tabular, textual, and visual data to provide efficient and scalable services.
Approach:	They propose a multimodal classification benchmark MuG with eight datasets . they analyze label balance ratios, percentages of missing features, distributions of data within each modality .
Outcome:	The proposed benchmark is available on https://github.com/lujiaying/MUG-Bench . it includes eight datasets that allow researchers to evaluate and improve their models .

Copied to clipboard

Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Bo Li, Xi Chen, Cunhang Fan, Zhao Lv, Dianhui Chu, Zhiying Tu, Dianbo Sui

Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modeling (2025.findings-emnlp)

Challenge:	Existing methods for parameter pruning fail to utilize the knowledge from pruned parameters.
Approach:	They propose a method that uses manifold learning and the Information Bottleneck measure to merge similar layers to preserve model performance.
Outcome:	The proposed method outperforms pruning methods on multiple datasets and LLMs with quantization and achieves substantial compression ratios.

Copied to clipboard

Yue Zhao, Xiaoyu Wang, Dan Wang, Zhonglin Jiang, Qingqing Gu, Teng Chen, Ningyuan Xi, Jinxian Qu, Yong Chen, Luo Ji

Dialogue Systems & Conversational Agents

Challenge:	a framework for constructing dialogue world models for natural language tasks is currently lacking.
Approach:	They propose a framework that can be used to train a dialogue world model.
Outcome:	The proposed framework can predict future utterances and user beliefs . it can achieve state-of-the-art performance on emotion classification and sentiment identification .

Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)

Copied to clipboard

Xi Xiao, Chenrui Ma, Yunbei Zhang, Chen Liu, Zhuxuanzi Wang, Yanshu Li, Lin Zhao, Guosheng Hu, Tianyang Wang, Hao Xu

Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Challenge:	Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence .
Approach:	They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions.
Outcome:	Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods.

Copied to clipboard

Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni

SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation (2022.findings-emnlp)

Challenge:	MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach:	They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome:	The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.

Copied to clipboard

Yueqian Wang, Chang Liu, Kai Chen, Xi Wang, Dongyan Zhao

Responsible & Trustworthy NLP

Challenge:	Large-scale language models with prompts have shown remarkable performance on few-shot learning.
Approach:	They propose an approach to improve SMAll language models’ few-SHot ability by training on intermediate tasks before prompt-based fine-tuning on downstream tasks.
Outcome:	The proposed model improves on sentence-pair and sentiment classification tasks by training on intermediate tasks before fine-tuning on downstream tasks.

MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)

Copied to clipboard

Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie

AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation (2026.findings-acl)

Challenge:	Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models.
Approach:	They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts.
Outcome:	The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings .

Copied to clipboard

Wentao Shi, Yu Wang, Yuyang Zhao, Yuxin Chen, Fuli Feng, Xueyuan Hao, Xi Su, Qi GU, Hui Su, Xunliang Cai, Xiangnan He

Challenge:	Existing approaches to verify agent behaviors in complex environments rely on rule-based verifiers or LLM-as-a-Judge models.
Approach:	They propose a benchmark to evaluate Agent-as-a-Judge across three domains . the benchmark covers search, data systems, and graphical user interfaces - with 155 tasks and 516 trajectories .
Outcome:	The proposed benchmark outperforms existing benchmarks in search, data systems, and GUI domains while revealing open challenges in agent-based verification.

Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)

Copied to clipboard

Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, Jiaoyan Chen

Sentiment Analysis

Challenge:	Existing intent detection models can only handle predefined intent classes in the offline environment.
Approach:	They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems .
Outcome:	The proposed method outperforms existing models on three benchmarks.

Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment (2026.acl-long)

Copied to clipboard

Yuming Yang, Mingyoung Lai, Wanxu Zhao, Xiaoran Fan, Zhiheng Xi, Mingqi Wu, Chiyue Huang, Jun Zhao, Haijun Lv, Jian Tong, Yunhua Zhou, Yicheng Zou, Qipeng Guo, Tao Gui, Qi Zhang, Xuanjing Huang

Reasoning

Challenge:	Existing methods assess suitability primarily through student likelihood, favoring trajectories that align closely with the student model’s current behavior but overlooking more informative ones.
Approach:	They propose a Rank–Surprisal Ratio metric that captures both alignment and informativeness to assess the suitability of a reasoning trajectory.
Outcome:	The proposed metric captures both alignment and informativeness to assess the suitability of a reasoning trajectory.

RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models (2026.findings-acl)

Copied to clipboard

Tianqianjin Lin, Xi Zhao, Xingyao Zhang, Rujiao Long, Yi Xu, Zhuoren Jiang, Wenbo Su, Bo Zheng

UER: An Open-Source Toolkit for Pre-training Models (D19-3)

Challenge:	Experiments show that reinforcement learning (RL) can refine the reasoning abilities of large language models (LLMs) but requires a key prerequisite: the model must already be able to generate high-utility reasoning paths with non-negligible probability.
Approach:	They propose a framework that uses answer-conditioned reasoning as a variational surrogate for question-only reasoning.
Outcome:	Experiments on 11 benchmarks and 3 models show that RAVR reduces hesitation, strengthens conclusion consolidation, and promotes problem-specific strategies in reasoning.

Copied to clipboard

Zhe Zhao, Hui Chen, Jinbin Zhang, Xin Zhao, Tao Liu, Wei Lu, Xi Chen, Haotang Deng, Qi Ju, Xiaoyong Du

LLMs May Perform MCQA by Selecting the Least Incorrect Option (2025.coling-main)

Challenge:	Existing work on pre-training models have shown that it is important to use a framework to deploy various pre- training models efficiently.
Approach:	They propose an assemble-on-demand pre-training toolkit that assembles pre-trained models on demand and encapsulates them with rich modules.
Outcome:	The proposed framework can reproduce state-of-the-art models or develop models that remain unexplored.

Copied to clipboard

Haochun Wang, Sendong Zhao, Zewen Qiang, Nuwa Xi, Bing Qin, Ting Liu

Challenge:	Multiple Choice Question Answering (MCQA) is a fundamental format for various tasks in NLP, such as commonsense reasoning.
Approach:	They propose a method to increase the number of correct options in a dataset.
Outcome:	The proposed method improves the performance of multiple choice question answering (MCQA) and improves its accuracy.

EmotionTalk: An Interactive Chinese Multimodal Emotion Dataset With Rich Annotations (2026.findings-acl)

Copied to clipboard

Haoqin Sun, Jinghua Zhao, Xuechen Wang, Shiwan Zhao, Jiaming Zhou, Hui Wang, Xi Yang, Yequan Wang, Yonghua Lin

GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL (2026.acl-long)

Challenge:	Existing datasets face issues such as low quality, limited scale, and incomplete modalities, hindering model performance.
Approach:	They propose to use Chinese multimodal datasets to capture authentic emotional interplay from 19 professional actors.
Outcome:	The EmotionTalk dataset spans 23.6 hours of dyadic conversations across diverse scenarios.

Copied to clipboard

Daojun Chen, Xi Wang, Shenyuan Ren, Qingzhi Ma, Pengpeng Zhao, An Liu

Text Generation

Challenge:	Existing frameworks for Text2SQL generation still have a critical semantic gap . a dedicated validator translates generated SQL back into natural language and checks whether its logic is aligned with the original question.
Approach:	They propose a framework that introduces Guided Generation with SQL2Text Back-translation Validation . dedicated validator translates generated SQL back into natural language and checks whether logic is aligned with original question .
Outcome:	The proposed framework achieves 63.23% execution accuracy on the BIRD benchmark and 90.42% on repaired BIDR dev.

AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Bo Zhang, Tzu-Yen Ma, Zichen Tang, Junpeng Ding, Zirui Wang, Yizhuo Zhao, Peilin Gao, Zijie Xi, Zixin Ding, Haiyang Sun, Haocheng Gao, Yuan Liu, Liangjia Wang, Yiling Huang, Yujie Wang, Yuyue Zhang, Ronghui Xi, Yuanze Li, Jiacheng Liu, Zhongjun Yang, Haihong E

What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations (2025.acl-long)

Challenge:	AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach:	They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome:	AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.

Copied to clipboard

Dongqi Liu, Chenxi Whitehouse, Xi Yu, Louis Mahon, Rohit Saxena, Zheng Zhao, Yifu Qiu, Mirella Lapata, Vera Demberg

Text Generation

Challenge:	VISTA dataset contains 18,599 recorded AI conference presentations . large multimodal models exhibit reduced performance in scientific contexts, study shows .
Approach:	They propose a dataset specifically designed for video-to-text summarization in scientific domains.
Outcome:	This paper compares the performance of large models with human models and shows that they improve on human models.

Ambiguity Awareness Optimization: Towards Semantic Disambiguation for Direct Preference Optimization (2025.emnlp-main)

Copied to clipboard

Jian Li, Shenglin Yin, Yujia Zhang, Alan Zhao, Xi Chen, Xiaohui Zhou, Pengfei Xu

Self-Demos: Eliciting Out-of-Demonstration Generalizability in Large Language Models (2024.findings-naacl)

Challenge:	Direct Preference Optimization (DPO) is a widely used reinforcement learning from human feedback (RLHF) method across various domains.
Approach:	They propose an approach that automatically re-weights ambiguous content to reduce ambiguities by calculating semantic similarity from preference pairs.
Outcome:	The proposed approach outperforms state-of-the-art approaches in performance across multiple model scales and widely adopted benchmark datasets.

Copied to clipboard

Wei He, Shichun Liu, Jun Zhao, Yiwen Ding, Yi Lu, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang

Context-Aware Query Rewriting for Improving Users’ Search Experience on E-commerce Websites (2023.acl-industry)

Challenge:	Existing methods that rely on limited demos and out-of-demonstration (OOD) queries fail when faced with out- of-demotion queries.
Approach:	They propose a query-aware prompting method that elicits the inherent generalizability of large language models by query-based demo generation.
Outcome:	The proposed method outperforms state-of-the-art methods in the OOD setting and two public math benchmarks.

Copied to clipboard

Simiao Zuo, Qingyu Yin, Haoming Jiang, Shaohui Xi, Bing Yin, Chao Zhang, Tuo Zhao

Text Generation

Challenge:	Existing query rewriting models ignore user history behaviors and consider only the instant search query, which is often a short string offering limited information about the true shopping intent.
Approach:	They propose an end-to-end context-aware query rewriting model that takes search context into account and builds a session graph using the history search queries and their contained words.
Outcome:	The proposed model outperforms state-of-the-art models under various metrics.

Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)

Copied to clipboard

Junpeng Ding, Zichen Tang, Haihong E, Mengyuan Ji, Yang Liu, Haolin Tian, Haiyang Sun, Pengqi Sun, Yang Xu, Yichen Liu, Haocheng Gao, Zijie Xi, Ruomeng Jiang, Peizhi Zhao, Rongjin Li, Yuanze Li, Jiacheng Liu, Zhongjun Yang, Jintong Chen, Siying Lin

Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model (2022.naacl-industry)

Challenge:	Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images.
Approach:	They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations.
Outcome:	The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images.

Copied to clipboard

Gongzheng Li, Yadong Xi, Jingzhen Ding, Duan Wang, Ziyang Luo, Rongsheng Zhang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao

Distill Visual Chart Reasoning Ability from LLMs to MLLMs (2025.findings-emnlp)

Challenge:	Recent studies show that transformer-based models are effective over many tasks, but they are expensive to deploy in the industrial application.
Approach:	They propose a transformer-based inference solution that optimizes kernels for long inputs and large hidden sizes and a flexible CUDA memory manager to reduce the memory footprint when deploying a large model.
Outcome:	The proposed solution achieves an average speedup of 1.40-4.20x on the transformer decoder layer with an A100 GPU.

Copied to clipboard

Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang

M2Edit: Locate and Edit Multi-Granularity Knowledge in Multimodal Large Language Model (2025.emnlp-main)

Challenge:	a new method for generating chart annotations is proposed to improve visual reasoning in multimodal large language models.
Approach:	They propose a code-as-intermediary translation method for distilling visual reasoning abilities from LLMs to MLLMs.
Outcome:	The proposed method is cost-effective, efficient and scalable.

Copied to clipboard

Yang Zhou, Pengfei Cao, Yubo Chen, Qingbin Liu, Dianbo Sui, Xi Chen, Kang Liu, Jun Zhao

Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words (2022.coling-1)

Challenge:	Existing knowledge editing methods for MLLMs lack multi-granularity knowledge . existing knowledge editing approaches lack multimodality knowledge and generalize to multimodal data.
Approach:	They propose a multimodal knowledge editing method which integrates key knowledge layers within MLLMs and collaboratively edits them.
Outcome:	The proposed method improves visual generality performance on knowledge data of different granularities.

Copied to clipboard

Haochun Wang, Chi Liu, Nuwa Xi, Sendong Zhao, Meizhi Ju, Shiwei Zhang, Ziheng Zhang, Yefeng Zheng, Bing Qin, Ting Liu

Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision (2026.acl-long)

Challenge:	Pre-trained models perform poorly with limited data and rare biomedical words.
Approach:	They propose to use prompt to fine-tune pre-trained models for biomedical domain tuning with a simple approach.
Outcome:	The proposed method achieves up to 6% improvement in biomedical natural language inference task without any extra parameters or training steps using few-shot vanilla prompt settings.

Copied to clipboard

Bingsen Chen, Boyan Li, Ping Nie, Yuyu Zhang, Xi Ye, Chen Zhao

Challenge:	Existing benchmarks for Deep Research Agents (DRAs) treat report generation as a single-shot writing task.
Approach:	They propose an evaluation suite that establishes multi-turn report revision as a new axis.
Outcome:	The evaluation suite establishes multi-turn report revision as a new axis.

KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)

Copied to clipboard

Yadong Xi, Xiaoxi Mao, Le Li, Lei Lin, Yanjiang Chen, Shuhan Yang, Xuhan Chen, Kailun Tao, Zhi Li, Gongzheng Li, Lin Jiang, Siyan Liu, Zeng Zhao, Minlie Huang, Changjie Fan, Zhipeng Hu