Papers by Bai Liu

VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025.coling-main)

Challenge:	Context faithfulness is essential for reliable reasoning in context-dependent scenarios.
Approach:	They propose a method that identifies and fine-tunes context-faithful experts . they propose 'context-faither fine- tuning' which selectively fine- tunes them .
Outcome:	The proposed method identifies experts with specialization in context utilization and improves context grounding.

Copied to clipboard

Wenrui Liu, Jionghao Bai, Xize Cheng, Jialong Zuo, Ziyue Jiang, Shengpeng Ji, Minghui Fang, Xiaoda Yang, Qian Yang, Zhou Zhao

MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Challenge:	Existing multilingual TTS datasets are limited in speech generation fields due to lack of quality data.
Approach:	They propose to use 30,000 hours of high-quality speech data across 3 languages . they filter out low-quality text-text pairs and concatenate short transcripts .
Outcome:	The proposed dataset comprises 30,000 hours of high-quality speech data, across 3 languages with multiple speakers and styles, suitable for various speech tasks such as TTS and ASR.

Copied to clipboard

Xiangyu Zhao, Wanghan Xu, Bo Liu, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang, Xiao-Ming Wu

HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Challenge:	Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach:	They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome:	MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.

Copied to clipboard

Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li

Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2 (2021.acl-srw)

Challenge:	Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach:	They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome:	The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.

Copied to clipboard

He Bai, Peng Shi, Jimmy Lin, Luchen Tan, Kun Xiong, Wen Gao, Jie Liu, Ming Li

RoadMapper: A Multi-Agent System for Roadmap Generation of Solving Complex Research Problems (2026.findings-acl)

Challenge:	Experimental results show that pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.
Approach:	They conduct experiments on an English essay dataset using Chinese-GPT2 . they find that the model can generate better continuations by learning to generate the in the fine-tuning stage.
Outcome:	The pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.

Copied to clipboard

Jiacheng Liu, Zichen Tang, Zhongjun Yang, Xinyi Hu, Xueyuan Lin, Linwei Jia, Ruofei Bai, Rongjin Li, Shiyao Peng, Haocheng Gao, Haihong E

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-Context QA (2025.findings-acl)

Challenge:	Existing tools to generate structured content for research tasks are limited in their ability to generate high-quality roadmaps.
Approach:	They propose a benchmark to evaluate the ability of large language models (LLMs) to generate high-quality roadmaps for solving complex research problems.
Outcome:	The proposed system can improve LLMs’ ability for roadmap generation while saving 84% of the time required by human experts.

Copied to clipboard

Jiajie Zhang, Yushi Bai, Xin Lv, Wanjun Gu, Danqing Liu, Minhao Zou, Shulin Cao, Lei Hou, Yuxiao Dong, Ling Feng, Juanzi Li

Question Answering

Challenge:	Current long-context large language models lack citations to support their responses, making verification difficult due to potential hallucinations.
Approach:	They propose to use off-the-shelf LLMs to automatically construct long-context QA instances with precise sentence-level citations and leverage this pipeline to construct a large-scale SFT dataset for LQAC.
Outcome:	The proposed pipeline can generate responses with fine-grained citations on the fly, surpassing existing models including GPT-4o.

Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Copied to clipboard

null Ymyang, Jiang Zhong, Li Jin, Xiao Sun, Jingwang Huang, null Gaojinpeng, Qing Liu, Yang Bai, Jingyuan Zhang, Rui Jiang, Qin Lei, Kaiwen Wei

Knowledge-enhanced Multimodal ECG Representation Learning with Arbitrary-Lead Inputs (2025.findings-emnlp)

Challenge:	Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach:	They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome:	The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.

Copied to clipboard

Che Liu, Cheng Ouyang, Zhongwei Wan, Haozhe Wang, Wenjia Bai, Rossella Arcucci

One Cognitive Loop Is Enough: SODA unlocks Pure-Text Spatial Reasoning in Large Language Models (2026.acl-long)

Challenge:	Current methods for multimodal representation learning for electrocardiograms often result in suboptimal alignment of ECG signals with their corresponding text reports.
Approach:	They propose a framework to learn ECG representations by aligning ECG signals with paired free-text reports.
Outcome:	The proposed framework outperforms existing methods in zero-shot classification and linear probing tasks using 12 leads.

Copied to clipboard

Shunwen Bai, Jiahuan Zhang, Haoran Huang, Yurun Wang, Jiale Liu, Yanxi Wu, Ningzhe Yu, Yudong Gao, Mingjun Cheng

Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation (2025.acl-long)

Challenge:	Existing large language models (LLMs) lack visual input, leading to errors in basic numerical comparisons.
Approach:	They propose a spatial OODA framework that integrates the OODAC cognitive loop into multiple control tasks and integrates it into LLMs.
Outcome:	The proposed model significantly improves the spatial reasoning capabilities of large language models across multiple scenarios including SPOD-Bench, SPACE and applications.

Copied to clipboard

Andong Chen, Yuchen Song, Kehai Chen, Xuefeng Bai, Muyun Yang, Liqiang Nie, Jie Liu, Tiejun Zhao, Min Zhang

On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)

Challenge:	Experimental results show that our model significantly outperforms existing multimodal MT and text-only MT.
Approach:	They propose a stable diffusion-based imagination network into a multimodal large language model to generate an image for each source sentence.
Outcome:	The proposed model outperforms existing multimodal and text-only MT and achieves an average improvement of 14 BLEU points on Multi30K and MSCOCO multimodal MT benchmarks.

Copied to clipboard

Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, Yangqiu Song

MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)

Challenge:	Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning.
Approach:	They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized.
Outcome:	The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized .

Copied to clipboard

Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He

Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction (2026.findings-acl)

Challenge:	Document images are characterized by higher resolutions, denser content, and more complex structural layouts.
Approach:	They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition.
Outcome:	The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead.

Copied to clipboard

Yulin Chen, Haoran Li, Yuan Sui, Yue Liu, Yufei He, Xiaoling Bai, Chi Fei, Li Yabo, Haozhe Ma, Yangqiu Song, Bryan Hooi

Clear Up Confusion: Advancing Cross-Domain Few-Shot Relation Extraction through Relation-Aware Prompt Learning (2024.naacl-short)

Challenge:	Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions.
Approach:	They propose a prompt injection defense method that suppresses the model's instruction-following tendencies rather than suppressing them.
Outcome:	The proposed method outperforms prompt-engineering-based approaches and fine-tuning methods and reduces the ASR to nearly 0% in some scenarios.

Copied to clipboard

Ge Bai, Chenji Lu, Daichi Guo, Shilong Li, Ying Liu, Zhang Zhang, Guanting Dong, Ruifang Liu, Sun Yong

Low-Resource NLP

Challenge:	Existing approaches to few-shot Relation Extraction (RE) are prone to confusion when applying knowledge to a target domain with entirely new types of relations.
Approach:	They propose a relation-aware prompt learning method with pre-training to clear confusion by decomposing relation types through an innovative label prompt.
Outcome:	The proposed method outperforms previous sota methods and yields better results on cross-domain few-shot RE tasks.

Structured Pruning for Efficient Generative Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Chaofan Tao, Lu Hou, Haoli Bai, Jiansheng Wei, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong

MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)

Challenge:	Large-scale generative Pre-trained Language Models (PLMs) are limited in their deployment in real-world applications.
Approach:	They propose to prune the feed-forward networks of generative pre-trained language models to smaller widths without designing extra operators.
Outcome:	The proposed method achieves 1.51x/6.96x inference speedup on GPU/CPU with 67% size reduction.

Copied to clipboard

Jingqun Tang, Qi Liu, Yongjie Ye, Jinghui Lu, Shu Wei, An-Lan Wang, Chunhui Lin, Hao Feng, Zhen Zhao, Yanjie Wang, Yuliang Liu, Hao Liu, Xiang Bai, Can Huang

Let’s Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models (2024.lrec-main)

Challenge:	Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool.
Approach:	They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images .
Outcome:	The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images.

Copied to clipboard

Shunyu Liu, Jie Zhou, Qunxi Zhu, Qin Chen, Qingchun Bai, Jun Xiao, Liang He

Dual-Path Counterfactual Integration for Multimodal Aspect-Based Sentiment Classification (2025.emnlp-main)

Challenge:	Empirical evaluations conducted on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models.
Approach:	They propose a diffusion model which extracts aspects step by step and learns a denoising process that progressively restores them in a reverse manner.
Outcome:	Empirical evaluations on eight benchmark datasets underscore the compelling advantages offered by DiffusionABSA when compared against robust baseline models.

Copied to clipboard

Rui Liu, Jiahao Cao, Jiaqian Ren, Xu Bai, Yanan Cao

Always the Best Fit: Adaptive Domain Gap Filling from Causal Perspective for Few-Shot Relation Extraction (2023.findings-emnlp)

Challenge:	Existing methods for multimodal aspect-based sentiment classification rely on superficial correlations and spurious cues.
Approach:	They propose a Dual-Path Counterfactual Integration framework that explicitly models counterfactual reasoning in multimodal contexts.
Outcome:	The proposed framework improves model robustness by explicitly modeling counterfactual reasoning in multimodal contexts.

Copied to clipboard

Ge Bai, Chenji Lu, Jiaxiang Geng, Shilong Li, Yidong Shi, Xiyan Liu, Ying Liu, Zhang Zhang, Ruifang Liu

Classical Sequence Match Is a Competitive Few-Shot One-Class Learner (2022.coling-1)

Challenge:	Existing approaches to cross-domain relation extraction have been limited by domains . data bias between domains can be difficult to fill, especially in few-shot scenarios .
Approach:	They propose a framework to bridge the semantic gap caused by data bias between domains . they use syntactic structure, label distribution, and entities to calculate causal effects .
Outcome:	The proposed framework fills the domain gap and yields better results on the few-shot task.

Copied to clipboard

Mengting Hu, Hang Gao, Yinhao Bai, Mingming Liu

The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents (2025.findings-acl)

Challenge:	Existing models that use transformers are unable to learn new knowledge in the few-shot scenarios.
Approach:	They propose a few-shot one-class problem which takes a known sample as a reference to detect whether an unknown instance belongs to the same class.
Outcome:	The proposed method significantly outperforms transformer models under meta-learning and fine-tuning.

Copied to clipboard

Yihong Tang, Kehai Chen, Xuefeng Bai, Zheng-Yu Niu, Bo Wang, Jie Liu, Min Zhang

Dialogue Systems & Conversational Agents

Challenge:	Large Language Models (LLMs) demonstrate their utility in character simulations, but they pose a risk of generating unsafe content.
Approach:	They propose a method which dynamically adjusts safety-utility preferences based on the degree of risk coupling and guides the model to generate responses biased toward utility or safety.
Outcome:	The proposed method improves safety metrics while maintaining utility.

TTVS: Boosting Self-Exploring Reinforcement Learning via Test-time Variational Synthesis (2026.findings-acl)

Copied to clipboard

Sikai Bai, Haoxi Li, Jie Zhang, Yongjiang Liu, Song Guo

Low-Resource NLP

Challenge:	Existing test-time methods are limited in specialized or novel domains where supervision is prohibitively expensive or unavailable.
Approach:	They propose a framework that augments training stream from unlabeled test queries.
Outcome:	Extensive experiments show TTVS outperforms state-of-the-art RL-based techniques on unlabeled test-time data.

Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue (2023.findings-emnlp)

Copied to clipboard

Yuanxing Liu, Weinan Zhang, Yifan Chen, Yuchi Zhang, Haopeng Bai, Fan Feng, Hengbin Cui, Yongbin Li, Wanxiang Che

Dialogue Systems & Conversational Agents

Challenge:	E-commerce pre-sales dialogues elicit user needs and preferences for items . large language models lack domain-specific knowledge for accurate recommendations .
Approach:	They propose two collaboration strategies to integrate CRS and large language models in pre-sales dialogues.
Outcome:	The proposed methods can be very effective in some cases, the authors say .

IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact (2024.findings-acl)

Copied to clipboard

Ruikang Liu, Haoli Bai, Haokun Lin, Yuening Li, Han Gao, Zhengzhuo Xu, Lu Hou, Jun Yao, Chun Yuan

KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)

Challenge:	Existing quantization methods are compromising performance of large language models (LLMs) despite their high computational intensity, LLMs are still demanding intensive computation.
Approach:	They propose to generate the KV cache of pivot tokens losslessly from the full-precision model.
Outcome:	The proposed method generates the KV cache of pivot tokens losslessly from the full-precision model with no extra inference overhead.

Copied to clipboard

Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

Aligning Paralinguistic Understanding and Generation in Speech LLMs via Multi-Task Reinforcement Learning (2026.eacl-industry)

Challenge:	None. None.. None!
Approach:	None. None.. None!
Outcome:	None. None. No. :

Copied to clipboard

Minseok Kim, Jingxiang Chen, Seong-Gyun Leem, Yin Huang, Rashi Rungta, Zhicheng Ouyang, Haibin Wu, Surya Teja Appini, Ankur Bansal, Yang Bai, Yue Liu, Florian Metze, Ahmed A Aly, Anuj Kumar, Ariya Rastrow, Zhaojiang Lin

WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild? (2025.emnlp-main)

Challenge:	Using paralinguistic cues is challenging for speech large language models, authors say . limited training data, annotation difficulty, and models exploiting lexical shortcuts are challenges . a recent study shows that modeling paralinguistic reasoning with multitask RL improves paralinguistics understanding .
Approach:	They propose multi-task reinforcement learning with chain-of-thought prompting that elicits explicit affective reasoning.
Outcome:	The proposed model improves paralinguistics understanding over baselines and strong proprietary models by 8-12% on Expresso, IEMOCAP, and RAVDESS.

Copied to clipboard

An-Lan Wang, Jingqun Tang, Lei Liao, Hao Feng, Qi Liu, Xiang Fei, Jinghui Lu, Han Wang, Hao Liu, Yuliang Liu, Xiang Bai, Can Huang

Robustness in NLP

Challenge:	Existing benchmarks for document understanding in the wild are based on scanned or digital documents . however, these benchmarks fail to capture the challenges posed by documents in the real world .
Approach:	They propose a new benchmark that incorporates a diverse set of manually captured document images reflecting real-world conditions.
Outcome:	The proposed model is based on a set of manually captured document images reflecting real-world conditions and is compared with digital or scanned documents.

Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding (2023.acl-long)

Copied to clipboard

Haoli Bai, Zhiguang Liu, Xiaojun Meng, Li Wentao, Shuang Liu, Yifeng Luo, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu

BinaryBERT: Pushing the Limit of BERT Quantization (2021.acl-long)

Challenge:	Existing solutions for visual document understanding lack granularity of document textlines.
Approach:	They propose a supervised pre-training program to leverage structural knowledge nested in document textlines to achieve fine-grained alignment between visual regions and texts.
Outcome:	The proposed system performs better on various VDU tasks in English and Chinese.

Copied to clipboard

Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jin Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King

Beyond Unimodal Shortcuts: MLLMs as Cross-Modal Reasoners for Grounded Named Entity Recognition (2026.findings-acl)

Challenge:	Recent pre-trained language models have achieved remarkable performance improvement in various tasks, but the improvement generally comes at the cost of increasing model size and computation.
Approach:	They propose a binary quantization technique which initializes binaryBERT by splitting from a ternary network.
Outcome:	The proposed model achieves state-of-the-art performance on the GLUE and SQUAD benchmarks while being 24x smaller.

Copied to clipboard

Jinlong Ma, Yu Zhang, Xuefeng Bai, Kehai Chen, Yuwei Wang, Zeming Liu, Jun Yu, Min Zhang

M2C: Towards Automatic Multimodal Manga Complement (2023.findings-emnlp)

Challenge:	Existing approaches to GMNER use MLLMs as auxiliary tools, causing cumulative error propagation and a lack of rigorous cross-modal verification.
Approach:	They propose a model that enforces structured cross-modal reasoning through Multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization.
Outcome:	The proposed model enforces structured cross-modal reasoning through multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization.

Copied to clipboard

Hongcheng Guo, Boyang Wang, Jiaqi Bai, Jiaheng Liu, Jian Yang, Zhoujun Li

Glyph: Scaling Context Windows via Visual-Text Compression (2026.acl-long)

Challenge:	Multimodal manga analysis focuses on enhancing manga understanding with visual and textual features.
Approach:	They propose a task to enhance manga understanding with visual and textual features by providing a shared semantic space for vision and language understanding.
Outcome:	The proposed task provides a shared semantic space for vision and language understanding.

Copied to clipboard

Jiale Cheng, Yusen Liu, Xinyu Zhang, Yulin Fei, Wenyi Hong, Ruiliang Lyu, Weihan Wang, Zhe Su, Xiaotao Gu, Xiao Liu, Yushi Bai, Jie Tang, Hongning Wang, Minlie Huang

Think Outside the Policy: In-Context Steered Policy Optimization (2026.findings-acl)

Challenge:	Large language models (LLMs) traditionally represent text as sequences of discrete tokens . a long-context scaling problem requires processing more tokens more efficiently .
Approach:	They propose a framework that renders long texts into compact visual pages and processes them with a vision-language model.
Outcome:	The proposed framework renders long texts into compact visual pages and processes them with a vision-language model.

Copied to clipboard

Hsiu-Yuan Huang, Chenming Tang, Weijie Liu, Clive Bai, Saiyong Yang, Yunfang Wu

KnowCoder-X: Boosting Multilingual Information Extraction via Code (2025.findings-acl)

Challenge:	Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods exhibit limited exploration due to reliance on on-policy rollouts which are limited to the current policy’s distribution, resulting in narrow trajectory diversity.
Approach:	They propose a framework that leverages the in-context learning capability of Large Reasoning Models to provide expert guidance using existing datasets.
Outcome:	The proposed framework improves RLVR performance and training stability on mathematical reasoning benchmarks.

Copied to clipboard

Yuxin Zuo, Wenxuan Jiang, Wenxuan Liu, Zixuan Li, Long Bai, Hanbin Wang, Yutao Zeng, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)

Challenge:	Empirical evidence indicates that Large Language Models exhibit spontaneous cross-lingual alignment in Information Extraction (IE) however, a significant imbalance across languages persists, highlighting an underlying deficiency.
Approach:	They propose a code LLM with advanced cross-lingual and multilingual capabilities for universal IE that standardizes the representation of multilingual schemas using Python classes and conducts IE alignment instruction tuning on translated instance prediction task.
Outcome:	The proposed model surpasses ChatGPT and SoTA by 30.17% without training in 29 unseen languages and significantly improves cross-lingual IE transferability.

Copied to clipboard

Jiawei Li, Yizhe Yang, Yu Bai, Xiaofeng Zhou, Yinghao Li, Huashan Sun, Yuhang Liu, Xingpeng Si, Yuhao Ye, Yixiao Wu, 林一冠林一冠, Bin Xu, Ren Bowen, Chong Feng, Yang Gao, Heyan Huang

Chumor 2.0: Towards Better Benchmarking Chinese Humor Understanding from (Ruo Zhi Ba) (2025.findings-acl)

Challenge:	Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications.
Approach:	They propose a reliable strategy for domains to choose more robust LLMs for real-world applications.
Outcome:	The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications.

Copied to clipboard

Ruiqi He, Yushu He, Longju Bai, Jiarui Liu, Zhenjie Sun, Zenghao Tang, He Wang, Hanchen Xia, Rada Mihalcea, Naihao Deng

MR. Judge: Multimodal Reasoner as a Judge (2025.emnlp-main)

Challenge:	Existing studies on humor in non-English languages lack culturally nuanced humor in other languages.
Approach:	They construct a Chinese humor explanation dataset using a reddit-like platform . they test ten LLMs and find they are significantly better than existing LLM models .
Outcome:	The proposed dataset is the first and largest Chinese humor explanation dataset.

Copied to clipboard

Renjie Pi, Haoping Bai, Qibin Chen, Xiaoming Simon Wang, Jiulong Shan, Xiaojiang Liu, Meng Cao

CMMaTH: A Chinese Multi-modal Math Skill Evaluation Benchmark for Foundation Models (2025.coling-main)

Challenge:	Effective reward modeling is especially valuable in reinforcement learning (RLHF) .
Approach:	They propose a paradigm for empowering general-purpose MLLMs judges with strong reasoning capabilities by using multiple-choice problem models instead of directly assigning scores.
Outcome:	The proposed model surpasses GPT-4o on VL-RewardBench and improves performance on MM-Vet by up to 7.7%.

Copied to clipboard

Zhongzhi Li, Ming-Liang Zhang, Pei-Jie Wang, Jian Xu, Rui-Song Zhang, Yin Fei, Zhi-Long Ji, Jin-Feng Bai, Zhen-Ru Pan, Jiaxin Zhang, Cheng-Lin Liu

Numerical Reasoning

Challenge:	Large language models excel in various language tasks, while large multimodal models effectively handle visual-language problems.
Approach:	They propose to use a multimodal multimodal model evaluation benchmark to evaluate model performance in Chinese K12 classrooms.
Outcome:	The proposed model evaluation tool is integrated with the CMMaTH dataset.

Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation (2024.acl-long)

Copied to clipboard

Aiwei Liu, Haoping Bai, Zhiyun Lu, Xiang Kong, Xiaoming Wang, Jiulong Shan, Meng Cao, Lijie Wen

EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios (2026.acl-long)

Challenge:	Existing methods to evaluate preference data without human annotations are difficult . et al., 2022b) is effective for aligning large language models with human expectations .
Approach:	They propose a method to evaluate the response preference using output probabilities under contrastive prompts.
Outcome:	The proposed method could surpass the RLHF method without human-annotated preference data.

Copied to clipboard

Bin Xu, Yu Bai, Huashan Sun, Yiguan Lin, Siming Liu, Xinyue Liang, Yaolin Li, Zhuangzhi Dong, Jingren Zhang, Yufan Deng, Xinyu Zou, Yang Gao, Heyan Huang

DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space (2024.lrec-main)

Challenge:	Existing benchmarks that focus on knowledge-intensive tasks do not reflect diverse educational scenarios.
Approach:	They propose a benchmark that incorporates 9 major scenarios and 4,000 educational contexts.
Outcome:	The proposed model performs comparable to state-of-the-art large models on the test set.

Copied to clipboard

Jianxiang Xiang, Zhenhua Liu, Haodong Liu, Yin Bai, Jia Cheng, Wenliang Chen

Dialogue Systems & Conversational Agents

Challenge:	Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited.
Approach:	They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones.
Outcome:	The proposed model greatly enhances diversity of dialog response while keeping the coherence.

Nested Event Extraction upon Pivot Element Recognition (2024.lrec-main)

Copied to clipboard

Weicheng Ren, Zixuan Li, Xiaolong Jin, Long Bai, Miao Su, Yantao Liu, Saiping Guan, Jiafeng Guo, Xueqi Cheng

Conformal Predictor for Improving Zero-Shot Text Classification Efficiency (2022.emnlp-main)

Challenge:	Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively.
Approach:	They propose a new model that extracts nested events mainly based on recognizing PEs.
Outcome:	The proposed model can extract nested events based on recognizing PEs . it incorporates information from both event types and argument roles to improve performance .

Copied to clipboard

Prafulla Kumar Choubey, Yu Bai, Chien-Sheng Wu, Wenhao Liu, Nazneen Rajani

GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion (2025.findings-acl)

Challenge:	Pre-trained language models (PLMs) have been shown effective for zero-shot (0shot) text classification.
Approach:	They propose to limit the number of likely labels using a fast base classifier-based conformal predictor calibrated on samples labeled by the 0shot model.
Outcome:	The proposed models reduce the average inference time for NLI- and NSP-based models by 25.6% and 22.2% without dropping performance below the predefined error rate of 1%.

Copied to clipboard

Kangyang Luo, Yuzhuo Bai, Cheng Gao, Shuzheng Si, Zhu Liu, Yingli Shen, Zhitong Wang, Cunliang Kong, Wenhao Li, Yufei Huang, Ye Tian, Xuantang Xiong, Lei Han, Maosong Sun

Jointly Learning to Repair Code and Generate Commit Message (2021.emnlp-main)

Challenge:	Existing knowledge graphs lack the ability to integrate structural information into LLMs and output predictions deterministically.
Approach:	They propose a method which encodes structural information of KGs and merges it with LLMs to enhance KGC performance.
Outcome:	The proposed method improves the performance of KG Completion datasets on KGs by integrating structural information with LLMs.

Copied to clipboard

Jiaqi Bai, Long Zhou, Ambrosio Blanco, Shujie Liu, Furu Wei, Ming Zhou, Zhoujun Li

Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)

Challenge:	Existing work performs code repair and commit message generation independently.
Approach:	They propose a cascaded method to repair program codes and generate commit messages in a unified framework.
Outcome:	The proposed model significantly outperforms baselines on a buggy-fixed-commit dataset.

Copied to clipboard

Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun

Pre3: Enabling Deterministic Pushdown Automata for Faster Structured LLM Generation (2025.acl-long)

Challenge:	Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks.
Approach:	They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies.
Outcome:	The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%.

Copied to clipboard

Junyi Chen, Shihao Bai, Zaijun Wang, Siyu Wu, Chuheng Du, Hailong Yang, Ruihao Gong, Shengzhong Liu, Fan Wu, Guihai Chen

MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension (2024.findings-emnlp)

Challenge:	Existing methods for structured generation of outputs are inefficient under large inference batches.
Approach:	They propose a new LLM-based method that parses LR(1) grammars into a pushdown automaton and exploits deterministic pushdown automation to optimize the constrained LLM decoding efficiency.
Outcome:	The proposed method improves time per output token (TPOT) by 40% and throughput by 36% .

Copied to clipboard

Xingyu Lu, He Cao, Zijing Liu, Shengyuan Bai, Leqing Chen, Yuan Yao, Hai-Tao Zheng, Yu Li

Question Answering

Challenge:	Existing models generate erroneous information and evaluations fail to assess factual correctness of models.
Approach:	They propose to use MoleculeQA to evaluate molecular factual correctness in large language models by organizing molecules into a taxonomy and building QA pairs through human and LLM efforts.
Outcome:	The proposed model improves the factual correctness of generated information and enables the development of new models.

Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni

Do Not Step Into the Same River Twice: Learning to Reason from Trial and Error (2026.acl-long)

Challenge:	MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach:	They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome:	The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.

Copied to clipboard

Chenming Tang, Hsiu-Yuan Huang, Weijie Liu, Clive Bai, Saiyong Yang, Yunfang Wu

RAG4ITOps: A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance (2024.emnlp-industry)

Challenge:	Existing approaches to RLVR train LMs based on their own on-policy responses and are constrained by the initial capability of LM.
Approach:	They propose an approach that hints LMs with their self-made mistakes without external guidance.
Outcome:	The proposed approach outperforms the normal group relative policy optimization and requires no external guidance.

Copied to clipboard

Tianyang Zhang, Zhuoxuan Jiang, Shengguang Bai, Tianrui Zhang, Lin Lin, Yang Liu, Jiawei Ren

Natural Language Interfaces

Challenge:	Large Language Models (LLMs) have improved the open-domain QA’s performance, but how to efficiently handle enterprise-exclusive corpora and build domain-specific QA systems are still not studied for industrial applications.
Approach:	They propose a general and comprehensive framework based on Retrieval Augmented Generation (RAG) and facilitate the whole business process of establishing QA systems for IT operations and maintenance.
Outcome:	The proposed framework achieves superior results on two kinds of QA tasks.

Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction (2025.emnlp-main)

Copied to clipboard

Wenxuan Liu, Zixuan Li, Long Bai, Yuxin Zuo, Daozhu Xu, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Challenge:	Event Extraction (EE) is a long-standing target, but lacks an efficient and effective annotation framework to construct the corresponding datasets.
Approach:	They propose an LLM-based collaborative annotation framework that refines annotations of triggers from distant supervision and carries out argument annotation.
Outcome:	The proposed framework outperforms state-of-the-art methods on the largest EE dataset to date . it achieves the F1 scores of 90% and 85.3% on the human-annotated test set .

Copied to clipboard

Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun

ImCoref-CeS: An Improved Lightweight Pipeline for Coreference Resolution with LLM-based Checker-Splitter Refinement (2026.acl-long)

Challenge:	Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach:	They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome:	The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.

Copied to clipboard

Kangyang Luo, Yuzhuo Bai, Shuzheng Si, Cheng Gao, Zhitong Wang, Yingli Shen, Wenhao Li, Zhu Liu, Yufeng Han, Jiayi Wu, Cunliang Kong, Maosong Sun

Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation (2023.findings-emnlp)

Challenge:	Existing supervised neural methods for coreference resolution are underexplored . current methods rely on small language models, but their potential is underexploited .
Approach:	They propose a framework that integrates an enhanced supervised model with LLM-based reasoning.
Outcome:	The proposed method surpasses existing state-of-the-art methods in coreference resolution.

Copied to clipboard

Zixian Guo, Yuxiang Wei, Ming Liu, Zhilong Ji, Jinfeng Bai, Yiwen Guo, Wangmeng Zuo

Pre-trained Language Model Based Active Learning for Sentence Matching (2020.coling-main)

Challenge:	Large vision-language models are often not open-source due to preventing abuse or commercial factors.
Approach:	They propose a method for parameter-efficient fine-tuning to improve model accessibility . large models are often not open-source due to preventing abuse or commercial factors . they propose implementing a lightweight adapter over the output feature of an inaccessible model .
Outcome:	The proposed methods improve on 11 benchmarks and are made publicly available.

Copied to clipboard

Guirong Bai, Shizhu He, Kang Liu, Jun Zhao, Zaiqing Nie

AutoGraph-R1: End-to-End Reinforcement Learning for Knowledge Graph Construction (2026.acl-long)

Challenge:	Existing active learning approaches for natural language processing ignore the characteristics of natural language.
Approach:	They propose a pre-trained language model based active learning approach for sentence matching that provides linguistic criteria to measure instances and help select more effective instances for annotation.
Outcome:	The proposed approach can achieve greater accuracy with fewer labeled training instances.

Copied to clipboard

Hong Ting Tsang, Jiaxin Bai, Haoyu Huang, Qiao Xiao, Tianshi Zheng, Baixuan Xu, Shujie Liu, Yangqiu Song

Structured Data in NLP

Challenge:	Currently, knowledge graphs are decoupled from their downstream application, resulting in suboptimal graph structures.
Approach:	They propose a framework to directly optimize KG construction for task performance using Reinforcement Learning (RL).
Outcome:	The proposed framework improves performance across multiple QA benchmarks and consistently achieves significant performance gains over task-agnostic baseline graphs.

Incremental Intent Detection for Medical Domain with Contrast Replay Networks (2022.findings-acl)

Copied to clipboard

Guirong Bai, Shizhu He, Kang Liu, Jun Zhao

FrontCoder: Scaling Visual Fidelity in Front-End Code Generation (2026.findings-acl)

Challenge:	Existing methods to detect medical intents require fixed pre-defined intent categories . however, novel medical intent categories incessantly emerge with new data and intents in the real world .
Approach:	They propose to incrementally learn emerged medical intents from continually arriving data of new intents while avoiding catastrophically forgetting old ones.
Outcome:	The proposed method outperforms the state-of-the-art model on two benchmarks by 5.7% and 9.1% accuracy.

Copied to clipboard

Jun Feng, Jian Yang, Wei Zhang, Jing Wang, Keyi Chen, Xiaokun Yang, Weicheng Gu, Yihang Lou, Yan Bai, Xianglong Liu

MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking (2024.lrec-main)

Challenge:	Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers.
Approach:	They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning .
Outcome:	The proposed model achieves competitive performance with frontier models while maintaining generation efficiency.

Copied to clipboard

Tianwen Tang, Tong Zhu, Haodong Liu, Yin Bai, Jia Cheng, Wenliang Chen

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction (2021.findings-acl)

Challenge:	Existing zero-shot dialogue state tracking models suffer from domain transferring and partial prediction problems.
Approach:	They propose to establish connections between similar slots in different domains to improve model transfer performance in unseen domains.
Outcome:	Empirical results show that the proposed model achieves the goal accuracy of 57.13% on MultiWOZ2.1 and 55.4.

Copied to clipboard

Tianyu Gao, Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyu Xie, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)

Challenge:	Distantly supervised relation extraction (RE) has attracted much attention in the past few years . previous methods to evaluate models manually or directly on autolabeled data have produced inaccurate evaluations .
Approach:	They propose to use distant supervision to generate large-scale autolabeled data . they build manually-annotated test sets for two DS-RE datasets and evaluate models .
Outcome:	The proposed method produces 53% wrong labels at the entity pair level in the popular NYT10 dataset.

Copied to clipboard

Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Challenge:	Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin.
Approach:	They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation.
Outcome:	The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin.

Copied to clipboard

Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin

Improving Open-Domain Dialogue Systems via Multi-Turn Incomplete Utterance Restoration (D19-1)

Challenge:	Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach:	They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome:	The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.

Copied to clipboard

Zhufeng Pan, Kun Bai, Yan Wang, Lianqiang Zhou, Xiaojiang Liu

Natural Language Interfaces

Challenge:	Experimental results show that restoring incomplete utterances from context improves the performance of open-domain dialogue systems.
Approach:	They propose to use a dataset to restore incomplete utterances from context . they propose to pick and combine the data to restore the incomplete .
Outcome:	The proposed model significantly boosts response quality of open-domain dialogue systems.

EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)

Copied to clipboard

Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song

Chinese Morph Resolution in E-commerce Live Streaming Scenarios (2025.naacl-industry)

Challenge:	Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges .
Approach:	They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions.
Outcome:	The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset .

Copied to clipboard

Jiahao Zhu, Jipeng Qiang, Ran Bai, Chenyu Liu, Xiaoye Ouyang

Challenge:	Live morph resolution task is used to detect e-commerce live streaming violations . morphs are used to evade scrutiny and engage in false advertising .
Approach:	They propose a task to detect morph violations in live streaming scenarios . they use large language models to generate additional training data .
Outcome:	The proposed method improves performance and improves live streaming regulation.

Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation (2024.acl-long)

Copied to clipboard

Jiaxin Bai, Yicheng Wang, Tianshi Zheng, Yue Guo, Xin Liu, Yangqiu Song

Robust Membership Inference for Large Language Models under Adversarial Generative Corruption (2026.acl-long)

Challenge:	Abductive reasoning is the process of making educated guesses to provide explanations for observations.
Approach:	They propose a task of complex logical hypothesis generation to generate a complex logique hypothesis that can explain a set of observations.
Outcome:	The proposed model generates logical hypotheses closer to the reference hypothesis, but not better on unseen observations.

Copied to clipboard

Yuanhong Huang, Huili Wang, Xueying Bai, Jinrui Wang, Jiajun Liu, Ziqin Wang, Wanchun Ni, Shangguang Wang, Tao Qi

A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Challenge:	Membership inference attacks are a promising tool for auditing training data of LLMs . existing methods rely on the assumption that LLM's assign higher confidence scores to training samples than to non-training ones.
Approach:	They propose a membership inference framework that can be robust against adversarial MIAs.
Outcome:	The proposed framework can be robust against adversarial MIA methods and AIGT detectors while maintaining the performance of baselines.

Copied to clipboard

Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo

Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)

Challenge:	Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach:	They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome:	The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.

Copied to clipboard

Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen

CERD: A Comprehensive Chinese Rhetoric Dataset for Rhetorical Understanding and Generation in Essays (2024.findings-emnlp)

Challenge:	Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning.
Approach:	They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties.
Outcome:	The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion.

Copied to clipboard

Nuowei Liu, Xinhao Chen, Hongyi Wu, Changzhi Sun, Man Lan, Yuanbin Wu, Xiaopeng Bai, Shaoguang Mao, Yan Xia

Challenge:	Existing rhetorical understanding and generation datasets focus on single coarse-grained categories or fine-grain categories, neglecting the intrinsic connections between different rhetorical devices.
Approach:	They propose a Chinese Essay Rhetoric Dataset with four coarse-grained categories . they propose to treat these categories as separate sub-tasks, thereby improving writing skills .
Outcome:	The proposed dataset improves the author's writing proficiency and language usage skills by recognizing and generating rhetorical sentences under given conditions.

MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding (2024.emnlp-main)

Copied to clipboard

Baixuan Xu, Weiqi Wang, Haochen Shi, Wenxuan Ding, Huihao Jing, Tianqing Fang, Jiaxin Bai, Xin Liu, Changlong Yu, Zheng Li, Chen Luo, Qingyu Yin, Bing Yin, Long Chen, Yangqiu Song

Knowledge Graph Embedding with Atrous Convolution and Residual Learning (2020.coling-main)

Challenge:	Existing methods for acquiring large-scale intentions generate product-centric intentions without product images and incur high costs for scalability.
Approach:	They propose a multimodal framework that allows Large Vision-Language Models to infer purchase intentions from multimodal product metadata and prioritize human-centric ones.
Outcome:	The proposed framework shows that it is robust to different prompts and superior to previous methods.

Copied to clipboard

Feiliang Ren, Juchen Li, Huihui Zhang, Shilei Liu, Bochao Li, Ruicheng Ming, Yujia Bai

Aspect Is Not You Need: No-aspect Differential Sentiment Framework for Aspect-based Sentiment Analysis (2022.naacl-main)

Challenge:	Existing knowledge graph embedding methods are complex and require time for training and inference.
Approach:	They propose an atrous convolution based knowledge graph embedding method that increases feature interactions by using atrous . they evaluate method on six benchmark datasets with different evaluation metrics .
Outcome:	The proposed method achieves better results on six benchmark datasets than state-of-the-art methods on most evaluation metrics.

Copied to clipboard

Jiahao Cao, Rui Liu, Huailiang Peng, Lei Jiang, Xu Bai

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (2024.acl-long)

Challenge:	Existing approaches to classify aspects with aspect sentiment bias are hard to find .
Approach:	They propose a no-aspect differential sentiment framework for the ABSA task that eliminates aspect sentiment bias and uses differential sentiment loss instead of cross-entropy loss to better classify the sentiments.
Outcome:	The proposed framework can be combined with almost all traditional ABSA methods.

Copied to clipboard

Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li

Learn to Adapt for Generalized Zero-Shot Text Classification (2022.acl-long)

Challenge:	Large language models (LLMs) can only handle texts a few thousand tokens long, limiting their applications on longer sequence inputs, such as books, reports, and codebases.
Approach:	They propose a bilingual, multi-task benchmark for long context understanding that extends context windows and more sophisticated memory mechanisms to improve models' long context capabilities.
Outcome:	The proposed model outperforms open-source models but struggles on longer contexts.

Copied to clipboard

Yiwen Zhang, Caixia Yuan, Xiaojie Wang, Ziwei Bai, Yongbin Liu

Information Retrieval

Challenge:	Existing methods for generalized zero-shot text classification generalize poorly since the learned parameters are only optimal for seen classes rather than for both classes.
Approach:	They propose a network that trains an adaptive classifier by using both seen and virtual unseen classes to simulate a generalized zero-shot learning scenario.
Outcome:	The proposed model outperforms several previous approaches on five text classification datasets.

Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)

Copied to clipboard

Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng

Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning (2025.emnlp-main)

Challenge:	Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge.
Approach:	They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy.
Outcome:	The proposed model protects private data while enhancing the model's knowledge.

Copied to clipboard

Deng Linger, Linghao Zhu, Yuliang Liu, Yu Wang, Qunyi Xie, Jingjing Wu, Gang Zhang, Yingying Zhu, Xiang Bai

Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction (2024.naacl-short)

Challenge:	Existing methods for generating geometric reasoning data through Chain-of-Thought (CoT) frameworks face three fundamental limitations: 1) lack of high-quality annotations and domain-specific expertise to ensure theorem-grounded diagrams. 2) lack of a coherent model; 3) lack of coherent model.
Approach:	They propose a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis framework that synthesizes theorematic diagrams with structured descriptions and properties.
Outcome:	The proposed framework expands theorem-type coverage, corrects misunderstandings, and enhances geometric reasoning.

Copied to clipboard

Shilong Li, Ge Bai, Zhang Zhang, Ying Liu, Chenji Lu, Daichi Guo, Ruifang Liu, Sun Yong

MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Models (2026.findings-eacl)

Challenge:	Existing methods to extract unseen relations require laborious manual annotation . a new approach uses fine-grained matching to reduce manual annotation cost .
Approach:	They propose an efficient multi-grained matching approach that uses virtual entity matching to reduce manual annotation cost.
Outcome:	The proposed approach outperforms the state-of-the-art methods and achieves inference efficiency and accuracy in zero-shot relation extraction tasks.

Copied to clipboard

Siwei Wu, King Zhu, Yu Bai, Yiming Liang, Yizhi Li, Haoning Wu, Jiaheng Liu, Ruibo Liu, Xingwei Qu, Xuxin Cheng, Ge Zhang, Wenhao Huang, Chenghua Lin

IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce (2024.findings-emnlp)

Challenge:	Current multimodal benchmarks focus on facts within individual images, but neglect associative relations among multiple images.
Approach:	They propose a multi-image relational association task and a MMRA benchmark to evaluate LVLMs.
Outcome:	The proposed benchmarks show that entity-level multi-image perception tasks pose greater challenges than image-level tasks.

Copied to clipboard

Wenxuan Ding, Weiqi Wang, Sze Kwok, Minghao Liu, Tianqing Fang, Jiaxin Bai, Xin Liu, Changlong Yu, Zheng Li, Chen Luo, Qingyu Yin, Bing Yin, Junxian He, Yangqiu Song

Towards Real-world Scenario: Imbalanced New Intent Discovery (2024.acl-long)

Challenge:	Existing approaches that distill intentions from LMs fail to generate meaningful and human-centric intentions applicable in real-world E-commerce contexts.
Approach:	They propose a double-task multiple-choice question answering benchmark to evaluate LMs' comprehension of purchase intentions in E-commerce.
Outcome:	The proposed benchmark consists of 4,360 carefully curated problems across three difficulty levels, constructed using an automated pipeline to ensure scalability on large E-commerce platforms.

Copied to clipboard

Shun Zhang, Yan Chaoran, Jian Yang, Jiaheng Liu, Ying Mo, Jiaqi Bai, Tongliang Li, Zhoujun Li

Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models (2024.findings-emnlp)

Challenge:	Existing studies focus on detecting known and previously undefined categories of user intent . skewed and long-tailed distributions often encountered in open-world scenarios .
Approach:	They propose to use imbalanced new intent discovery task to identify familiar and novel intent categories within long-tailed distributions.
Outcome:	The proposed model outperforms the existing benchmark on three datasets to simulate the real-world long-tail distributions.

Copied to clipboard

Jiaming Li, Lei Zhang, Yunshui Li, Ziqiang Liu, Yuelin Bai, Run Luo, Longze Chen, Min Yang

PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization (2022.coling-1)

Challenge:	Large language models struggle to meet user’s needs when required to generate responses of a specific length due to their inherent difficulty in accurately perceiving numerical constraints.
Approach:	They propose a Target Length Generation Task and propose RULER, a model-agnostic approach that controls generated length for large language models.
Outcome:	The proposed model-agnostic approach improves instruction-following ability of large language models under length-constrained instructions and can generate appropriate MLT when length constraints are not explicitly provided.

Copied to clipboard

Xiaochen Liu, Yang Gao, Yu Bai, Jiawei Li, Yinan Hu, Heyan Huang, Boxing Chen

Faster and Better LLMs via Latency-Aware Test-Time Scaling (2025.findings-emnlp)

Challenge:	Experimental results show that our method outperforms full-model tuning in few-shot abstractive summarization tasks.
Approach:	They propose a soft prompts architecture with prompt pre-training and prompt fine-tuning paradigm to support few-shot abstractive summarization.
Outcome:	The proposed model outperforms Prompt Tuning and Profix-Tuning on CNN/DailyMail and XSum datasets and outperfies Profix Tuning by a large margin.

Copied to clipboard

Zili Wang, Tianyu Zhang, Haoli Bai, Lu Hou, Xianzhi Yu, Wulong Liu, Shiming Xiang, Lei Zhu

Challenge:	Existing research has overlooked the efficiency of TTS from a latency-sensitive perspective.
Approach:	They propose two approaches to achieve latency-optimal TTS by branch-wise parallelism and sequence-wise parallelism.
Outcome:	The proposed approach achieves latency-optimal TTS for large models . branch-wise parallelism and sequence-wise parallelism are key approaches .

CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning (2024.acl-long)

Copied to clipboard

Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi, Wenxuan Ding, Baixuan Xu, Zhaowei Wang, Jiaxin Bai, Xin Liu, Cheng Jiayang, Chunkit Chan, Yangqiu Song

From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)

Challenge:	Existing approaches to generalize commonsense reasoning lack instantiated knowledge and require pre-built concept taxonomies and annotations.
Approach:	They propose a framework that iteratively performs contextualized conceptualization and instantiation over commonsense knowledge bases by instructing large language models to generate both types of knowledge with critic filtering.
Outcome:	Empirical results show that distilling CANDLE on student models provides benefits across three downstream tasks.

Copied to clipboard

Jiajun Zhang, Zeyu Cui, Jiaxi Yang, Lei Zhang, Yuheng Jing, Zeyao Ma, Tianyi Bai, Zilei Wang, Qiang Liu, Liang Wang, Binyuan Hui, Junyang Lin

Programming Languages in NLP

Challenge:	Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency.
Approach:	They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process.
Outcome:	The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing.

SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis (2025.findings-emnlp)

Copied to clipboard

Shuang Sun, Huatong Song, Yuhao Wang, Ruiyang Ren, Jinhao Jiang, Junjie Zhang, Fei Bai, Jia Deng, Xin Zhao, Zheng Liu, Lei Fang, Zhongyuan Wang, Ji-Rong Wen

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Challenge:	Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data.
Approach:	They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments.
Outcome:	The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments.

Copied to clipboard

Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang

Intention Knowledge Graph Construction for User Intention Relation Modeling (2026.eacl-long)

Challenge:	Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach:	They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome:	The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.

Copied to clipboard

Jiaxin Bai, Zhaobo Wang, Junfei Cheng, Dan Yu, Zerui Huang, Weiqi Wang, Xin Liu, Chen Luo, Yanming Zhu, Bo Li, Yangqiu Song

MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues (2024.acl-long)

Challenge:	Existing knowledge graphs focus on connecting intentions but lacks the ability to model the relationships between different intentions.
Approach:	They propose a framework to automatically generate an intention knowledge graph, capturing connections between user intentions.
Outcome:	The proposed model outperforms state-of-the-art methods and shows its utility.

Copied to clipboard

Ge Bai, Jie Liu, Xingyuan Bu, Yancheng He, Jiaheng Liu, Zhanhui Zhou, Zhuoran Lin, Wenbo Su, Tiezheng Ge, Bo Zheng, Wanli Ouyang

Natural Language Interfaces

Challenge:	Large Language Models (LLMs) have greatly enhanced dialogue systems, but evaluation of their capabilities remains a challenge.
Approach:	They propose a model to evaluate the fine-grained abilities of Large Language Models in multi-turn dialogues.
Outcome:	The proposed model evaluates 21 popular chatbots based on MT-Bench-101 . it includes 3 overarching abilities and 13 distinct tasks within multi-turn dialogue scenarios.

VLP: Vision-Language Preference Learning for Embodied Manipulation (2025.emnlp-main)

Copied to clipboard

Runze Liu, Chenjia Bai, Jiafei Lyu, Shengjie Sun, Yali Du, Xiu Li

Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model (2022.naacl-industry)

Challenge:	Existing approaches to reward engineering are time-consuming and expensive to collect human preference labels.
Approach:	They propose a vision-language preference learning framework which learns from human feedback . they define three types of language-conditioned preferences and construct a visual preference dataset .
Outcome:	The proposed framework outperforms baselines on embodied manipulation tasks and can be applied to other tasks.

Copied to clipboard

Gongzheng Li, Yadong Xi, Jingzhen Ding, Duan Wang, Ziyang Luo, Rongsheng Zhang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao

DIXITWORLD: Evaluating Multimodal Abductive Reasoning in Vision-Language Models with Multi-Agent Dixit Gameplay (2026.acl-short)

Challenge:	Recent studies show that transformer-based models are effective over many tasks, but they are expensive to deploy in the industrial application.
Approach:	They propose a transformer-based inference solution that optimizes kernels for long inputs and large hidden sizes and a flexible CUDA memory manager to reduce the memory footprint when deploying a large model.
Outcome:	The proposed solution achieves an average speedup of 1.40-4.20x on the transformer decoder layer with an A100 GPU.

Copied to clipboard

Yunxiang MO, Tianshi Zheng, Qing Zong, Jiayu Liu, Baixuan Xu, Yauwai Yim, Chunkit Chan, Jiaxin Bai, Yangqiu Song

GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models (2024.findings-emnlp)

Challenge:	Existing evaluations of multimodal abductive reasoning are limited to static, single-agent tasks.
Approach:	They propose a multiagent evaluation suite that deconstructs the current evaluations of multimodal abductive reasoning in vision–language models.
Outcome:	The evaluation suite is based on two core components: DixitArena and DixitsBench.

Copied to clipboard

Shilong Li, Yancheng He, Hangyu Guo, Xingyuan Bu, Ge Bai, Jie Liu, Jiaheng Liu, Xingwei Qu, Yangguang Li, Wanli Ouyang, Wenbo Su, Bo Zheng

FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery (2023.findings-acl)

Challenge:	Existing models for long contexts struggle to handle long inputs due to limited context window and memory usage.
Approach:	They propose a graph-based agent system that analyzes long texts into a graphical graph . GraphReader consistently outperforms GPT-4-128k across context lengths from 16k to 256k .
Outcome:	The proposed model outperforms existing models on four challenging benchmarks.

Copied to clipboard

Changlong Yu, Weiqi Wang, Xin Liu, Jiaxin Bai, Yangqiu Song, Zheng Li, Yifan Gao, Tianyu Cao, Bing Yin

Commonsense Reasoning

Challenge:	Existing intention-based studies on recommendation tasks are limited and use models to implicitly model the intention memberships.
Approach:	They propose a framework that leverages the generation power of large language models and human-in-the-loop annotation to semi-automatically construct the intention knowledge graph.
Outcome:	The proposed framework can model e-commerce knowledge and have many potential applications.

Think Parallax: Solving Multi-Hop Problems via Multi-View Knowledge-Graph-Based Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Jinliang Liu, Jiale Bai, Shaoning Zeng

Structured Data in NLP

Challenge:	Existing KG-RAG systems collapse all reasoning hops into a single representation, flat embedding space, suppressing this implicit structure and causing noisy or drifted path exploration.
Approach:	They propose a symmetric multi-view framework that decouples queries and KGs into aligned, head-specific retrieval spaces.
Outcome:	The proposed framework achieves state-of-the-art retrieval and QA performance on WebQSP and CWQ, and significantly reduces hallucination.

BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Prediction (2024.acl-long)

Copied to clipboard

Yinhao Bai, Yalan Xie, Xiaoyi Liu, Yuhua Zhao, Zhixin Han, Mengting Hu, Hang Gao, Renhong Cheng

IsOBS: An Information System for Oracle Bone Script (2020.emnlp-demos)

Challenge:	Aspect sentiment quad prediction aims to predict aspects due to distinct data distribution.
Approach:	They propose a method that aggregates multiple templates with a broader view . they first construct a few-shot ASQP dataset that contains richer categories .
Outcome:	The proposed method outperforms the state-of-the-art methods under four few-shot settings and other public datasets.

Copied to clipboard

Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyuan Liu, Maosong Sun

Challenge:	Oracle bone script (OBS) documents are the oldest continuously-used writing system in the world and are important for linguistic and historical research.
Approach:	They construct an information system for OBS to symbolize, serialize, and store OBS data at the character-level using efficient databases and retrieval modules.
Outcome:	The proposed system symbolizes, serializes, and stores OBS data at the character-level, based on efficient databases and retrieval modules.

Unlocking the Black Box of Latent Reasoning: An Interpretability-Guided Approach to Intervention (2026.acl-long)

Copied to clipboard

Shuochen Chang, Tong Bai, Xiaofeng Zhang, Qianli Ma, Qingyang Liu, Zhaohe Liao, Yibo Miao, Li Niu