Papers by Yang Bai

VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025.coling-main)

Challenge:	Context faithfulness is essential for reliable reasoning in context-dependent scenarios.
Approach:	They propose a method that identifies and fine-tunes context-faithful experts . they propose 'context-faither fine- tuning' which selectively fine- tunes them .
Outcome:	The proposed method identifies experts with specialization in context utilization and improves context grounding.

Copied to clipboard

Wenrui Liu, Jionghao Bai, Xize Cheng, Jialong Zuo, Ziyue Jiang, Shengpeng Ji, Minghui Fang, Xiaoda Yang, Qian Yang, Zhou Zhao

HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Challenge:	Existing multilingual TTS datasets are limited in speech generation fields due to lack of quality data.
Approach:	They propose to use 30,000 hours of high-quality speech data across 3 languages . they filter out low-quality text-text pairs and concatenate short transcripts .
Outcome:	The proposed dataset comprises 30,000 hours of high-quality speech data, across 3 languages with multiple speakers and styles, suitable for various speech tasks such as TTS and ASR.

Copied to clipboard

Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li

LLM-based Translation Inference with Iterative Bilingual Understanding (2025.findings-acl)

Challenge:	Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach:	They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome:	The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.

Copied to clipboard

Andong Chen, Kehai Chen, Yang Xiang, Xuefeng Bai, Muyun Yang, Yang Feng, Tiejun Zhao, Min Zhang

Multilinguality

Challenge:	Existing studies show that the ability of large language models to generate contextual understanding of the sentence can degrade translation quality.
Approach:	They propose a method that generates contextual understanding for both source and target languages separately.
Outcome:	The proposed method outperforms strong comparison methods in multiple domains.

Cross-Lingual Abstractive Summarization with Limited Parallel Resources (2021.acl-long)

Copied to clipboard

Yu Bai, Yang Gao, Heyan Huang

Generalizable Cross-Lingual Cognitive Distortion Detection with Standardized Annotations and Multi-Task Learning (2025.findings-acl)

Challenge:	Existing approaches to cross-lingual summarization use limited available cross-linguistic resources.
Approach:	They propose a multi-task framework for cross-lingual abstractive summarization that uses a single decoder to generate monolingual and cross-linguistic summaries.
Outcome:	Experiments on two CLS datasets show that the proposed model outperforms baseline models in low-resource and full-dataset scenarios.

Copied to clipboard

Hongzhi Qi, Nan Bai, Jianqiang Li, Wei Zhai, Qing Zhao, Qi Gao, Bing Xiang Yang, Guanghui Fu

LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression (2020.coling-main)

Challenge:	Existing studies on cognitive distortion have limited generalizability and performance of models in large-scale and cross-linguistic contexts.
Approach:	They propose a multi-task learning model based on teacher student architecture solution which improves generalization performance.
Outcome:	The proposed model improves generalizability and interpretability of the proposed model.

Copied to clipboard

Yihuan Mao, Yujing Wang, Chufan Wu, Chen Zhang, Yang Wang, Quanlu Zhang, Yaming Yang, Yunhai Tong, Jing Bai

RoadMapper: A Multi-Agent System for Roadmap Generation of Solving Complex Research Problems (2026.findings-acl)

Challenge:	Existing models that use knowledge distillation are memory-intensive and latency-prohibitive . Existing solutions that use this knowledge distilling framework are expensive .
Approach:	They propose a solution that uses weight pruning, matrix factorization and knowledge distillation to learn a smaller model.
Outcome:	The proposed model reduces the training overheads by an order of magnitude on public datasets while preserving state-of-the-art accuracy.

Copied to clipboard

Jiacheng Liu, Zichen Tang, Zhongjun Yang, Xinyi Hu, Xueyuan Lin, Linwei Jia, Ruofei Bai, Rongjin Li, Shiyao Peng, Haocheng Gao, Haihong E

Enhancing Self-Attention with Knowledge-Assisted Attention Maps (2022.naacl-main)

Challenge:	Existing tools to generate structured content for research tasks are limited in their ability to generate high-quality roadmaps.
Approach:	They propose a benchmark to evaluate the ability of large language models (LLMs) to generate high-quality roadmaps for solving complex research problems.
Outcome:	The proposed system can improve LLMs’ ability for roadmap generation while saving 84% of the time required by human experts.

Copied to clipboard

Jiangang Bai, Yujing Wang, Hong Sun, Ruonan Wu, Tianmeng Yang, Pengfei Tang, Defu Cao, Mingliang Zhang1, Yunhai Tong, Yaming Yang, Jing Bai, Ruofei Zhang, Hao Sun, Wei Shen

An Empirical Study of Frame Selection for Text-to-Video Retrieval (2023.findings-emnlp)

Challenge:	Existing works of knowledge infusion depend on multi-task learning frameworks, which are inefficient and require large-scale retraining when new knowledge is considered.
Approach:	They propose a method which integrates knowledge-generated attention maps into the self-attention mechanism and integrates it into the model.
Outcome:	The proposed model outperforms existing methods on academic datasets and industry-scale ad relevance applications.

Copied to clipboard

Mengxia Wu, Min Cao, Yang Bai, Ziyin Zeng, Chen Chen, Liqiang Nie, Min Zhang

Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Challenge:	Existing methods for text-to-video retrieval select a subset of frames to represent video content . current methods only explore video contents while ignoring relevancy to texts .
Approach:	They propose to use a subset of frames to represent video content for TVR . they analyze six different frame selection methods to determine their effectiveness .
Outcome:	The proposed method improves retrieval efficiency without sacrificing visual details . the proposed method explores the video contents while ignoring relevancy to texts .

Copied to clipboard

null Ymyang, Jiang Zhong, Li Jin, Xiao Sun, Jingwang Huang, null Gaojinpeng, Qing Liu, Yang Bai, Jingyuan Zhang, Rui Jiang, Qin Lei, Kaiwen Wei

Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation (2025.acl-long)

Challenge:	Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach:	They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome:	The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.

Copied to clipboard

Andong Chen, Yuchen Song, Kehai Chen, Xuefeng Bai, Muyun Yang, Liqiang Nie, Jie Liu, Tiejun Zhao, Min Zhang

Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training (2024.acl-long)

Challenge:	Experimental results show that our model significantly outperforms existing multimodal MT and text-only MT.
Approach:	They propose a stable diffusion-based imagination network into a multimodal large language model to generate an image for each source sentence.
Outcome:	The proposed model outperforms existing multimodal and text-only MT and achieves an average improvement of 14 BLEU points on Multi30K and MSCOCO multimodal MT benchmarks.

Copied to clipboard

Feiteng Fang, Yuelin Bai, Shiwen Ni, Min Yang, Xiaojun Chen, Ruifeng Xu

Robustness in NLP

Challenge:	Large language models (LLMs) exhibit substantial capabilities yet face challenges such as hallucination, outdated knowledge, and untraceable reasoning processes.
Approach:	They propose a retrieval-augmented generation approach that leverages adaptive adversarial training to dynamically adjust the model’s training process in response to retrieval noises.
Outcome:	The proposed approach improves the performance of the LLaMA-2 7B model under diverse noise conditions.

ATFormer: A Learned Performance Model with Transfer Learning Across Devices for Deep Learning Tensor Programs (2023.emnlp-main)

Copied to clipboard

Yang Bai, Wenqian Zhao, Shuo Yin, Zixiao Wang, Bei Yu

Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models (2025.acl-long)

Challenge:	Compilation-based methods with performance models have poor measurement accuracy and transferability between platforms.
Approach:	They propose a compiler that automatically generates tensors and automatically tunes them for different hardware platforms.
Outcome:	The proposed model reduces inference time and costs on modern DNN benchmarks.

Copied to clipboard

Shuai Niu, Jing Ma, Hongzhan Lin, Liang Bai, Zhihua Wang, Richard Yi Da Xu, Yunya Song, Xian Yang

Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)

Challenge:	Existing models struggle to balance predictive accuracy with human-understandable rationales.
Approach:	They propose to enhance LLMs by leveraging rationale distillation and domain knowledge injection for trustworthy multimodal rationale generation.
Outcome:	Experiments on real-world medical datasets show that ClinRaGen achieves state-of-the-art performance in disease diagnosis and rationale generation.

Copied to clipboard

Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou

Information Extraction & Text Mining

Challenge:	Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text.
Approach:	They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types.
Outcome:	The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages.

Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)

Copied to clipboard

Yingjie Zhu, Xuefeng Bai, Kehai Chen, Yang Xiang, Jun Yu, Min Zhang

Maximizing Local Entropy Where It Matters: Prefix-Aware Localized LLM Unlearning (2026.acl-long)

Challenge:	Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains.
Approach:	They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks.
Outcome:	Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information.

Copied to clipboard

Naixin Zhai, Pengyang Shao, Binbin Zheng, Yonghui Yang, Fei Shen, Long Bai, Xun Yang

Challenge:	Existing approaches to machine unlearning treat all tokens indiscriminately and enforce uncertainty over the entire vocabulary.
Approach:	They propose a framework that targets the prefix in a response and minimizes uncertainty in the critical subspace.
Outcome:	The proposed framework achieves superior forgetting efficacy and utility preservation compared to baselines.

How is BERT surprised? Layerwise detection of linguistic anomalies (2021.acl-long)

Copied to clipboard

Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz

New Intent Discovery with Attracting and Dispersing Prototype (2024.lrec-main)

Challenge:	a number of studies have shown that transformer-based language models detect when a word is anomalous in context, but likelihood scores do not tell the cause of the anomaly.
Approach:	They propose to use Gaussian models for density estimation at intermediate layers of three language models to evaluate grammaticality.
Outcome:	The proposed method on BLiMP shows that language models employ different mechanisms to detect different types of linguistic anomalies.

Copied to clipboard

Shun Zhang, Jian Yang, Jiaqi Bai, Chaoran Yan, Tongliang Li, Zhao Yan, Zhoujun Li

Text Clustering

Challenge:	Existing methods for detecting new intents with labeled data are not cluster-friendly . a robust prototypical attracting learning (RPAL) method is designed to compel instances to gravitate toward their corresponding prototype .
Approach:	They propose a robust and adaptive prototypical learning framework for globally distinct decision boundaries for both known and new intent categories.
Outcome:	The proposed method improves on CLINC, BANKING, and StackOverflow benchmarks on three challenging benchmarks.

MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media (2025.emnlp-main)

Copied to clipboard

Wei Zhai, Nan Bai, Qing Zhao, Jianqiang Li, Fan Wang, Hongzhi Qi, Meng Jiang, Xiaoqin Wang, Bing Xiang Yang, Guanghui Fu

Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees (2021.eacl-main)

Challenge:	Social media is a key platform for emotional expression, yet deep learning lacks flexibility and interpretability.
Approach:	They propose to use Chinese social media to train interpretable mental health instruction datasets to test models' ability to explain their decisions.
Outcome:	The proposed models outperform deep learning and LLMs on three mental health downstream tasks and demonstrate their potential for clinical applications.

Copied to clipboard

Jiangang Bai, Yujing Wang, Yiren Chen, Yaming Yang, Jing Bai, Jing Yu, Yunhai Tong

Efficient Pretraining Data Selection for Language Models via Multi-Actor Collaboration (2025.acl-long)

Challenge:	Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information.
Approach:	They propose a plug-and-play framework that incorporates syntax trees into pre-trained Transformers.
Outcome:	The proposed framework improves on pre-trained models on natural language understanding datasets and shows that it can be used to train pre-structured neural networks.

Copied to clipboard

Tianyi Bai, Ling Yang, Zhen Hao Wong, Fupeng Sun, Xinlin Zhuang, Jiahui Peng, Chi Zhang, Lijun Wu, Qiu Jiantao, Wentao Zhang, Binhang Yuan, Conghui He

Neural reality of argument structure constructions (2022.acl-long)

Challenge:	Efficient data selection is crucial to accelerate the pretraining of language models . limited research has addressed the inherent conflicts between data selection methods .
Approach:	They propose a multi-actor collaborative data selection mechanism that prioritizes data based on its specific criterion and updates prioritization rules using the current state of the model.
Outcome:	The proposed model accelerates convergence in LM pretraining and achieves an average relative performance gain of 10.5% across multiple language model benchmarks.

Copied to clipboard

Bai Li, Zining Zhu, Guillaume Thomas, Frank Rudzicz, Yang Xu

Linguistics & Cognitive NLP

Challenge:	lexicalist linguistic theories assume argument structure is predictable from meaning of verbs . construction grammarians propose argument structure constructions distinct from verbs.
Approach:	They adapt psycholinguistic studies to probe for the existence of argument structure constructions in Transformer-based language models.
Outcome:	The proposed method could be used to probe argument structure constructions in LMs . the study shows that LM learners prefer grouping by construction over verb grouping .

KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)

Copied to clipboard

Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

Aligning Paralinguistic Understanding and Generation in Speech LLMs via Multi-Task Reinforcement Learning (2026.eacl-industry)

Challenge:	None. None.. None!
Approach:	None. None.. None!
Outcome:	None. None. No. :

Copied to clipboard

Minseok Kim, Jingxiang Chen, Seong-Gyun Leem, Yin Huang, Rashi Rungta, Zhicheng Ouyang, Haibin Wu, Surya Teja Appini, Ankur Bansal, Yang Bai, Yue Liu, Florian Metze, Ahmed A Aly, Anuj Kumar, Ariya Rastrow, Zhaojiang Lin

How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment (2024.findings-emnlp)

Challenge:	Using paralinguistic cues is challenging for speech large language models, authors say . limited training data, annotation difficulty, and models exploiting lexical shortcuts are challenges . a recent study shows that modeling paralinguistic reasoning with multitask RL improves paralinguistics understanding .
Approach:	They propose multi-task reinforcement learning with chain-of-thought prompting that elicits explicit affective reasoning.
Outcome:	The proposed model improves paralinguistics understanding over baselines and strong proprietary models by 8-12% on Expresso, IEMOCAP, and RAVDESS.

Copied to clipboard

Heyan Huang, Yinghao Li, Huashan Sun, Yu Bai, Yang Gao

Challenge:	Recent studies have demonstrated that In-Context Learning (ICA) can align Large Language Models (LLMs) with human preferences without requiring parameter adjustments.
Approach:	They investigate the effectiveness of each part in enabling ICA to function effectively and examine how variants in these parts impact alignment performance.
Outcome:	The proposed model can comprehend human instructions without parameter adjustments.

STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detection (2025.findings-acl)

Copied to clipboard

Zewen Bai, Liang Yang, Shengdi Yin, Junyu Lu, Jingjie Zeng, Haohao Zhu, Yuanyuan Sun, Hongfei Lin

Ethical NLP

Challenge:	Existing studies on Chinese hate speech detection lack span-level fine-grained annotations.
Approach:	They construct a Span-level target-aware Toxicity Extraction dataset and evaluate existing models for Chinese hateful slang.
Outcome:	The proposed dataset is the first span-level Chinese hate speech dataset and evaluates the ability of existing models to understand hate semantics.

M2C: Towards Automatic Multimodal Manga Complement (2023.findings-emnlp)

Copied to clipboard

Hongcheng Guo, Boyang Wang, Jiaqi Bai, Jiaheng Liu, Jian Yang, Zhoujun Li

Think Outside the Policy: In-Context Steered Policy Optimization (2026.findings-acl)

Challenge:	Multimodal manga analysis focuses on enhancing manga understanding with visual and textual features.
Approach:	They propose a task to enhance manga understanding with visual and textual features by providing a shared semantic space for vision and language understanding.
Outcome:	The proposed task provides a shared semantic space for vision and language understanding.

Copied to clipboard

Hsiu-Yuan Huang, Chenming Tang, Weijie Liu, Clive Bai, Saiyong Yang, Yunfang Wu

Reasoning

Challenge:	Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods exhibit limited exploration due to reliance on on-policy rollouts which are limited to the current policy’s distribution, resulting in narrow trajectory diversity.
Approach:	They propose a framework that leverages the in-context learning capability of Large Reasoning Models to provide expert guidance using existing datasets.
Outcome:	The proposed framework improves RLVR performance and training stability on mathematical reasoning benchmarks.

Probing Audio-Visual Reasoning in Multimodal Language Models through the Lens of Audio (2026.acl-long)

Copied to clipboard

Kaixiong Gong, Kaituo Feng, Bohao Li, Yibing Wang, Mofan Cheng, Shijia Yang, Jiaming Han, Benyou Wang, Yutong Bai, Zhuoran Yang, Xiangyu Yue

CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling (2024.emnlp-main)

Challenge:	Recent multimodal large language models lack robust audio-visual integration ability and performance on DeafTest is highly correlated with AV-Odyssey accuracy.
Approach:	They propose a benchmarking tool that integrates audio-visual reasoning with audio-video cues to infer solutions.
Outcome:	The proposed model performs well on DeafTest, but lacks audio perception in simple audio tasks.

Copied to clipboard

Yu Bai, Xiyuan Zou, Heyan Huang, Sanxing Chen, Marc-Antoine Rondeau, Yang Gao, Jackie Cheung

Value Compass Benchmarks: A Comprehensive, Generative and Self-Evolving Platform for LLMs’ Value Evaluation (2025.acl-demo)

Challenge:	Recent studies have found that information relevant to the next token prediction task accumulates in the hidden representations of just a few tokens.
Approach:	They propose a method that integrates attention preferences useful for a downstream task into the eviction process of hidden states.
Outcome:	The proposed method performs better on comprehension and retrieval tasks while preserving language modeling perplexity.

Copied to clipboard

Jing Yao, Xiaoyuan Yi, Shitong Duan, Jindong Wang, Yuzhuo Bai, Muhua Huang, Yang Ou, Scarlett Li, Peng Zhang, Tun Lu, Zhicheng Dou, Maosong Sun, James Evans, Xing Xie

Challenge:	Current evaluation methods for large language models face two key challenges: 1. evaluation validity and 2. Result interpretation reduce the pluralistic and incommensurable values to one-dimensional scores.
Approach:	They propose a platform for comprehensive value diagnosis of large language models (LLMs) that provides a generative evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs.
Outcome:	The proposed platform provides a framework for comprehensive value diagnosis of large language models (LLMs) with fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, customized comparisons, and visualized analysis of LLM’s alignment with cultural values.

Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)

Copied to clipboard

Jiawei Li, Yizhe Yang, Yu Bai, Xiaofeng Zhou, Yinghao Li, Huashan Sun, Yuhang Liu, Xingpeng Si, Yuhao Ye, Yixiao Wu, 林一冠林一冠, Bin Xu, Ren Bowen, Chong Feng, Yang Gao, Heyan Huang

Improving Deep Embedded Clustering via Learning Cluster-level Representations (2022.coling-1)

Challenge:	Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications.
Approach:	They propose a reliable strategy for domains to choose more robust LLMs for real-world applications.
Outcome:	The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications.

Copied to clipboard

Qing Yin, Zhihua Wang, Yunya Song, Yida Xu, Shuai Niu, Liang Bai, Yike Guo, Xian Yang

Information Extraction & Text Mining

Challenge:	Existing efforts to learn meaningful representations at the instance level are limited.
Approach:	They propose a deep embedded clustering model with cluster-level representation learning to jointly learn cluster and instance level representations.
Outcome:	The proposed model produces meaningful clusters on real-world short text datasets.

OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model (2025.emnlp-demos)

Copied to clipboard

Chen Wang, Tianyu Peng, Wen Yang, YiNan Bai, Guangfu Wang, Jun Lin, Lanpeng Jia, Lingxiang Wu, Jinqiao Wang, Chengqing Zong, Jiajun Zhang

Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model (2024.findings-acl)

Challenge:	Empathetic speech models are increasingly closed off, leaving details about the architecture, data and development opaque to researchers.
Approach:	They propose an open-source empathetic speech-to-text model with a streaming interleaved decoding architecture and a data pipeline to enable end-to end training.
Outcome:	The proposed model is open-source and transparent, with no data or data required to build it.

Copied to clipboard

Hongbin Zhang, Kehai Chen, Xuefeng Bai, Yang Xiang, Min Zhang

Cross-domain Generalization for AMR Parsing (2022.emnlp-main)

Challenge:	Large language models lack explicit alignment between source and target contexts, leading to unfaithful translations.
Approach:	They propose three learning strategies to encourage LLMs to pay more attention to source context . they use a dataset to test the effectiveness of their model across multiple language pairs .
Outcome:	The proposed model reduces hallucinatory translation and improves fidelity across multiple languages.

Copied to clipboard

Xuefeng Bai, Sen Yang, Leyang Cui, Linfeng Song, Yue Zhang

LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)

Challenge:	Abstract Meaning Representation (AMR) parsing aims to predict an AMR graph from textual input.
Approach:	They evaluate five representative AMR parsers on five domains and analyze challenges to cross-domain parsing.
Outcome:	The proposed method reduces the domain distribution divergence of text and AMR features on two out-of-domain sets.

Copied to clipboard

Hao Li, Yiqun Zhang, Zhaoyan Guo, Chenxu Wang, Shengji Tang, Qiaosheng Zhang, Yang Chen, Biqing Qi, Peng Ye, Lei Bai, Zhen Wang, Shuyue Hu

Challenge:	Large language model (LLM) routing assigns each query to the best suitable model from an ensemble.
Approach:	They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation .
Outcome:	The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing.

PiKGL: Leveraging Pruned Knowledge Graphs for Explainable Stance Detection (2026.tacl-1)

Copied to clipboard

Bingbing Wang, Jingjie Lin, Zhixin Bai, Xintong Song, Qianlong Wang, Min Yang, Xi Zeng, Jing Li, Ruifeng Xu

Sentiment Analysis

Challenge:	Experimental results demonstrate that a Pruned interpretable knowledge Graph Learning framework for explainable stance detection is state-of-the-art for social media stance prediction.
Approach:	They propose a Pruned interpretable knowledge Graph Learning framework for explainable stance detection that incorporates commonsense knowledge and prunes redundant information to ensure precision and minimize noise.
Outcome:	The proposed framework achieves state-of-the-art on three public datasets.

EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios (2026.acl-long)

Copied to clipboard

Bin Xu, Yu Bai, Huashan Sun, Yiguan Lin, Siming Liu, Xinyue Liang, Yaolin Li, Zhuangzhi Dong, Jingren Zhang, Yufan Deng, Xinyu Zou, Yang Gao, Heyan Huang

RAMQA: A Unified Framework for Retrieval-Augmented Multi-Modal Question Answering (2025.findings-naacl)

Challenge:	Existing benchmarks that focus on knowledge-intensive tasks do not reflect diverse educational scenarios.
Approach:	They propose a benchmark that incorporates 9 major scenarios and 4,000 educational contexts.
Outcome:	The proposed model performs comparable to state-of-the-art large models on the test set.

Copied to clipboard

Yang Bai, Christan Grant, Daisy Zhe Wang

Information Retrieval

Challenge:	Existing ranking methods rely on small encoder-based ranking models, which are incompatible with modern decoder--based generative large language models (LLMs) Existing methods based on small LLaVA rankers are incompatible with advanced LLMs.
Approach:	They propose a framework that combines learning-to-rank methods with generative permutation-enhanced ranking techniques.
Outcome:	The proposed framework improves on two benchmarks, WebQA and MultiModalQA, showing significant improvements over baselines.

Nature-Inspired Population-Based Evolution of Large Language Models (2026.acl-long)

Copied to clipboard

Yiqun Zhang, Peng Ye, Xiaocui Yang, Shi Feng, Shufei Zhang, Lei Bai, Wanli Ouyang, Shuyue Hu

Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization (2025.findings-acl)

Challenge:	a new framework for population-based evolution of large language models is emerging . a population-driven evolution of LLMs is a key component of evolution, authors say .
Approach:	They propose a framework that allows for population-based evolution of large language models . they start with a population of parent LLMs and allow this population to evolve .
Outcome:	The proposed framework outperforms existing methods on 12 datasets.

Copied to clipboard

Yilun Qiu, Xiaoyan Zhao, Yang Zhang, Yimeng Bai, Wenjie Wang, Hong Cheng, Fuli Feng, Tat-Seng Chua

Challenge:	Extensive experiments on real-world datasets demonstrate that DPL significantly enhances LLM personalization.
Approach:	They propose a novel approach that emphasizes extracting inter-user differences to enhance LLM personalization.
Outcome:	The proposed approach extracts inter-user differences to enhance LLM personalization.

Memo-SQL: Structured Decomposition and Experience-Driven Self-Correction for Training-Free NL2SQL (2026.findings-acl)

Copied to clipboard

Yang Zerui, Weichuan Wang, Yanwei Xu, Linqi Song, Yudai Matsuda, Wei Han, Bo Bai

Programming Languages in NLP

Challenge:	Existing NL2SQL systems rely on in-context learning with only correct examples . current test-time scaling methods often decompose questions arbitrarily, resulting in poor performance .
Approach:	They propose a structured decomposition and experience-aware self-correction framework for NL2SQL . they build a dynamic memory of successful queries and historical error–fix pairs .
Outcome:	The proposed framework achieves 68.5% execution accuracy on BIRD, setting new state of the art among open, zero-fine-tuning methods.

AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song

Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)

Challenge:	Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach:	They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome:	The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.

Copied to clipboard

Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun

Pre3: Enabling Deterministic Pushdown Automata for Faster Structured LLM Generation (2025.acl-long)

Challenge:	Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks.
Approach:	They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies.
Outcome:	The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%.

Copied to clipboard

Junyi Chen, Shihao Bai, Zaijun Wang, Siyu Wu, Chuheng Du, Hailong Yang, Ruihao Gong, Shengzhong Liu, Fan Wu, Guihai Chen

Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Challenge:	Existing methods for structured generation of outputs are inefficient under large inference batches.
Approach:	They propose a new LLM-based method that parses LR(1) grammars into a pushdown automaton and exploits deterministic pushdown automation to optimize the constrained LLM decoding efficiency.
Outcome:	The proposed method improves time per output token (TPOT) by 40% and throughput by 36% .

Copied to clipboard

Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni

Do Not Step Into the Same River Twice: Learning to Reason from Trial and Error (2026.acl-long)

Challenge:	MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach:	They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome:	The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.

Copied to clipboard

Chenming Tang, Hsiu-Yuan Huang, Weijie Liu, Clive Bai, Saiyong Yang, Yunfang Wu

RAG4ITOps: A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance (2024.emnlp-industry)

Challenge:	Existing approaches to RLVR train LMs based on their own on-policy responses and are constrained by the initial capability of LM.
Approach:	They propose an approach that hints LMs with their self-made mistakes without external guidance.
Outcome:	The proposed approach outperforms the normal group relative policy optimization and requires no external guidance.

Copied to clipboard

Tianyang Zhang, Zhuoxuan Jiang, Shengguang Bai, Tianrui Zhang, Lin Lin, Yang Liu, Jiawei Ren

Natural Language Interfaces

Challenge:	Large Language Models (LLMs) have improved the open-domain QA’s performance, but how to efficiently handle enterprise-exclusive corpora and build domain-specific QA systems are still not studied for industrial applications.
Approach:	They propose a general and comprehensive framework based on Retrieval Augmented Generation (RAG) and facilitate the whole business process of establishing QA systems for IT operations and maintenance.
Outcome:	The proposed framework achieves superior results on two kinds of QA tasks.

M3: A Multi-Task Mixed-Objective Learning Framework for Open-Domain Multi-Hop Dense Sentence Retrieval (2024.lrec-main)

Copied to clipboard

Yang Bai, Anthony Colas, Christan Grant, Zhe Wang

From Scaffolding to Assimilation: Progressive Structural Internalization for Format-Constrained Creative Text Generation (2026.findings-acl)

Challenge:	Recent research shows that contrastive learning can lead to suboptimal retrieval performance.
Approach:	They propose an advanced recursive Multi-hop dense sentence retrieval system built upon a novel Multi-task Mixed-objective approach for dense text representation learning.
Outcome:	The proposed approach yields state-of-the-art performance on a large-scale open-domain fact verification benchmark dataset, FEVER.

Copied to clipboard

Wenhao Li, Yuwei Yang, Xiaoqing Wu, Yufeng Han, Cunliang Kong, Yuzhuo Bai, Xin Cong, Maosong Sun

Word class flexibility: A deep contextualized approach (2020.emnlp-main)

Challenge:	Existing paradigms rely on unreliable prompting or rigid constrained decoding strategies to achieve aesthetic unity.
Approach:	They propose a framework to embed external constraints into the model’s intrinsic intuition and use it to generate open-ended creative texts.
Outcome:	The proposed framework surpasses baselines in both strict constraint adherence and literary aesthetics.

Copied to clipboard

Bai Li, Guillaume Thomas, Yang Xu, Frank Rudzicz

Multilinguality

Challenge:	Existing studies on word class flexibility have been fraught with difficulties in quantifying it accurately and at scale.
Approach:	They propose a method to quantify word class flexibility in 37 languages using contextualized word embeddings.
Outcome:	The proposed method builds on recent work in contextualized word embeddings to quantify semantic shift between word classes and uncovers shared tendencies in class flexibility across languages.

DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)

Copied to clipboard

Andong Chen, Lianzhang Lou, Kehai Chen, Xuefeng Bai, Yang Xiang, Muyun Yang, Tiejun Zhao, Min Zhang

DEFT: Distribution-guided Efficient Fine-Tuning for Human Alignment (2024.findings-emnlp)

Challenge:	Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs).
Approach:	They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance.
Outcome:	The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks.

Copied to clipboard

Liang Zhu, Feiteng Fang, Yuelin Bai, Longze Chen, Zhexiang Zhang, Minghuan Tan, Min Yang

FrontCoder: Scaling Visual Fidelity in Front-End Code Generation (2026.findings-acl)

Challenge:	Experimental results show that the methods enhanced by DEFT outperform the original methods in both alignment capability and generalization ability, with significantly reduced training time.
Approach:	They propose a distribution-based alignment framework that integrates data filtering and distributional guidance to improve alignment efficiency and generalization ability.
Outcome:	The proposed framework outperforms existing methods in alignment capability and generalization ability with significantly reduced training time.

Copied to clipboard

Jun Feng, Jian Yang, Wei Zhang, Jing Wang, Keyi Chen, Xiaokun Yang, Weicheng Gu, Yihang Lou, Yan Bai, Xianglong Liu

Explain the Synth: Interpretable Evaluation of LLM Data Synthesis (2026.acl-long)

Challenge:	Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers.
Approach:	They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning .
Outcome:	The proposed model achieves competitive performance with frontier models while maintaining generation efficiency.

Copied to clipboard

Yue Yang, Fan Yang, Yu Bai, Hao Wang

Explainability & Interpretability in NLP

Challenge:	Large language models (LLMs) are increasingly used to generate tabular data.
Approach:	They propose a framework that uses a rule-based model as a shared explanatory language to examine the explanation of real versus synthetic data.
Outcome:	The proposed framework compares the explanatory structure induced by real versus synthetic data.

Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration (2025.findings-acl)

Copied to clipboard

Yang Zhang, Shixin Yang, Chenjia Bai, Fei Wu, Xiu Li, Zhen Wang, Xuelong Li

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)

Challenge:	Existing methods for grounding large language models suffer from inefficient querying . Existing approaches that rely on physical verification or self-reflection suffer from excessive querying.
Approach:	They propose a framework that introduces Reinforced Advantage feedback for efficient self-refinement of plans.
Outcome:	The proposed framework surpasses baselines in success rate and significantly decreases interaction steps of agents and query rounds of LLMs.

Copied to clipboard

Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li

Multilinguality

Challenge:	Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin.
Approach:	They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation.
Outcome:	The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin.

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin

EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)

Challenge:	Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach:	They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome:	The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.

Copied to clipboard

Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song

A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Challenge:	Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges .
Approach:	They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions.
Outcome:	The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset .

Copied to clipboard

Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo

SafeConf: A Confidence-Calibrated Safety Self-Evaluation Method for Large Language Models (2025.findings-emnlp)

Challenge:	Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach:	They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome:	The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.

Copied to clipboard

Bo Zhang, Cong Gao, Linkang Yang, Bingxu Han, Minghao Hu, Zhunchen Luo, Guotong Geng, Xiaoying Bai, Jun Zhang, Wen Yao, Zhong Wang

Commonality and Individuality! Integrating Humor Commonality with Speaker Individuality for Humor Recognition (2025.naacl-long)

Challenge:	Large language models (LLMs) have many advantages but they also pose significant safety risks.
Approach:	They propose a method to enhance the safety self-evaluation capability of LLMs . they perform semantic mutations on the original safety evaluation questions .
Outcome:	The proposed method improves safety self-evaluation accuracy by 5.86% and 7.79% over baseline methods on Chinese and English datasets.

Copied to clipboard

Haohao Zhu, Xiaokun Zhang, Zeyuan Zeng, Junyu Lu, Zewen Bai, Liang Yang, Hongfei Lin

Commonsense Reasoning

Challenge:	Current methods for humor recognition focus on one aspect of humor commonalities, ignoring the multifaceted nature of humor.
Approach:	They propose a commonality and individuality incorporated network for humor recognition that integrates multifaceted humor commonalities with speaker individuality.
Outcome:	The proposed model integrates multifaceted humor commonalities with speaker individuality to deepen the understanding of humor expressions.

Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)

Copied to clipboard

Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng

Focus-dLLM: Accelerating Long-Context Diffusion LLM Inference via Confidence-Guided Context Focusing (2026.acl-long)

Challenge:	Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge.
Approach:	They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy.
Outcome:	The proposed model protects private data while enhancing the model's knowledge.

Copied to clipboard

Lingkun Long, Yushi Huang, Shihao Bai, Ruihao Gong, Jun Zhang, Ao Zhou, Jianlei Yang

Towards Real-world Scenario: Imbalanced New Intent Discovery (2024.acl-long)

Challenge:	Existing methods for estimating attention importance for tokens are ineffective . dLLMs require bidirectional attention, which limits inference efficiency .
Approach:	They propose a training-free attention sparsification framework for efficient long-context inference . they propose 'sink-aware pruning strategy' to accurately estimate and remove redundant computation .
Outcome:	The proposed approach offers 29 lossless speedup under 32K context length.

Copied to clipboard

Shun Zhang, Yan Chaoran, Jian Yang, Jiaheng Liu, Ying Mo, Jiaqi Bai, Tongliang Li, Zhoujun Li

Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models (2024.findings-emnlp)

Challenge:	Existing studies focus on detecting known and previously undefined categories of user intent . skewed and long-tailed distributions often encountered in open-world scenarios .
Approach:	They propose to use imbalanced new intent discovery task to identify familiar and novel intent categories within long-tailed distributions.
Outcome:	The proposed model outperforms the existing benchmark on three datasets to simulate the real-world long-tail distributions.

Copied to clipboard

Jiaming Li, Lei Zhang, Yunshui Li, Ziqiang Liu, Yuelin Bai, Run Luo, Longze Chen, Min Yang

ProMedTS: A Self-Supervised, Prompt-Guided Multimodal Approach for Integrating Medical Text and Time Series (2025.findings-acl)

Challenge:	Large language models struggle to meet user’s needs when required to generate responses of a specific length due to their inherent difficulty in accurately perceiving numerical constraints.
Approach:	They propose a Target Length Generation Task and propose RULER, a model-agnostic approach that controls generated length for large language models.
Outcome:	The proposed model-agnostic approach improves instruction-following ability of large language models under length-constrained instructions and can generate appropriate MLT when length constraints are not explicitly provided.

Copied to clipboard

Shuai Niu, Jing Ma, Hongzhan Lin, Liang Bai, Zhihua Wang, V. W., Richard Yi Da Xu, Guo Li, Xian Yang

PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization (2022.coling-1)

Challenge:	Large language models excel at processing unstructured data, but integrating time series data with text remains a challenge.
Approach:	They propose a self-supervised multimodal framework that uses prompt-guided learning to unify heterogeneous data types.
Outcome:	The proposed framework outperforms state-of-the-art approaches on disease diagnosis tasks using real-world datasets.

Copied to clipboard

Xiaochen Liu, Yang Gao, Yu Bai, Jiawei Li, Yinan Hu, Heyan Huang, Boxing Chen

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs (2025.coling-main)

Challenge:	Experimental results show that our method outperforms full-model tuning in few-shot abstractive summarization tasks.
Approach:	They propose a soft prompts architecture with prompt pre-training and prompt fine-tuning paradigm to support few-shot abstractive summarization.
Outcome:	The proposed model outperforms Prompt Tuning and Profix-Tuning on CNN/DailyMail and XSum datasets and outperfies Profix Tuning by a large margin.

Copied to clipboard

Taiqiang Wu, Zhe Zhao, Jiahao Wang, Xingyu Bai, Lei Wang, Ngai Wong, Yujiu Yang

MidPO: Dual Preference Optimization for Safety and Helpfulness in Large Language Models via a Mixture of Experts Framework (2025.findings-emnlp)

Challenge:	Existing methods to train low-latency multilayer perceptrons (MLPs) on graph tasks are based on graph nodes and lack graph structural information.
Approach:	They propose to distill graph structural information from Graph Neural Networks (GNNs) to low-latency multilayer perceptrons (MLPs) on graph tasks.
Outcome:	The proposed method does not require graph edges (edge-free setting) yet learns structure-aware MLPs.

Copied to clipboard

Yupeng Qi, Ziyu Lyu, Min Yang, Yanlin Wang, Lu Bai, Lixin Cui

AdaptFlow: Adaptive Workflow Optimization via Meta-Learning (2025.findings-emnlp)

Challenge:	Recent studies address safety-constrained online and offline preferences optimizations, but offline methods perform poorly in adaptively balancing safety and helpfulness.
Approach:	They propose a mixture of experts framework for safety-helpfulness dual Preference Optimization . they combine a single-preference enhanced direct preference optimization approach with a dynamic routing mechanism .
Outcome:	The proposed framework outperforms state-of-the-art methods in safety and helpfulness.

Copied to clipboard

Runchuan Zhu, Bowen Jiang, Lingrui Mei, Fangkai Yang, Lu Wang, Haoxiang Gao, Fengshuo Bai, Pu Zhao, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual Property (2024.lrec-main)

Challenge:	Existing approaches to large language models rely on static templates or manual workflows.
Approach:	AdaptFlow is a language-based meta-learning framework inspired by model-agnostic meta- learning.
Outcome:	AdaptFlow outperforms manual and automated workflows on question answering, code generation and mathematical reasoning benchmarks.

Copied to clipboard

Shiwen Ni, Minghuan Tan, Yuelin Bai, Fuqiang Niu, Min Yang, Bowen Zhang, Ruifeng Xu, Xiaojun Chen, Chengming Li, Xiping Hu

Natural Language Interfaces

Challenge:	Large language models (LLMs) have demonstrated impressive performance in various natural language processing tasks.
Approach:	They propose a benchmark for the evaluation of large language models in the IP domain . they also propose supervised multilingual large language model called MoZi .
Outcome:	The proposed model outperforms four well-known LLMs on the MoZIP benchmark . the most powerful ChatGPT does not reach the passing level .

From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)

Copied to clipboard

Jiajun Zhang, Zeyu Cui, Jiaxi Yang, Lei Zhang, Yuheng Jing, Zeyao Ma, Tianyi Bai, Zilei Wang, Qiang Liu, Liang Wang, Binyuan Hui, Junyang Lin

Programming Languages in NLP

Challenge:	Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency.
Approach:	They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process.
Outcome:	The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing.

StyleDGPT: Stylized Response Generation with Pre-trained Language Models (2020.findings-emnlp)

Copied to clipboard

Ze Yang, Wei Wu, Can Xu, Xinnian Liang, Jiaqi Bai, Liran Wang, Wei Wang, Zhoujun Li

MTRouter: Cost-Aware Multi-Turn LLM Routing with History–Model Joint Embeddings (2026.acl-long)

Challenge:	Existing methods for generating responses following a desired style are lacking of parallel data for training.
Approach:	They propose a KL loss and a style classifier to fine-tune response generation . they show that their model can significantly outperform state-of-the-art methods .
Outcome:	The proposed model outperforms state-of-the-art models in style consistency and contextual coherence with two public datasets.

Copied to clipboard

Yiqun Zhang, Hao Li, Zihan Wang, Shi Feng, Xiaocui Yang, Daling Wang, Bo Zhang, Lei Bai, Shuyue Hu

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Challenge:	Multi-turn, long-horizon tasks require dozens of sequential model calls per episode.
Approach:	They propose a cost-aware multi-turn LLM routing tool which encodes interaction history and candidate models into joint history–model embeddings and learns an outcome estimator from logged trajectories to predict turn-level model utility.
Outcome:	The proposed model reduces cost and performance by 58.7% on ScienceWorld and on Humanity’s Last Exam (HLE) and even reduces costs for held-out tasks.

Copied to clipboard

Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang

Bridge the Gap: High-level Semantic Planning for Image Captioning (2020.coling-main)

Challenge:	Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach:	They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome:	The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.

Copied to clipboard

Chenxi Yuan, Yang Bai, Chun Yuan

Dynamic Evil Score-Guided Decoding: An Efficient Decoding Framework For Red-Team Model (2025.findings-acl)

Challenge:	Recent image captioning models have improved the multi-modal interaction, such as attention mechanisms.
Approach:	They propose a high-level semantic planning mechanism that integrates a semantic reconstruction and an explicit order planning mechanism to bridge the gap between visual and language domains.
Outcome:	The proposed model outperforms previous methods and achieves the state-of-the-art performance on MS COCO.

Copied to clipboard

Cong Gao, Bo Zhang, Linkang Yang, Minghao Hu, Zhunchen Luo, Xiaoying Bai, Guotong Geng, Jun Zhang, Yunhua Xue

Online Iterative Self-Alignment for Radiology Report Generation (2025.acl-long)

Challenge:	Existing red-teaming methods require expensive fine-tuning, especially for large LLMs.
Approach:	They propose a red-teaming method that uses an ‘evil score’ to evaluate the potential of tokens to contribute to harmful outputs during decoding.
Outcome:	The proposed method achieves an ASR of 92.83% on the Llama-3.2-3B-Instruct model, compared to 83.48% with adversarial fine-tuning while using less computational resources.

Copied to clipboard

Ting Xiao, Lei Shi, Yang Zhang, HaoFeng Yang, Zhe Wang, Chenjia Bai

Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and Elegance (2025.emnlp-main)

Challenge:	Existing methods for RRG rely on supervised fine-tuning based on data pairs of radiological images and corresponding radiologist-annotated reports.
Approach:	They propose a method that performs supervised fine-tuning on data pairs of radiological images and corresponding radiologist-annotated reports.
Outcome:	The proposed method surpasses existing methods and achieves state-of-the-art performance across multiple evaluation metrics.

Copied to clipboard

Andong Chen, Lianzhang Lou, Kehai Chen, Xuefeng Bai, Yang Xiang, Muyun Yang, Tiejun Zhao, Min Zhang

Machine Translation

Challenge:	Existing large language models fall short of translating culturally significant content . existing models fall behind in achieving such translations, authors say .
Approach:	They propose a suitable benchmark for translating classical Chinese poetry into English . they propose RAT, a retrieval-augmented machine translation method that enhances the translation process .
Outcome:	The proposed method improves translation quality in terms of adequate, fluent, and elegant translations.

MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL (2025.coling-main)

Copied to clipboard

Bing Wang, Changyu Ren, Jian Yang, Xinnian Liang, Jiaqi Bai, LinZheng Chai, Zhao Yan, Qian-Wen Zhang, Di Yin, Xing Sun, Zhoujun Li

Programming Languages in NLP

Challenge:	Recent LLM-based Text-to-SQL methods suffer from performance degradation on “huge” databases and complex user questions that require multi-step reasoning.
Approach:	They propose a framework that integrates a decomposer agent and auxiliary agents to generate SQL queries from natural language text.
Outcome:	The proposed framework achieves comparable execution accuracy on SQL-Llama tasks compared to the baseline model.

Learning Structural Information for Syntax-Controlled Paraphrase Generation (2022.findings-naacl)

Copied to clipboard

Erguang Yang, Chenglin Bai, Deyi Xiong, Yujie Zhang, Yao Meng, Jinan Xu, Yufeng Chen