Papers by Xin Wei

Scaling Laws for Code: Every Programming Language Matters (2026.findings-acl)

Challenge:	Existing approaches to improve long-chain mathematical reasoning focus on the first erroneous step, but ignore all other steps and rely heavily on external signals.
Approach:	They propose a DPO framework that leverages step-wise rewards from the entire reasoning chain instead of optimizing only the first erroneous step.
Outcome:	The proposed framework improves on in-domain and out-of-domain mathematical reasoning benchmarks.

Copied to clipboard

Jian Yang, Shuyue Guo, Linzheng Chai, Wei Zhang, Aishan Liu, Chuan Hao, Zhoujun Li, Xin Zhao, Xianglong Liu, Weifeng Lv, Bryan Dai

RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction (2023.acl-long)

Challenge:	Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development.
Approach:	They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance .
Outcome:	The proposed scaling law is based on 1000+ experiments across multiple languages and models.

Copied to clipboard

Jun Zhao, WenYu Zhan, Xin Zhao, Qi Zhang, Tao Gui, Zhongyu Wei, Junzhe Wang, Minlong Peng, Mingming Sun

ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge (2025.emnlp-main)

Challenge:	Existing methods for zero-shot relation extraction lack explicit modeling of matching pattern . et al. (2018) show that our method achieves higher matching accuracy and faster inference speed .
Approach:	They propose a fine-grained semantic matching method tailored for zero-shot relation extraction . they decompose sentence-level similarity score into entity matching score and context matching score .
Outcome:	The proposed method achieves higher matching accuracy and faster inference speed than state-of-the-art methods.

Copied to clipboard

Chaoyue He, Xin Zhou, Yi Wu, Xinjia Yu, Yan Zhang, Lei Zhang, Di Wang, Shengfei Lyu, Hong Xu, Wang Xiaoqiao, Wei Liu, Chunyan Miao

The Elephant in the Room: Exploring the Role of Neutral Words in Language Model Group-Agnostic Debiasing (2025.findings-acl)

Challenge:	ESGenius is a comprehensive benchmark for evaluating Large Language Models on ESG and sustainability knowledge.
Approach:	They introduce ESGenius, a benchmark for evaluating and enhancing ESG proficiency . they use a rigorous two-stage evaluation protocol and a repository of foundational frameworks .
Outcome:	ESGenius is a benchmark for evaluating and enhancing the proficiency of Large Language Models (LLMs) in ESG and sustainability-focused question answering.

Copied to clipboard

Xinwei Guo, Jiashi Gao, Junlei Zhou, Jiaxin Zhang, Guanhua Chen, Xiangyu Zhao, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei

MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)

Challenge:	Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes.
Approach:	They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing.
Outcome:	The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function.

Copied to clipboard

Xiao Sun, null Ymyang, Xinyi Jiang, Yu Tian, Junnan Zhu, Jiang Zhong, Qin Lei, Jingwang Huang, Haoyang Zeng, Xinyu Zhou, Xin Xiao, Kaiwen Wei

GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)

Challenge:	Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility .
Approach:	They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning.
Outcome:	The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis.

Copied to clipboard

Yao Zhang, Hongru Liang, Adam Jatowt, Wenqiang Lei, Xin Wei, Ning Jiang, Zhenglu Yang

Structured Data in NLP

Challenge:	Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications.
Approach:	They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios.
Outcome:	The proposed model improves on baselines in short and long distance reasoning scenarios.

ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching (2026.findings-acl)

Copied to clipboard

Han Zhu, Wei Kang, Liyong Guo, Zengwei Yao, Fangjun Kuang, Weiji Zhuang, Zhaoqing Li, Zhifeng Han, Dong Zhang, Xin Zhang, Xingchen Song, Lingxuan Ye, Long Lin, Daniel Povey

Dialogue Systems & Conversational Agents

Challenge:	Existing autoregressive models for dialogue generation suffer from high latency and stability issues.
Approach:	They propose a non-autoregressive (NAR) zero-shot spoken dialogue generation model based on flow-matching.
Outcome:	The proposed model outperforms existing models in speech generation due to poor speech intelligibility and turn-taking precision.

G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks (2022.emnlp-main)

Copied to clipboard

Zhongwei Wan, Yichun Yin, Wei Zhang, Jiaxin Shi, Lifeng Shang, Guangyong Chen, Xin Jiang, Qun Liu

MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction (2022.findings-acl)

Challenge:	Existing domain-adaptive pre-training (DAPT) models tend to forget the general knowledge acquired by general PLMs, leading to catastrophic forgetting and sub-optimal performance.
Approach:	They propose a framework which augments the domain-specific PLM by a memory built from the frozen general PLM without losing the general knowledge.
Outcome:	The proposed framework augments the domain-specific PLM by a memory built from the frozen general PLM without losing the general knowledge.

Copied to clipboard

Linhan Zhang, Qian Chen, Wen Wang, Chong Deng, ShiLiang Zhang, Bing Li, Wei Wang, Xin Cao

Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation (2022.emnlp-main)

Challenge:	Keyphrase extraction (KPE) extracts phrases in a document that provide a concise summary of the core content.
Approach:	They propose an unsupervised keyphrase extraction method that ranks candidates by similarity between embeddings of source document and masked document.
Outcome:	The proposed method outperforms state-of-the-art methods on six benchmarks . it achieves average 3.53 improvement over the existing method .

Copied to clipboard

Sunzhu Li, Peng Zhang, Guobing Gan, Xiuqing Lv, Benyou Wang, Junqiu Wei, Xin Jiang

Multilinguality

Challenge:	Existing methods to compress Transformer are limited to sub-components, e.g., selfattention networks or embedding layer.
Approach:	They propose a Hybrid Tensor-Train decomposition which retains full rank and meanwhile reduces operations and parameters.
Outcome:	The proposed model outperforms light-weight SOTA methods on three translation tasks and achieves 7.1 points absolute improvement in BLEU and 1.27 X speedup on IWSLT’14 De-En task.

Temporal Scaling Law for Large Language Models (2025.emnlp-main)

Copied to clipboard

Yizhe Xiong, Xiansheng Chen, Xin Ye, Hui Chen, Zijia Lin, Haoran Lian, Zhenpeng Su, Wei Huang, Jianwei Niu, Jungong Han, Guiguang Ding

On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)

Challenge:	Existing studies have found that the test loss of LLMs scales as power-laws with model size, computational budget, and dataset size.
Approach:	They propose a concept of Temporal Scaling Law to study test loss of LLMs . they break down test loss into fine-grained token positions and develop a dynamic hyperbolic-law .
Outcome:	The proposed model predicts the test loss of LLMs as the training steps scale up.

Copied to clipboard

Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, Yangqiu Song

ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer (2022.acl-long)

Challenge:	Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning.
Approach:	They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized.
Outcome:	The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized .

Copied to clipboard

Ningning Wang, Guobing Gan, Peng Zhang, Shuai Zhang, Junqiu Wei, Qun Liu, Xin Jiang

LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)

Challenge:	Existing sparse attention methods use fixed patterns to select words without considering similarities between words.
Approach:	They propose a neural clustering method which integrates into the Self-Attention Mechanism in Transformer and integrates it into the target task.
Outcome:	The proposed method outperforms two typical sparse attention methods on translation, text classification, and text matching tasks while having a comparable or even better time and memory efficiency.

Copied to clipboard

Yuxuan Li, Xinwei Guo, Jiashi Gao, Guanhua Chen, Xiangyu Zhao, Jiaxin Zhang, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei

Information Retrieval

Challenge:	Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge.
Approach:	They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework .
Outcome:	The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text .

Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension (2022.acl-long)

Copied to clipboard

Huibin Zhang, Zhengkun Zhang, Yao Zhang, Jun Wang, Yufan Li, Ning Jiang, Xin Wei, Zhenglu Yang

When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning (2025.findings-emnlp)

Challenge:	Procedural Multimodal Documents organize textual instructions and corresponding images step by step.
Approach:	They propose a novel temporal-modal entity Graph for comprehending PMDs . they propose encoding and reasoning modules to capture textual and visual entities .
Outcome:	The proposed model can capture textual and visual entities and trace their temporal-modal evolution.

Copied to clipboard

Mengyi Deng, Xin Li, Tingyu Zhu, Zhicheng Yang, Zhijiang Guo, Wei Wang

Latent Suicide Risk Detection on Microblog via Suicide-Oriented Word Embeddings and Layered Attention (D19-1)

Challenge:	Existing methods for o1-level performance focus on unidirectional supervised fine-tuning (SFT), overlooking the intricate interplay between diverse reasoning patterns.
Approach:	They construct a reverse reasoning dataset and examine how it is supervised . they find that naively mixing forward and reverse data during SFT weakens the directional distinction .
Outcome:	The proposed model improves accuracy by 1.6%–6.8% over a standard model.

Copied to clipboard

Lei Cao, Huijun Zhang, Ling Feng, Zihan Wei, Xin Wang, Ningyun Li, Xiaohao He

Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting (2023.findings-emnlp)

Challenge:	Existing approaches to detect suicidal ideation on social media are limited to a small group of people.
Approach:	They propose to use tree holes to embed words into microblogs to strengthen the sensibility of suicide-related lexicons and to use a two-layered attention mechanism to grasp intermittently changing points from individual's open blog streams.
Outcome:	The proposed approach can achieve over 91% accuracy with the use of suicide-oriented word embeddings and attention on a large-scale well-labelled suicide data set.

Copied to clipboard

Haoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao, Ting Song, Yan Xia, Furu Wei

Low-Resource NLP

Challenge:	Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages.
Approach:	They propose a generic template prompt that stimulates cross-lingual and logical reasoning skills to enhance task performance across languages.
Outcome:	The proposed method improves multilingual capability across languages and covers high-resource and low-resourced languages.

KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion (2021.findings-acl)

Copied to clipboard

Jie Zhou, Shengding Hu, Xin Lv, Cheng Yang, Zhiyuan Liu, Wei Xu, Jie Jiang, Juanzi Li, Maosong Sun

Structured Pruning for Efficient Generative Pre-trained Language Models (2023.findings-acl)

Challenge:	Existing studies focus on partial aspects of knowledge abstraction, concretization, and completion (KACC).
Approach:	They propose a unified knowledge graph benchmark to improve existing benchmarks . they collect new datasets that contain larger concept graphs and cross-view links .
Outcome:	The proposed benchmark improves existing benchmarks in terms of dataset scale, task coverage, and difficulty.

Copied to clipboard

Chaofan Tao, Lu Hou, Haoli Bai, Jiansheng Wei, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong

WirelessMathBench: A Mathematical Modeling Benchmark for LLMs in Wireless Communications (2025.findings-acl)

Challenge:	Large-scale generative Pre-trained Language Models (PLMs) are limited in their deployment in real-world applications.
Approach:	They propose to prune the feed-forward networks of generative pre-trained language models to smaller widths without designing extra operators.
Outcome:	The proposed method achieves 1.51x/6.96x inference speedup on GPU/CPU with 67% size reduction.

Copied to clipboard

Xin Li, Mengbing Liu, Li Wei, Jiancheng An, Merouane Abdelkader Debbah, Chau Yuen

Masks Can be Learned as an Alternative to Experts (2025.acl-long)

Challenge:	Large Language Models (LLMs) have demonstrated impressive results across a broad array of tasks, yet their capacity for complex, domain-specific mathematical reasoning remains underexplored.
Approach:	They propose a benchmark to evaluate Large Language Models on mathematical modeling challenges to wireless communications engineering.
Outcome:	The proposed benchmark evaluates LLMs on mathematical modeling challenges to wireless communications engineering.

Copied to clipboard

Peiyu Liu, Tianwen Wei, Bo Zhu, Xin Zhao, Shuicheng Yan

Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs (2024.emnlp-main)

Challenge:	a recent study shows that sparse activation techniques can reduce inference performance without sacrificing performance.
Approach:	They propose to sparsify a pre-trained dense large language model into a mixture-of-experts architecture for faster inference.
Outcome:	The proposed approach is more efficient than one-shot sparsification techniques . it achieves 97% performance retention on downstream tasks with only 50% of parameters activated .

Copied to clipboard

Xin Zhou, Ping Nie, Yiwen Guo, Haojie Wei, Zhanqiu Zhang, Pasquale Minervini, Ruotian Ma, Tao Gui, Qi Zhang, Xuanjing Huang

Information Retrieval

Challenge:	Existing research seeks to enhance RAG performance by retrieving higher-quality documents or designing RAG-specific LLMs, but internal mechanisms that contribute to RAG’s effectiveness remain underexplored.
Approach:	They propose to examine the internal mechanisms within the popular Mixture-of-Expert (MoE)-based LLMs and examine their ability to improve RAG by examining expert activations.
Outcome:	The proposed method significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks.

Compression of Generative Pre-trained Language Models via Quantization (2022.acl-long)

Copied to clipboard

Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Challenge:	Existing methods to compress generative pre-trained language models fail on generative tasks due to homogeneous word embeddings and limited memory.
Approach:	They propose a token-level contrastive distillation method to learn distinguishable word embeddings and a module-wise dynamic scaling method to make quantizers adaptive to different modules.
Outcome:	The proposed method outperforms the state-of-the-art compression methods on generative PLMs by a clear margin.

Copied to clipboard

Zhong Zhang, Yaxi Lu, Yikun Fu, Yupeng Huo, Shenzhi Yang, Yesai Wu, Han Si, Xin Cong, Haotian Chen, Yankai Lin, Xie Xie, Wei Zhou, Wang Xu, Zhou Su, Zhongwu Zhai, Xiaoming Liu, null Meiyudong, Jianming Xu, Hongyan Tian, Chongyi Wang, Chi Chen, Yuan Yao, Zhiyuan Liu, Maosong Sun

AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Challenge:	Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach:	They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome:	The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.

Copied to clipboard

Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, Chenyang Liao, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang

SCOPE: Compress Mathematical Reasoning Steps for Efficient Automated Process Annotation (2025.findings-acl)

Challenge:	Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach:	They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome:	The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.

Copied to clipboard

Huimin Xu, Xin Mao, Feng-Lin Li, Xiaobao Wu, Wang Chen, Wei Zhang, Anh Tuan Luu

DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization (2026.findings-acl)

Challenge:	Existing process annotation approaches are computationally expensive.
Approach:	They propose a compression-based approach that transforms reasoning steps into code and normalizes them through Abstract Syntax Tree.
Outcome:	The proposed method outperforms existing methods on Best-of-N strategy and ProcessBench.

Copied to clipboard

Mengyi Deng, Zhiwei Li, Xin Li, Tingyu Zhu, Yulan Yuan, Zhijiang Guo, Wei Wang

LongHeads: Multi-Head Attention is Secretly a Long Context Processor (2024.findings-emnlp)

Challenge:	Existing methods for directional consistency alignment of large language models are limited . a recent study suggests reverse supervision as a complement to forward reasoning .
Approach:	They propose a framework that aggregates supervision signals at the group level and explicitly models direction-aware alignment through multi-candidate comparisons.
Outcome:	The proposed framework achieves 3.2% accuracy improvement across five benchmarks and multiple datasets.

Copied to clipboard

Yi Lu, Xin Zhou, Wei He, Jun Zhao, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang

Green & Sustainable NLP

Challenge:	Large language models struggle to process lengthy inputs due to limited length generalization and attention’s quadratic computational demands.
Approach:	They propose a training-free framework that allows each head to attend to important context chunks instead of allowing each head a full sentence .
Outcome:	The proposed framework unlocks multi-head attention's untapped potential by allowing each head to attend to important context chunks instead of the full sentence.

Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks (2022.coling-1)

Copied to clipboard

Xin Zhou, Ruotian Ma, Yicheng Zou, Xuanting Chen, Tao Gui, Qi Zhang, Xuanjing Huang, Rui Xie, Wei Wu

Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding (2023.acl-long)

Challenge:	Large pre-trained language models (PLMs) have demonstrated superior performance in industrial applications.
Approach:	They propose a framework that re-uses existing parameter-efficient methods with a unified classifier.
Outcome:	The proposed framework improves the efficiency of existing parameter-efficient methods with a unified classifier.

Copied to clipboard

Haoli Bai, Zhiguang Liu, Xiaojun Meng, Li Wentao, Shuang Liu, Yifeng Luo, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu

Don’t Forget Your Reward Values: Language Model Alignment via Value-based Calibration (2024.emnlp-main)

Challenge:	Existing solutions for visual document understanding lack granularity of document textlines.
Approach:	They propose a supervised pre-training program to leverage structural knowledge nested in document textlines to achieve fine-grained alignment between visual regions and texts.
Outcome:	The proposed system performs better on various VDU tasks in English and Chinese.

Copied to clipboard

Xin Mao, Feng-Lin Li, Huimin Xu, Wei Zhang, Wang Chen, Anh Tuan Luu

BinaryBERT: Pushing the Limit of BERT Quantization (2021.acl-long)

Challenge:	Existing methods for generating large language models have been criticized for their complexity and instability.
Approach:	They propose a value-based calibration method to better align Large Language Models with human preferences.
Outcome:	The proposed method surpasses existing methods on AI assistant and summarization datasets, providing impressive generalizability, robustness, and diversity in different settings.

Copied to clipboard

Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jin Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King

Can LLMs Hear the Dogwhistle? (2026.findings-acl)

Challenge:	Recent pre-trained language models have achieved remarkable performance improvement in various tasks, but the improvement generally comes at the cost of increasing model size and computation.
Approach:	They propose a binary quantization technique which initializes binaryBERT by splitting from a ternary network.
Outcome:	The proposed model achieves state-of-the-art performance on the GLUE and SQUAD benchmarks while being 24x smaller.

Copied to clipboard

Yifan Liu, Yi Lin, Xinwei Guo, Ziwei Wang, Jiaxin Zhang, Guanhua Chen, Haiyan Wu, Xiangyu Zhao, Xin Yao, Xuetao Wei

NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding (2024.findings-emnlp)

Challenge:	Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles.
Approach:	They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices .
Outcome:	The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts.

Copied to clipboard

Chunkit Chan, Cheng Jiayang, Yauwai Yim, Zheye Deng, Wei Fan, Haoran Li, Xin Liu, Hongming Zhang, Weiqi Wang, Yangqiu Song

Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding (2021.acl-long)

Challenge:	Theory of mind evaluations currently focus on testing models using machine-generated data or game settings prone to shortcuts and spurious correlations.
Approach:	They propose a benchmark to stress-test machine ToM in real-world negotiation surrounding covered multi-dimensional mental states.
Outcome:	The proposed benchmark builds upon the Belief-Desire-Intention theory and conducts the necessary empirical experiments to evaluate large language models.

Copied to clipboard

Xin Sun, Tao Ge, Furu Wei, Houfeng Wang

P²Net: Parallel Pointer-based Network for Key Information Extraction with Complex Layouts (2025.findings-acl)

Challenge:	Existing approaches to improve online inference efficiency of the Transformer for instantaneous Grammatical Error Correction (GEC) are sequenceto-sequence (seq2sequ) and sequenceto sequence (saq2eq)
Approach:	They propose a novel approach to improve the online inference efficiency of the Transformer model for instantaneous Grammatical Error Correction (GEC) it aggressively decodes as many tokens as possible in parallel instead of always decoding only one token in each step to improve computational parallelism.
Outcome:	The proposed approach can achieve state-of-the-art results in English and Chinese benchmarks with 10x speedup over the Transformer-big model.

Copied to clipboard

Kaiwen Wei, Jie Yao, Jiang Zhong, Yangyang Kang, Jingyuan Zhang, Changlong Sun, Xin Zhang, Fengmao Lv, Li Jin

Information Extraction & Text Mining

Challenge:	Existing methods for key information extraction are based on a limited set of entity categories and fixed layouts.
Approach:	They propose a large-scale, human-annotated dataset for key information extraction . it is based on a human-annotated layout and 1,162 entity categories . they propose 'parallel pointer-based network' that leverages implicit relationships .
Outcome:	Experiments on widely-used datasets show that the proposed model outperforms state-of-the-art methods while maintaining fast inference speeds.

Sailor: Open Language Models for South-East Asia (2024.emnlp-demo)

Copied to clipboard

Longxu Dou, Qian Liu, Guangtao Zeng, Jia Guo, Jiahui Zhou, Xin Mao, Ziqi Jin, Wei Lu, Min Lin

Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph (2020.emnlp-main)

Challenge:	Large language models (LLMs) rely on English data for training, but are often not comparable across other languages.
Approach:	They propose to develop a family of open language models for SEA languages . they use BPE dropout, aggressive data cleaning and deduplication to improve model robustness .
Outcome:	The proposed models perform well across four benchmarks, including commonsense reasoning, question answering, reading comprehension and examination.

Copied to clipboard

Xin Lv, Xu Han, Lei Hou, Juanzi Li, Zhiyuan Liu, Wei Zhang, Yichi Zhang, Hao Kong, Suhui Wu

Structured Data in NLP

Challenge:	Existing reasoning methods for sparse KGs are incomplete and lack of evidential paths to target entities makes multi-hop reasoning difficult.
Approach:	They propose a multi-hop reasoning model over sparse KGs to solve this problem . they use latent prediction of embedding-based models to make the model perform more potential path search over sparses .
Outcome:	The proposed method outperforms state-of-the-art models on five datasets from Freebase, NELL and Wikidata.

DeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping (2026.findings-acl)

Copied to clipboard

Wei Fan, Wenlin Yao, Zheng Li, Feng Yao, Xin Liu, Liang Qiu, Qingyu Yin, Yangqiu Song, Bing Yin

Open Set Relation Extraction via Unknown-Aware Training (2023.acl-long)

Challenge:	Existing approaches to planning involve implicit planning or introduce explicit planners without systematically optimizing the planning stage.
Approach:	They propose an end-to-end RL framework that enhances the planning capabilities of deep research agents.
Outcome:	Experiments show that DeepPlanner improves planning quality and achieves state-of-the-art results under a lower training budget.

Copied to clipboard

Jun Zhao, Xin Zhao, WenYu Zhan, Qi Zhang, Tao Gui, Zhongyu Wei, Yun Wen Chen, Xiang Gao, Xuanjing Huang

Information Extraction & Text Mining

Challenge:	Existing supervised relation extraction methods can still misclassify unknown relations into known relations due to the lack of supervision signals.
Approach:	They propose a method that regularizes the model by dynamically synthesizing negative instances that can provide the missing supervision signals.
Outcome:	The proposed method achieves SOTA unknown relation detection without compromising the classification of known relations.

AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song

NL2Lean: Translating Natural Language into Lean 4 through Multi-Aspect Reinforcement Learning (2025.emnlp-main)

Challenge:	Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach:	They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome:	The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.

Copied to clipboard

Yue Fang, Shaohan Huang, Xin Yu, Haizhen Huang, Zihan Zhang, Weiwei Deng, Furu Wei, Feng Sun, Qi Zhang, Zhi Jin

Machine Translation

Challenge:	Existing formal proof assistants rely on instruction tuning and lack fine-grained structural and semantic alignment.
Approach:	They propose a reinforcement learning framework that enables LLMs to translate natural language into formal language such as Lean 4 . they use a model with basic translation ability to refine the model's reinforcement learning .
Outcome:	The proposed method outperforms baseline models on NL-to-Lean 4 tasks.

FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation (2025.acl-long)

Copied to clipboard

Wei Li, Xin Zhang, Zhongxin Guo, Shaoguang Mao, Wen Luo, Guangyue Peng, Yangyu Huang, Houfeng Wang, Scarlett Li

Programming Languages in NLP

Challenge:	Existing benchmarks focus on standalone programming problems, such as HumanEval, MBPP, and LiveCodeBench.
Approach:	They propose to use large language models to evaluate their ability to perform incremental development within code repositories by collecting pull requests from 83 GitHub repositorias and using rule-based and intent-based filtering to construct task instances focused on new feature development.
Outcome:	The proposed benchmarks show that large language models perform significantly worse in the FEA-Bench, highlighting considerable challenges in repository-level incremental code development.

MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark (2025.acl-long)

Copied to clipboard

Qihao Zhao, Yangyu Huang, Tengchao Lv, Lei Cui, Qinzheng Sun, Shaoguang Mao, Xin Zhang, Ying Xin, Qiufeng Yin, Scarlett Li, Furu Wei

Learning to Edit: Aligning LLMs with Knowledge Editing (2024.acl-long)

Challenge:	Multiple-choice question datasets like Massive Multitask Language Understanding (MMLU) have inevitably led to benchmark contamination, resulting in unreliable evaluation.
Approach:	They propose a contamination-free MCQ benchmark called MMLU-CF which reassesses LLMs’ understanding of world knowledge by averting both unintentional and malicious data contamination.
Outcome:	The proposed MMLU-CF reassesses LLMs’ understanding of world knowledge by averting both unintentional and malicious data contamination.

Copied to clipboard

Yuxin Jiang, Yufei Wang, Chuhan Wu, Wanjun Zhong, Xingshan Zeng, Jiahui Gao, Liangyou Li, Xin Jiang, Lifeng Shang, Ruiming Tang, Qun Liu, Wei Wang

Challenge:	Existing knowledge editing techniques rely on memorizing updated knowledge, impeding LLMs from effectively combining the new knowledge with their inherent knowledge when answering questions.
Approach:	They propose a Learning to Edit framework that equips LLMs with the ability to apply updated knowledge to input questions through a two-phase process .
Outcome:	The proposed framework outperforms existing methods in knowledge editing tasks and compares it with four benchmarks and two LLM architectures.

SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters (2025.naacl-long)

Copied to clipboard

Yan Yang, Zeguan Xiao, Xin Lu, Hongru Wang, Xuetao Wei, Hailiang Huang, Guanhua Chen, Yun Chen

Don’t Click That: Teaching Web Agents to Resist Deceptive Interfaces (2026.acl-long)

Challenge:	Existing studies have focused on the potential misuse of large language models (LLMs) however, the ability to align LLMs with human values is still vulnerable to malicious attacks.
Approach:	They propose a red-teaming strategy to enhance LLM safety by using a framework to design jailbreak prompts automatically.
Outcome:	The proposed framework achieves attack success rates of 88% and 60% in cold-start scenarios.

Copied to clipboard

Yilin Zhang, Yingkai Hua, Chunyu Wei, Xin Wang, Yueguo Chen

Challenge:	Existing approaches to deception detection and defenses are inadequate . Existing methods do not integrate with agent decision-making .
Approach:	They propose a framework that integrates hybrid-reward learning with asymmetric penalties and experience summarization to distill failure patterns into transferable guidance.
Outcome:	The proposed framework reduces deception susceptibility by 53.8% while maintaining task performance, establishing an effective foundation for robust web agent deployment.

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning (2025.findings-acl)

Copied to clipboard

Dacao Zhang, Kun Zhang, Shimao Chu, Le Wu, Xin Li, Si Wei

Fast Quiet-STaR: Thinking Without Thought Tokens (2025.findings-emnlp)

Challenge:	Recent advances in Large Language Models (LLMs) have revolutionized various domains, offering unprecedented performance across numerous tasks.
Approach:	They propose a new Mixture of Low-Rank Experts (MoRE) for multi-task PEFT to improve performance of LLMs with fewer parameters.
Outcome:	The proposed method improves performance over multiple tasks and no additional inference cost.

Copied to clipboard

Wei Huang, Yizhe Xiong, Xin Ye, Zhijie Deng, Hui Chen, Zijia Lin, Guiguang Ding

Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Challenge:	Large Language Models have achieved impressive performance across a range of tasks, but further gains require more than scaling up model sizes or training data.
Approach:	They propose a method that gradually reduces the number of thought tokens . this method allows models to internalize more abstract reasoning processes .
Outcome:	The proposed framework preserves the benefits of token-level reasoning while reducing computational cost.

Copied to clipboard

Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen

SynGraph: A Dynamic Graph-LLM Synthesis Framework for Sparse Streaming User Sentiment Modeling (2025.findings-acl)

Challenge:	Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach:	They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome:	The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.

Copied to clipboard

Xin Zhang, Qiyu Wei, Yingjie Zhu, Linhai Zhang, Deyu Zhou, Sophia Ananiadou

AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation (2024.acl-long)

Challenge:	Traditional sentiment analysis methods focus on static reviews, failing to capture temporal relationship between user sentiment rating and textual content.
Approach:	They propose a dynamic graph-based framework that addresses data sparsity in streaming reviews.
Outcome:	The proposed framework reduces data sparsity by categorizing users into mid-tail, long-tail and extreme scenarios and incorporating LLM enhancements within a dynamic graph-based structure.

Copied to clipboard

Zhaowei Wang, Wei Fan, Qing Zong, Hongming Zhang, Sehyun Choi, Tianqing Fang, Xin Liu, Yangqiu Song, Ginny Wong, Simon See

Explainability & Interpretability in NLP

Challenge:	Existing work shows that LLMs are deficient in abstract ability, and how to improve it remains unexplored.
Approach:	They propose a framework AbsInstruct to enhance LLMs’ abstract ability through instruction tuning.
Outcome:	The proposed framework can enhance LLMs’ abstraction ability with strong generalization performance while maintaining their general instruction-following abilities.

UER: An Open-Source Toolkit for Pre-training Models (D19-3)

Copied to clipboard

Zhe Zhao, Hui Chen, Jinbin Zhang, Xin Zhao, Tao Liu, Wei Lu, Xi Chen, Haotang Deng, Qi Ju, Xiaoyong Du

TAeKD: Teacher Assistant Enhanced Knowledge Distillation for Closed-Source Multilingual Neural Machine Translation (2024.lrec-main)

Challenge:	Existing work on pre-training models have shown that it is important to use a framework to deploy various pre- training models efficiently.
Approach:	They propose an assemble-on-demand pre-training toolkit that assembles pre-trained models on demand and encapsulates them with rich modules.
Outcome:	The proposed framework can reproduce state-of-the-art models or develop models that remain unexplored.

Copied to clipboard

Bo Lv, Xin Liu, Kaiwen Wei, Ping Luo, Yue Yu

TernaryBERT: Distillation-aware Ultra-low Bit BERT (2020.emnlp-main)

Challenge:	Large language models (LLMs) have produced impressive results in the field of Multilingual Neural Machine Translation (MNMT).
Approach:	They propose a Teacher Assistant enhanced Knowledge Distillation method to augment knowledge transfer capacity from closed-source MNMT models.
Outcome:	The proposed method outperforms the state-of-the-art KD methods on both WMT22 and FLORES-101 test sets.

Copied to clipboard

Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, Qun Liu

Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Challenge:	Transformer-based pre-training models like BERT are computationally expensive and limited to resource-constrained devices.
Approach:	They propose a method which ternarizes the weights in a fine-tuned BERT model.
Outcome:	The proposed method outperforms the other methods on the GLUE and SQUAD benchmarks while being 14.9x smaller.

Copied to clipboard

Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Zihao Xie, YiFei Wang, Weize Chen, Cheng Yang, Xin Cong, Xiaoyin Che, Zhiyuan Liu, Maosong Sun

FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (2024.acl-long)

Challenge:	Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach:	They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome:	The proposed framework enables agents to tackle unseen software-developing tasks more effectively.

Copied to clipboard

Yuxin Jiang, Yufei Wang, Xingshan Zeng, Wanjun Zhong, Liangyou Li, Fei Mi, Lifeng Shang, Xin Jiang, Qun Liu, Wei Wang

VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understanding (2025.emnlp-main)

Challenge:	Existing benchmarks focus on evaluating pure response quality, rather than assessing whether the response follows constraints stated in the instruction.
Approach:	They propose a Multi-level Fine-grained Constraints Following Benchmark for Large Language Models that adds a single constraint to the initial instruction at each increased level.
Outcome:	The proposed model can follow instructions with more constraints, and is deemed to have better instruction-following ability.

Copied to clipboard

Zhaowei Liu, Xin Guo, Haotian Xia, Lingfeng Zeng, Fangqi Lou, Jinyi Niu, Mengping Li, Qi Qi, Jiahuan Li, Wei Zhang, Yinglong Wang, Weige Cai, Weining Shen, Liwen Zhang

THCM-CAL: Temporal-Hierarchical Causal Modelling with Conformal Calibration for Clinical Risk Prediction (2025.findings-emnlp)

Challenge:	Existing benchmarks focus on text comprehension, but MLLMs lack the ability to integrate visual data over financial visuals.
Approach:	They evaluate 21 state-of-the-art multimodal large language models in a zero-shot setting . they use an annotated question–answer pair from eight common financial image modalities .
Outcome:	The new benchmark outperforms existing models but trailed financial experts by 14 percentage points.

Copied to clipboard

Xin Zhang, Qiyu Wei, Yingjie Zhu, Fanyi Wu, Sophia Ananiadou

Challenge:	Existing approaches to risk prediction from EHRs handle structured diagnostic codes and unstructured narrative notes separately.
Approach:	They propose a Temporal-Hierarchical Causal Model with Conformal Calibration . they construct a multimodal causal graph where nodes represent clinical entities from two modalities .
Outcome:	The proposed model infers three clinically grounded interactions from textual propositions and ICD codes mapped to textual descriptions.

pFedRAG: A Personalized Federated Retrieval-Augmented Generation System with Depth-Adaptive Tiered Embedding Tuning (2025.findings-emnlp)

Copied to clipboard

Hangyu He, Xin Yuan, Kai Wu, Ren Ping Liu, Wei Ni

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models (2024.acl-long)

Challenge:	Personalized Federated RAG framework enables efficient collaborative fine-tuning of embedding models . depth-adaptive tieered Embedding (DATE) architecture is tailored for local data and training results of each client.
Approach:	a new Personalized Federated RAG framework is proposed for large language models . the framework enables efficient collaborative fine-tuning of embedding models based on common knowledge .
Outcome:	a novel Personalized Federated RAG framework is proposed for large language models . the framework enables efficient collaborative fine-tuning of embedding models based on common knowledge .

Copied to clipboard

Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen

Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning (D19-1)

Challenge:	Despite the impressive multilingual capabilities demonstrated by LLMs, the understanding of how these abilities develop and function remains nascent.
Approach:	They propose a novel detection method to pinpoint language-specific neurons within LLMs by selectively activating or deactivating these neurons.
Outcome:	The proposed method can “steer” the output language of LLMs by selectively activating or deactivating language-specific neurons.

Copied to clipboard

Zheng Li, Xin Li, Ying Wei, Lidong Bing, Yu Zhang, Qiang Yang

Sentiment Analysis

Challenge:	Existing methods to extract aspects and sentiments are limited due to lack of annotated sequence data.
Approach:	They propose a Selective Adversarial Learning method to align latent correlation vectors . they propose tagging a set of aspect boundary tags and sentiment tags to create a joint label space .
Outcome:	The proposed method can learn weights for words to achieve fine-grained adaptation.

Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Shihan Dou, Jiayi Chen, Chenhao Huang, Feng Chen, Wei Chengzhi, Huiyuan Zheng, Shichun Liu, Yan Liu, Chenxiao Liu, Chao Xin, Lin Yan, Zongzhang Zhang, Tao Gui, Qi Zhang, Xuanjing Huang

Challenge:	Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach:	They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome:	The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.

SCALE: Synergized Collaboration of Asymmetric Language Translation Engines (2024.findings-acl)

Copied to clipboard

Xin Cheng, Xun Wang, Tao Ge, Si-Qing Chen, Furu Wei, Dongyan Zhao, Rui Yan

Multilinguality

Challenge:	In this paper, we introduce SCALE, a collaborative framework that connects a compact Specialized Translation Model (STM) and a general-purpose Large Language Model (LLM) as one unified translation engine.
Approach:	They propose a collaborative framework that connects a Specialized Translation Model (STM) and a general-purpose Large Language Model (LLM) as one unified translation engine.
Outcome:	The proposed framework outperforms both LLMs and supervised models in high-resource or challenging low-resourced settings.

A Data-Centric Framework for Composable NLP Workflows (2020.emnlp-demos)

Copied to clipboard

Zhengzhong Liu, Guanxiong Ding, Avinash Bukkittu, Mansi Gupta, Pengzhi Gao, Atif Ahmed, Shikun Zhang, Xin Gao, Swapnil Singhavi, Linwei Li, Wei Wei, Zecong Hu, Haoran Shi, Xiaodan Liang, Teruko Mitamura, Eric Xing, Zhiting Hu

Challenge:	Empirical natural language processing (NLP) systems involve interoperation among multiple components . a wealth of NLP toolkits exist ( 4), such as spaCy, DKPro, CoreNLP.
Approach:	They propose a unified open-source framework that supports fast development of NLP workflows . framework includes processors for NLP tasks, visualization, and annotation .
Outcome:	The framework offers processors for NLP tasks, visualization, and annotation, and is extensible . it is delivered through two modularized yet integratable open-source projects, Forte and Stave .

Making Harmful Behaviors Unlearnable for Large Language Models (2024.findings-acl)

Copied to clipboard

Xin Zhou, Yi Lu, Ruotian Ma, Yujian Wei, Tao Gui, Qi Zhang, Xuanjing Huang

MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Models (2025.findings-acl)

Challenge:	Large language models (LLMs) are often customized by fine-tuning for the requirements of different domains.
Approach:	They propose a controllable training framework to make undesired behaviors unlearnable during the fine-tuning process.
Outcome:	The proposed framework makes undesired behaviors unlearnable during the fine-tuning process while preserving the ability to learn other information.

Copied to clipboard

Jiahao Huo, Yibo Yan, Xu Zheng, Yuanhuiyi Lyu, Xin Zou, Zhihua Wei, Xuming Hu

An Effective and Efficient Entity Alignment Decoding Algorithm via Third-Order Tensor Isomorphism (2022.acl-long)

Challenge:	Recent advances in machine learning (MU) have enabled the selective removal of private or sensitive information encoded within deep neural networks.
Approach:	They propose to "reformulate" the task of multimodal MU in the era of MLLMs by preserving only the visual patterns associated with a given entity while preserving the corresponding textual knowledge.
Outcome:	The proposed method surpasses baselines that finetuned MLLMs with VQA data directly through Gradient Ascent (GA) or Negative Preference Optimization (NPO), across all evaluation dimensions.

Copied to clipboard

Xin Mao, Meirong Ma, Hao Yuan, Jianchao Zhu, ZongYu Wang, Rui Xie, Wei Wu, Man Lan

Structured Data in NLP

Challenge:	Existing methods focus on graph representation learning, but decoding is a key part of the process.
Approach:	They propose an EA Decoding Algorithm via Third-order Tensor Isomorphism (DATTI) they combine two sets of isomorphic equations to enhance the decoding process .
Outcome:	The proposed algorithm can deliver significant performance improvements even on the most advanced methods while the extra required time is less than 3 seconds.

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References (2024.naacl-long)

Copied to clipboard

Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Xin Zhao, Tom Kocmi, Furu Wei

Text Generation

Challenge:	Existing evaluation benchmarks with limited references may not accurately reflect the quality of the model’s hypotheses.
Approach:	They propose a method to enrich evaluation benchmarks by diversifying the expression of a single reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible.
Outcome:	The proposed method can enhance evaluation benchmarks by diversifying the expression of reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible.

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models (2025.naacl-long)

Copied to clipboard

Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang

Improving Zero-Shot Entity Linking Candidate Generation with Ultra-Fine Entity Type Information (2022.coling-1)

Challenge:	Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored.
Approach:	They propose to use a benchmark to evaluate large language models' financial domain knowledge and practical abilities.
Outcome:	The proposed benchmark evaluates large language models' financial domain knowledge and practical abilities.

Copied to clipboard

Xuhui Sui, Ying Zhang, Kehui Song, Baohang Zhou, Guoqing Zhao, Xin Wei, Xiaojie Yuan

SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)

Challenge:	Entity linking is a task of assigning entity mentions to referent entities in a knowledge base.
Approach:	They propose to use ultra-fine-grained type information to improve the generalization ability of EL models by utilizing a low-level task to extract ultra-finish entity type information.
Outcome:	The proposed model achieves state-of-the-art in the zero-shot entity linking task .

Copied to clipboard

Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song

Instruction-Tuning Data Synthesis from Scratch via Web Reconstruction (2025.findings-acl)

Challenge:	Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used.
Approach:	They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark.
Outcome:	The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history.

Copied to clipboard

Yuxin Jiang, Yufei Wang, Chuhan Wu, Xinyi Dai, Yan Xu, Weinan Gan, Yasheng Wang, Xin Jiang, Lifeng Shang, Ruiming Tang, Wei Wang

Low-Resource NLP

Challenge:	Existing methods for generating and curating high-quality instruction-tuning data rely heavily on the quality of seed data or strong assumptions about the structure and content of web documents.
Approach:	They propose a fully automated framework for synthesizing high-quality instruction-tuning (IT) data directly from raw web documents with minimal assumptions.
Outcome:	The proposed framework outperforms state-of-the-art baselines by 16.65% across four instruction-following benchmarks.

PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yuan Yao, Yangqiu Song

TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Challenge:	generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach:	They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome:	The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.

Copied to clipboard

Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang

Robustness in NLP

Challenge:	Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach:	They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome:	The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.

Unleashing Low-Bit Inference on Ascend NPUs: A Comprehensive Evaluation of HiFloat Formats (2026.acl-industry)

Copied to clipboard

Pengxiang Zhao, Hui-Ling Zhen, Xing Li, Han Bao, Weizhe Lin, Zhiyuan Yang, Yu Zi Wei, Xin Wang, Mingxuan Yuan, Xianzhi Yu, Zhenhua Dong

Green & Sustainable NLP

Challenge:	Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency.
Approach:	They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs.
Outcome:	The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks.

Towards Unified Representations of Knowledge Graph and Expert Rules for Machine Learning and Reasoning (2022.aacl-main)

Copied to clipboard

Zhepei Wei, Yue Wang, Jinnan Li, Zhining Liu, Erxin Yu, Yuan Tian, Xin Wang, Yi Chang