Papers by Yin Yang

Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Challenge:	Popular pre-trained Transformers have improved performance for various NLP tasks by sizable margins, but are too resource-hungry and computation-intensive to suit low-capacity devices or applications with strict latency requirements.
Approach:	They present a literature review of the compression of Transformers, focusing on the popular BERT model, which has attracted considerable research attention.
Outcome:	The proposed models improve Sentiment analysis, paraphrase detection, machine reading comprehension, question answering, text summarization, and other tasks by sizable margins.

Copied to clipboard

Ziqi Zhao, Zhaochun Ren, Jiahong Zou, Liu Yang, Zhiwei Xu, Xuri Ge, Zhumin Chen, Xinyu Ma, Daiting Shi, Shuaiqiang Wang, Dawei Yin, Xin Xin

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation (2022.findings-emnlp)

Challenge:	Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach:	They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome:	Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.

Copied to clipboard

Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei

Towards a Unified Multi-Dimensional Evaluator for Text Generation (2022.emnlp-main)

Challenge:	Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data.
Approach:	They propose a cross-lingual entity projection framework to enable zero-shot cross-linguistic NER with the help of a multilingual labeled sequence translation model.
Outcome:	The proposed method outperforms the baseline method on two benchmarks by a large margin of +3 7 F1 scores and achieves state-of-the-art performance.

Copied to clipboard

Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han

CharacterCraft: Bridging the Literature-Reality Dialogue Gap for Practical Role-Playing Agents (2025.findings-emnlp)

Challenge:	Existing evaluation frameworks for natural language generation are dominated by similarity-based metrics.
Approach:	They propose a multi-dimensional evaluator for natural language generation that integrates multiple dimensions into one evaluer.
Outcome:	The proposed evaluator improves on three typical NLG tasks and improves with external knowledge.

Copied to clipboard

Xuyan Yin, Xinran Yang, Zihao Li, Lixin Zou, Chenliang Li

UnCo: Uncertainty-Driven Collaborative Framework of Large and Small Models for Grounded Multimodal NER (2025.emnlp-main)

Challenge:	Existing dialogue datasets have a bias between query distributions and real-world user language usage.
Approach:	They propose a framework for Chinese role-playing and a robust evaluation method . they propose specialized Chinese dialogue extraction model and specialized memory retrieval module .
Outcome:	The proposed framework extracts character dialogue from novels and ensures high data quality.

Copied to clipboard

Jielong Tang, Yang Yang, Jianxing Yu, Zhen-Xing Wang, Haoyuan Liang, Liang Yao, Jian Yin

DrAgent: Empowering Large Language Models as Medical Agents for Multi-hop Medical Reasoning (2025.findings-emnlp)

Challenge:	Existing methods to identify unseen multimodal entities struggle with limited knowledge and generalization.
Approach:	They propose a framework that leverages the strengths of small fine-tuned models and MLLMs to generate unambiguous predictions.
Outcome:	Extensive experiments show that the proposed framework retains the in-domain knowledge of small models while utilizing the capabilities of MLLMs to handle unseen entities.

Copied to clipboard

Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xin Liu, Zhengyang Wang, Xianfeng Tang, Shiyang Li, Xiang He, Ruijie Wang, Bing Yin, Xiao Gu, Lei Clifton, David A. Clifton

Mitigating Lost in Multi-turn Conversation via Curriculum RL with Verifiable Accuracy and Abstention Rewards (2026.acl-long)

Challenge:	commercial LLMs can be difficult to use in real-world clinical decision-making . a lightweight LLM can be used to collaborate with diverse clinical tools .
Approach:	They propose a lightweight LLM that can be used to build medical LLMs as agents . they use recursive curriculum learning to optimize the LLM in an easy-to-hard progression .
Outcome:	The proposed approach outperforms human experts in medical examinations on diverse datasets.

Copied to clipboard

Ming Li, Pei Chen, Zhenhao Zhang, Tao Yang, Xinyang Zhang, Han Li, Tianyu Cao, Ming Zeng, Zhuofeng Wu, Meng Jiang, Huasheng Li, Lihong Li, Bing Yin

ATFormer: A Learned Performance Model with Transfer Learning Across Devices for Deep Learning Tensor Programs (2023.emnlp-main)

Challenge:	Large Language Models exhibit strong capabilities in single-turn instruction following but suffer from Lost-in-Conversation (LiC) when instructions are revealed progressively in multi-turn settings, models get "Lost in Conversation"
Approach:	They propose a framework that encourages models to generate correct answers and judge solvability in multi-turn conversations.
Outcome:	The proposed framework improves models' ability to balance problem-solving with abstention . it reduces premature answering behaviors that cause lost-in-conversation (LiC)

Copied to clipboard

Yang Bai, Wenqian Zhao, Shuo Yin, Zixiao Wang, Bei Yu

Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)

Challenge:	Compilation-based methods with performance models have poor measurement accuracy and transferability between platforms.
Approach:	They propose a compiler that automatically generates tensors and automatically tunes them for different hardware platforms.
Outcome:	The proposed model reduces inference time and costs on modern DNN benchmarks.

Copied to clipboard

Bin Liang, Hang Su, Rongdi Yin, Lin Gui, Min Yang, Qin Zhao, Xiaoqi Yu, Ruifeng Xu

Sentiment Analysis

Challenge:	Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence.
Approach:	They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights .
Outcome:	The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets.

Arbitrary Time Information Modeling via Polynomial Approximation for Temporal Knowledge Graph Embedding (2024.lrec-main)

Copied to clipboard

Zhiyu Fang, Jingyan Qin, Xiaobin Zhu, Chun Yang, Xu-Cheng Yin

Multilingual Agreement for Multilingual Neural Machine Translation (2021.acl-short)

Challenge:	Existing knowledge graphs lack rich inference patterns and the limited ability to model arbitrary timestamps continuously.
Approach:	They propose a temporal knowledge graph-based temporal representation method that decomposes time information by polynomials and then enhances the model's capability to represent arbitrary timestamps flexibly.
Outcome:	The proposed method can encode arbitrary time information or even unseen timestamps while capturing rich inference patterns and higher-arity relations of the knowledge base.

Copied to clipboard

Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Zhoujun Li, Furu Wei

Keyphrase Generation via Soft and Hard Semantic Corrections (2022.emnlp-main)

Challenge:	Existing models that only use auxiliary languages to encourage multilingual agreement ignore the relationships between different language pairs.
Approach:	They propose a multilingual agreement-based method which explicitly models the agreement between different translation directions by randomly substituting some fragments of the source language with their counterpart translations of auxiliary languages.
Outcome:	The proposed method improves on the multilingual translation task of 10 language pairs.

Copied to clipboard

Guangzhen Zhao, Guoshun Yin, Peng Yang, Yu Yao

Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)

Challenge:	Extensive experiments show that CorrKG is capable of generating high-quality keyphrases.
Approach:	They propose a correction model CorrKG on top of the MLE pipeline to correct the biases . the adaptive adaptive mass learning scheme is designed to better fit OT and FreqFS .
Outcome:	The proposed model overcomes the semantic biases in keyphrase generation using OT and FreqFS techniques.

Copied to clipboard

Yuchen Zhuang, Jingfeng Yang, Haoming Jiang, Xin Liu, Kewei Cheng, Sanket Lokegaonkar, Yifan Gao, Qing Ping, Tianyi Liu, Binxuan Huang, Zheng Li, Zhengyang Wang, Pei Chen, Ruijie Wang, Rongzhi Zhang, Nasser Zalmout, Priyanka Nigam, Bing Yin, Chao Zhang

The Mirage of Model Editing: Revisiting Evaluation in the Wild (2025.acl-long)

Challenge:	Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability.
Approach:	They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs .
Outcome:	The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks.

Copied to clipboard

Wanli Yang, Fei Sun, Jiajun Tan, Xinyu Ma, Qi Cao, Dawei Yin, Huawei Shen, Xueqi Cheng

Question Answering

Challenge:	despite near-perfect results, effectiveness of model editing in real-world applications remains unclear.
Approach:	They propose QAEdit and WILD to better reflect real-world use of model editing . they propose a benchmark aligned with widely used question answering datasets and a task-agnostic evaluation framework .
Outcome:	The proposed QAEdit benchmark and WILD evaluation framework show that current models perform worse than previously reported.

Efficient Shapley Values Estimation by Amortization for Text Classification (2023.acl-long)

Copied to clipboard

Chenghao Yang, Fan Yin, He He, Kai-Wei Chang, Xiaofei Ma, Bing Xiang

Information Retrieval

Challenge:	Shapley Values are often estimated with a small number of stochastic model evaluations, but this can only be mitigated by aggregating thousands of model evaluation.
Approach:	They propose to combine a model with thousands of model evaluations to estimate Shapley Values without additional model evaluation.
Outcome:	The proposed model estimates Shapley Values accurately with up to 60 times speedup compared to traditional methods and does not suffer from stability issues as inference is deterministic.

Eliciting Implicit Acoustic Styles from Open-domain Instructions to Facilitate Fine-grained Controllable Generation of Speech (2025.emnlp-main)

Copied to clipboard

Jianxing Yu, Gou Zihao, Chen Li, Zhisheng Wang, Peiji Yang, Wenqing Chen, Jian Yin

Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)

Challenge:	Current work relies on pre-defined rules or templates to control the style of speech.
Approach:	They propose to use open-domain instructions to generate speech with the acoustic style that meets users’ needs based on their instructions.
Outcome:	The proposed model can be used to generate speech with the acoustic style that meets users’ needs based on open-domain instructions.

Copied to clipboard

Jiali Zeng, Yang Liu, Jinsong Su, Yubing Ge, Yaojie Lu, Yongjing Yin, Jiebo Luo

SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis (2025.findings-naacl)

Challenge:	Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework.
Approach:	They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer.
Outcome:	Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework.

Copied to clipboard

Hengxing Cai, Xiaochen Cai, Junhan Chang, Sihang Li, Lin Yao, Wang Changxin, Zhifeng Gao, Hongshuai Wang, Li Yongge, Mujie Lin, Shuwen Yang, Jiankun Wang, Mingjun Xu, Jin Huang, Xi Fang, Jiaxi Zhuang, Yuqi Yin, Yaqi Li, Changhong Chen, Zheng Cheng, Zifeng Zhao, Linfeng Zhang, Guolin Ke

Challenge:	Existing benchmarks fail to adequately evaluate the proficiency of Large Language Models (LLMs) Existing standards do not cover the skills needed to evaluate LLMs in scientific literature analysis.
Approach:	They propose a benchmark to evaluate the proficiency of large language models in scientific literature analysis.
Outcome:	SciAssess evaluates 11 LLMs on multiple tasks across scientific fields.

Fine-Grained Propaganda Detection with Fine-Tuned BERT (D19-50)

Copied to clipboard

Shehel Yoosuf, Yin Yang

GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)

Challenge:	The goal of the Fragment Level Classification task is to detect and classify textual segments that correspond to one of the 18 given propaganda techniques in a news articles dataset.
Approach:	They propose a model that performs word-level classification using a pre-trained language model to detect and classify propaganda fragments in a news article dataset.
Outcome:	The proposed model performs word-level classification using a popular pre-trained language model.

Copied to clipboard

Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li

WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)

Challenge:	Existing pre-training methods underutilize the benefits of language understanding for generation.
Approach:	They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator.
Outcome:	The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance.

Copied to clipboard

Chenchen Yang, Kexin Huang, Liwei Fan, Qian Tu, Botian Jiang, Dong Zhang, Linqi Yin, Shimin Li, Zhaoye Fei, Qinyuan Cheng, Xipeng Qiu

Towards Database-Free Text-to-SQL Evaluation: A Graph-Based Metric for Functional Correctness (2025.coling-main)

Challenge:	aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is.
Approach:	They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types.
Outcome:	The proposed model disentangles ASR errors from event detection while maintaining ASR quality.

Copied to clipboard

Yi Zhan, Longjie Cui, Han Weng, Guifeng Wang, Yu Tian, Boyi Liu, Yingxiang Yang, Xiaoming Yin, Jiajun Xie, Yang Sun

RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository (2026.acl-long)

Challenge:	Existing metrics for evaluating functional correctness of SQL queries are prone to false positives due to inadequately prepared test databases.
Approach:	They propose a graph-based metric that uses a relational operator tree to extract rich semantic information from the logical execution plan of SQL queries and embed it into a diagram.
Outcome:	The proposed method eliminates the need for extensive test database preparation and performs graph matching on unseen SQL queries.

Copied to clipboard

Zhiyuan Peng, Xin Yin, Pu Zhao, Fangkai Yang, Lu Wang, Ran Jia, Xu Chen, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

Challenge:	Existing benchmarks focus on isolated function/class-level generation, neglecting complete microservice repository generation.
Approach:	They propose a multilingual benchmark for repository-level end-to-end web microservice generation that reflects real-world development workflows.
Outcome:	The benchmark compared 106 repositories across 18 domains and 11 frameworks and 1,258 API endpoints and 2,335 test cases.

BC-Prover: Backward Chaining Prover for Formal Theorem Proving (2024.emnlp-main)

Copied to clipboard

Yuhang He, Jihai Zhang, Jianzhu Bao, Fangquan Lin, Cheng Yang, Bing Qin, Ruifeng Xu, Wotao Yin

Reasoning

Challenge:	Existing methods for interactive theorem proving in formal logic lack robustness and robustness.
Approach:	They propose a backward chaining framework guided by pseudo steps for proofstep generation that prioritizes pseudo steps.
Outcome:	The proposed framework improves on the miniF2F benchmark.

AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models (2023.acl-short)

Copied to clipboard

Siheng Li, Cheng Yang, Yichun Yin, Xinyu Zhu, Zesen Cheng, Lifeng Shang, Xin Jiang, Qun Liu, Yujiu Yang

Can Language Models Follow Multiple Turns of Entangled Instructions? (2025.findings-emnlp)

Challenge:	Existing research on information-seeking conversations is stymied by the lack of training data.
Approach:	They propose to use autoconv for synthetic conversation generation to capture the characteristics of the information-seeking process and fine tune an LLM with a few human conversations to generate synthetic conversations with high quality.
Outcome:	The proposed model improves on two commonly-used datasets and alleviates the dependence on human annotation.

Copied to clipboard

Chi Han, Xin Liu, Haodong Wang, Shiyang Li, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Qingyu Yin, Liang Qiu, Changlong Yu, Yifan Gao, Zheng Li, Bing Yin, Jingbo Shang, Heng Ji

LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios (2025.naacl-long)

Challenge:	Despite of significant achievements in improving instruction-following capabilities of large language models, the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge.
Approach:	They construct multi-turn instruction with 1.1K high-quality multi-turned conversations using the human-in-the-loop approach and examine their capabilities.
Outcome:	The proposed model shows that it is difficult to integrate multiple turns and balance competing objectives when instructions intersect or conflict.

Copied to clipboard

Pei Chen, Hongye Jin, Cheng-Che Lee, Rulin Shao, Jingfeng Yang, Mingyu Zhao, Zhaoyu Zhang, Qin Lu, Kaiwen Men, Ning Xie, Huasheng Li, Bing Yin, Han Li, Lingyun Wang

Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator (2023.findings-acl)

Challenge:	LongLeader aims to assess different LLMs' long-context comprehension abilities . long-constext comprehension is a key bottleneck for many use cases .
Approach:	They propose a leaderboard to assess different LLMs' long-context comprehension abilities . they offer open-source access to the benchmarks and maintain a dedicated website .
Outcome:	The proposed model assesses different LLMs on selected benchmarks and provides open-source access to the benchmarks.

Copied to clipboard

Ziwei He, Meng Yang, Minwei Feng, Jingcheng Yin, Xinbing Wang, Jingwen Leng, Zhouhan Lin

AttnPO: Attention-Guided Process Supervision for Efficient Reasoning (2026.acl-long)

Challenge:	Existing transformer models are computationally demanding and prohibitively costly for long sequences due to the quadratic complexity of its selfattention module.
Approach:	They propose a transformer-based model that inherits weights from large pretrained models by removing redundancies in hidden sequences using the ready-made Fast Fourier Transform operator.
Outcome:	The proposed model outperforms the standard BART model on the long-range modeling benchmark LRA with significant improvements in speed and space.

Copied to clipboard

Shuaiyi Nie, null Dingsiyu, Wenyuan Zhang, Linhao Yu, Tianmeng Yang, Yao Chen, Weichong Yin, Yu Sun, Hua Wu, Tingwen Liu

CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Challenge:	Existing trajectory-level length penalties fail to effectively shorten reasoning length and degrade accuracy, as they treat all reasoning steps uniformly and lack fine-grained signals to distinguish redundancy from necessity.
Approach:	They propose a low-overhead process-supervised RL framework that leverages the model’s intrinsic attention signals for step-level credit assignment.
Outcome:	The proposed framework reduces reasoning length while improving performance across 9 benchmarks.

Copied to clipboard

Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan

Challenge:	Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach:	They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome:	The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .

Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination (D18-1)

Copied to clipboard

Jiali Zeng, Jinsong Su, Huating Wen, Yang Liu, Jun Xie, Yongjing Yin, Jianqiang Zhao

Aligning Paralinguistic Understanding and Generation in Speech LLMs via Multi-Task Reinforcement Learning (2026.eacl-industry)

Challenge:	Experimental results on Chinese-English and English-French multi-domain translation tasks demonstrate the effectiveness of the proposed model.
Approach:	They propose to use mixed-domain parallel sentences to construct a unified model that allows translation to switch between different domains.
Outcome:	The proposed model distinguishes and exploits word-level domain contexts on Chinese-English and English-French translation tasks.

Copied to clipboard

Minseok Kim, Jingxiang Chen, Seong-Gyun Leem, Yin Huang, Rashi Rungta, Zhicheng Ouyang, Haibin Wu, Surya Teja Appini, Ankur Bansal, Yang Bai, Yue Liu, Florian Metze, Ahmed A Aly, Anuj Kumar, Ariya Rastrow, Zhaojiang Lin

STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detection (2025.findings-acl)

Challenge:	Using paralinguistic cues is challenging for speech large language models, authors say . limited training data, annotation difficulty, and models exploiting lexical shortcuts are challenges . a recent study shows that modeling paralinguistic reasoning with multitask RL improves paralinguistics understanding .
Approach:	They propose multi-task reinforcement learning with chain-of-thought prompting that elicits explicit affective reasoning.
Outcome:	The proposed model improves paralinguistics understanding over baselines and strong proprietary models by 8-12% on Expresso, IEMOCAP, and RAVDESS.

Copied to clipboard

Zewen Bai, Liang Yang, Shengdi Yin, Junyu Lu, Jingjie Zeng, Haohao Zhu, Yuanyuan Sun, Hongfei Lin

Ethical NLP

Challenge:	Existing studies on Chinese hate speech detection lack span-level fine-grained annotations.
Approach:	They construct a Span-level target-aware Toxicity Extraction dataset and evaluate existing models for Chinese hateful slang.
Outcome:	The proposed dataset is the first span-level Chinese hate speech dataset and evaluates the ability of existing models to understand hate semantics.

Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates (2025.emnlp-main)

Copied to clipboard

Hy Dang, Tianyi Liu, Zhuofeng Wu, Jingfeng Yang, Haoming Jiang, Tao Yang, Pei Chen, Zhengyang Wang, Helen Wang, Huasheng Li, Bing Yin, Meng Jiang

Dialectical Structured Reasoning for Explainable Multimodal Fake News Detection (2026.findings-acl)

Challenge:	Large language models (LLMs) have strong reasoning and tool-use capabilities, yet fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent.
Approach:	They propose a curriculum-inspired framework that leverages structured reasoning templates to guide LLMs through more deliberate step-by-step instructions for generating function calls.
Outcome:	The proposed framework reduces tool-use errors and improves interpretability and transparency of tool-using agents.

Copied to clipboard

Ruichao Yang, Yufan Bian, Wei Gao, Bo-Wen Zhang, Jing Ma, Hongzhan Lin, Ziyang Luo, Xiaobin Zhu, Xu-Cheng Yin

Knowledge Diffusion for Neural Dialogue Generation (P18-1)

Challenge:	Existing fake news detection models are opaque and lack deductive transparency . a framework for dialectical structured reasoning is proposed to address this limitation .
Approach:	They propose a framework that model fake news detection as an explicit dialectical process over multimodal social context.
Outcome:	The proposed framework achieves state-of-the-art while producing transparent explanations that mirror human reasoning process.

Copied to clipboard

Shuman Liu, Hongshen Chen, Zhaochun Ren, Yang Feng, Qun Liu, Dawei Yin

Morpheme Sense Disambiguation: A New Task Aiming for Understanding the Language at Character Level (2024.lrec-main)

Challenge:	End-to-end neural dialogue generation does not employ knowledge to guide the generation.
Approach:	They propose a neural knowledge diffusion model to introduce knowledge into dialogue generation.
Outcome:	The proposed model outperforms baseline models on a real-world dataset.

Copied to clipboard

Yue Wang, Hua Zheng, Yaqi Yin, Hansi Wang, Qiliang Liang, Yang Liu

Visual Data in NLP

Challenge:	Morphemes are a strong linguistic feature to capture lexical semantics, but lack of morpheme-informed resources and the expense of manual annotations hinder morphme-enhanced methods.
Approach:	They propose a task of Morpheme Sense Disambiguation with two subtasks in-text and in-word to generalize morpheme features on more tasks.
Outcome:	The proposed tasks are based on two morpheme-annotated datasets for Chinese . the best model yields a promising precision of 77.66% on in-text and 88.19% on in word .

Graph-Reward-SQL: Execution-Free Reinforcement Learning for Text-to-SQL via Graph Matching and Stepwise Reward (2025.findings-emnlp)

Copied to clipboard

Han Weng, Puzhen Wu, Cui Longjie, Yi Zhan, Boyi Liu, Yuanfeng Song, Dun Zeng, Yingxiang Yang, Qianru Zhang, Dong Huang, Xiaoming Yin, Yang Sun, Xing Chen

Beyond the First Error: Process Reward Models for Reflective Mathematical Reasoning (2025.findings-emnlp)

Challenge:	Existing methods to enhance performance of large language models (LLMs) on Text-to-SQL tasks rely on execution-based or LLM-based reward models.
Approach:	They propose a reward model framework for RL-based Text-to-SQL that employs the GMNScore outcome reward model.
Outcome:	The proposed reward model outperforms existing reward models on standard benchmarks including Spider and BIRD.

Copied to clipboard

Zhaohui Yang, Chenghua He, Xiaowen Shi, Shihong Deng, Linjing Li, Qiyue Yin, Daxin Jiang

Reasoning

Challenge:	Existing methods for training effective PRMs focus on the first incorrect step and all preceding steps, assuming that all subsequent steps are incorrect.
Approach:	They propose a data annotation method specifically designed to score the long CoT reasoning process by using an LLM-based judger for annotation.
Outcome:	The proposed method improves PRMs' ability to identify effective self-correction behaviors and reasoning based on erroneous steps.

Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labels (2023.findings-acl)

Copied to clipboard

Bang Yang, Fenglin Liu, Zheng Li, Qingyu Yin, Chenyu You, Bing Yin, Yuexian Zou

Data Diversity Matters for Robust Instruction Tuning (2024.findings-emnlp)

Challenge:	Existing approaches to generate informative titles for products with limited labels are inadequate for novel products.
Approach:	They propose a prompt-based approach to generate attractive titles for novel products . they use multimodal prompts to preserve characteristics and writing styles of novel products.
Outcome:	The proposed approach achieves state-of-the-art results on novel product categories with limited labels.

Copied to clipboard

Alexander Bukharin, Shiyang Li, Zhengyang Wang, Jingfeng Yang, Bing Yin, Xian Li, Chao Zhang, Tuo Zhao, Haoming Jiang

FOFO: A Benchmark to Evaluate LLMs’ Format-Following Capability (2024.acl-long)

Challenge:	Recent studies have shown that by curating high quality and diverse instruction tuning datasets, we can significantly improve instruction-following capabilities.
Approach:	They propose an algorithm to control diversity and quality of instruction tuning datasets and validate it.
Outcome:	The proposed algorithm significantly improves worst and average case performance on large scale instruction tuning datasets.

Copied to clipboard

Congying Xia, Chen Xing, Jiangshu Du, Xinyi Yang, Yihao Feng, Ran Xu, Wenpeng Yin, Caiming Xiong

Challenge:	Existing benchmarks fail to assess large language models’ format-following proficiency adequately.
Approach:	They propose a benchmark to evaluate large language models' ability to follow complex, domain-specific formats.
Outcome:	The proposed framework evaluates large language models' ability to follow complex, domain-specific formats across open-source and closed-source models.

Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao

Improving Deep Embedded Clustering via Learning Cluster-level Representations (2022.coling-1)

Challenge:	Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach:	They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome:	The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.

Copied to clipboard

Qing Yin, Zhihua Wang, Yunya Song, Yida Xu, Shuai Niu, Liang Bai, Yike Guo, Xian Yang

Information Extraction & Text Mining

Challenge:	Existing efforts to learn meaningful representations at the instance level are limited.
Approach:	They propose a deep embedded clustering model with cluster-level representation learning to jointly learn cluster and instance level representations.
Outcome:	The proposed model produces meaningful clusters on real-world short text datasets.

PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts (2023.acl-long)

Copied to clipboard

Yunshui Li, Binyuan Hui, ZhiChao Yin, Min Yang, Fei Huang, Yongbin Li

Conflicts Make Large Reasoning Models Vulnerable to Attacks (2026.findings-acl)

Challenge:	Existing research on multi-modal dialogue pre-training is limited due to limited availability of multi-dimensional data . a recent emergence of chatGPT 1 has increased confidence in the potential for this goal .
Approach:	They propose a framework for multi-modal dialogue pre-training that integrates experts to accommodate multi-faceted tasks.
Outcome:	The proposed framework achieves state-of-the-art on eight multi-modal dialog benchmarks.

Copied to clipboard

Honghao Liu, Chengjin Xu, Xuhui Jiang, Cehao Yang, Shengming Yin, Zhengwu Ma, Lionel Ni, Jian Guo

NetSafe: Exploring the Topological Safety of Multi-agent System (2025.findings-acl)

Challenge:	Large Reasoning Models have demonstrated outstanding capabilities in solving complex reasoning tasks by incorporating step-by-step chain-of-thought (CoT) reasoning.
Approach:	They evaluate three large reasoning models that perform explicit and coherent reasoning under conflicting objectives and use them to evaluate their performance.
Outcome:	The proposed models perform explicit and coherent reasoning before producing their outputs, improving problem-solving and multi-step decision making.

Copied to clipboard

Miao Yu, Shilong Wang, Guibin Zhang, Junyuan Mao, Chenlong Yin, Qijiong Liu, Kun Wang, Qingsong Wen, Yang Wang

Challenge:	Large language models (LLMs) have fueled significant progress in intelligent Multi-agent Systems (MAS), with expanding academic and industrial applications.
Approach:	They propose a framework that unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis.
Outcome:	The proposed framework unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis.

AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization via Multi-LLMs (2025.findings-naacl)

Copied to clipboard

Jiawei Chen, Xiao Yang, Zhengwei Fang, Yu Tian, Yinpeng Dong, Zhaoxia Yin, Hang Su

PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathology (2025.findings-emnlp)

Challenge:	Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness .
Approach:	They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts.
Outcome:	The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries.

Copied to clipboard

Yating Huang, Ziyan Huang, Lintao Xiang, Qijun Yang, Hujun Yin

MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition (2024.findings-emnlp)

Challenge:	Current vision-language (VL) models fail to capture complex reasoning required for interpreting structured pathological reports.
Approach:	They propose a pathology-specific VL training scheme that generates enhanced and perturbed samples for multimodal contrastive learning.
Outcome:	The proposed approach achieves state-of-the-art performance on PathoHR-Bench and six additional pathology datasets, highlighting its effectiveness in fine-grained pathology representation.

Copied to clipboard

Cheng Yang, Yang Sui, Jinqi Xiao, Lingyi Huang, Yu Gong, Yuanlin Duan, Wenqi Jia, Miao Yin, Yu Cheng, Bo Yuan

CaM-HG: Causal-Enhanced MoE and Hypergraphs Network for Incomplete Multimodal Emotion Recognition in Conversations (2026.findings-acl)

Challenge:	emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models.
Approach:	They propose a two-stage compression method tailored for Mixture of Experts to reduce the model size and decrease the computational cost.
Outcome:	The proposed method reduces model size and improves inference efficiency while maintaining performance in various zero-shot tasks.

Copied to clipboard

Mingjian Yang, Yong Wang, Peng Liu, Wen Yin

A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation (2020.acl-main)

Challenge:	Existing methods that focus on statistical reconstruction often fail to bridge these gaps, effectively leaving semantic holes.
Approach:	They propose a Causal-Enhanced Mixture-of-Experts and Hypergraph Network to bridge missing features . they use experts to synthesize missing features that are realistic and causally consistent .
Outcome:	The proposed model synthesizes missing features that are realistic and causally consistent . it surpasses benchmarks on IEMOCAP, CMU-MOSI, and CMU MOSEI by 1.43% and 1.25% .

Copied to clipboard

Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo

VehicleWorld: A Highly Integrated Multi-Device Environment for Intelligent Vehicle Interaction (2025.findings-emnlp)

Challenge:	Existing multi-modal neural machine translation models do not fully exploit fine-grained semantic correspondences between semantic units of different modalities.
Approach:	They propose a graph-based multi-modal fusion encoder that exploits fine-grained semantic correspondences between different modalities.
Outcome:	The proposed encoder significantly extends the conventional text-based translation by taking images as additional inputs.

Copied to clipboard

Jie Yang, Jiajun Chen, Zhangyue Yin, Shuo Chen, Yuxin Wang, Yiran Guo, Yuan Li, Yining Zheng, Xuanjing Huang, Xipeng Qiu

Challenge:	Traditional Function Calling (FC) approaches operate statelessly, requiring multiple exploratory calls to build environmental awareness before execution, leading to inefficiency and limited error recovery.
Approach:	They propose a state-based function call approach that maintains explicit system state awareness and implements direct state transitions to achieve target conditions.
Outcome:	The proposed approach outperforms traditional function calling approaches, achieving superior execution accuracy and reduced latency.

SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models (2022.findings-naacl)

Copied to clipboard

Jingfeng Yang, Haoming Jiang, Qingyu Yin, Danqing Zhang, Bing Yin, Diyi Yang

PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning (2025.emnlp-industry)

Challenge:	Recent research shows promising results on combining pretrained language models with canonical utterance for few-shot semantic parsing.
Approach:	They propose a few-shot semantic parsing method that decomposes a problem into a sequence of sub-problems, which correspond to the sub-clauses of the formal language.
Outcome:	The proposed method achieves SOTA performance of BART-based models on GeoQuery and EcommerceQuery, which are two few-shot datasets with compositional data split.

Copied to clipboard

Mohammad Kachuee, Teja Gollapudi, Minseok Kim, Yin Huang, Kai Sun, Xiao Yang, Jiaqi Wang, Nirav Shah, Yue Liu, Aaron Colak, Anuj Kumar, Wen-tau Yih, Xin Luna Dong

Reasoning

Challenge:	Existing methods to improve factuality of large language models (LLMs) rely on human-engineered instructions.
Approach:	They propose a retrieval-augmented generation framework that trains the model with distractor-aware QA pairs mixing gold evidence with subtle distractor passages and instills reasoning-centric habits that make the LLM plan, rationalize, and synthesize without extensive human engineered instructions.
Outcome:	The proposed framework outperforms state-of-the-art solutions across 12 open-book RAG QA benchmarks and is being deployed in production.

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark (2024.emnlp-main)

Copied to clipboard

Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xianfeng Tang, Chen Luo, Ming Zeng, Haoming Jiang, Yifan Gao, Priyanka Nigam, Sreyashi Nag, Bing Yin, Yining Hua, Xuan Zhou, Omid Rohanian, Anshul Thakur, Lei Clifton, David Clifton

The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse (2024.findings-acl)

Challenge:	Existing studies focus on evaluating large language models in close-ended QA tasks, but many clinical decisions involve answering open-ended questions without pre-set options.
Approach:	They construct a benchmark to better understand large language models in the clinic . they use existing datasets to evaluate LLMs in clinical situations .
Outcome:	The proposed model outperforms human experts in multiple medical tasks.

Copied to clipboard

Wanli Yang, Fei Sun, Xinyu Ma, Xun Liu, Dawei Yin, Xueqi Cheng

ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation (2025.emnlp-main)

Challenge:	Even a single edit can trigger model collapse, manifesting as significant performance degradation in various benchmark tasks.
Approach:	They propose to use perplexity as a surrogate metric to determine whether an edited model's performance is affected by a single edit.
Outcome:	The proposed method shows that even a single edit can cause model collapse, manifesting as significant performance degradation in various benchmark tasks.

Copied to clipboard

Minghua He, Yue Chen, Fangkai Yang, Pu Zhao, Wenjie Yin, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

Red Teaming Large Reasoning Models (2026.acl-long)

Challenge:	Existing code translation models only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code.
Approach:	They propose an LLM specifically designed for code translation called ExeCoder . it uses executability representations such as functional semantics and syntax structures to enhance LLMs' capabilities.
Outcome:	The proposed model outperforms existing open-source code translation models on two metrics.

Copied to clipboard

Jiawei Chen, Yang Yang, Chao Yu, Yu Tian, Zhi Cao, Xue Yang, Linghao Li, Hang Su, Zhaoxia Yin

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization (2021.naacl-main)

Challenge:	Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies.
Approach:	They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models.
Outcome:	The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models.

Copied to clipboard

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Hassan Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, Dragomir Radev

Zero-Shot Rationalization by Multi-Task Transfer Learning from Question Answering (2020.findings-emnlp)

Challenge:	Existing work on meeting summarization tasks is limited to short summaries that cover all the content of a meeting.
Approach:	They propose a query-based multi-domain meeting summarization task that generates a single short summary of meetings based on a transcript.
Outcome:	The proposed task is based on 1,808 query-summary pairs over 232 meetings in multiple domains.

Copied to clipboard

Po-Nien Kung, Tse-Hsuan Yang, Yi-Cheng Chen, Sheng-Siang Yin, Yun-Nung Chen

Extending Complex Logical Queries on Uncertain Knowledge Graphs (2025.acl-long)

Challenge:	Existing methods to extract rationales from input text are difficult and impractical.
Approach:	They propose a method that leverages multi-task learning and transfer learning to generate rationales through question answering in a zero-shot fashion.
Outcome:	The proposed method achieves comparable or even better performance without supervised signal for two benchmark rationalization datasets.

Copied to clipboard

Weizhi Fei, Zihao Wang, Hang Yin, Yang Duan, Yangqiu Song

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)

Challenge:	Existing studies on logical queries on knowledge graphs overlook the incompleteness of KGs.
Approach:	They propose an ML-based approach to answer soft queries on uncertain knowledge . they propose to use forward inference and backward calibration to avoid catastrophic errors .
Outcome:	The proposed method ensures there are no catastrophic cascading errors while maintaining the same complexity as state-of-the-art inference algorithms for first-order queries.

Copied to clipboard

Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li

Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data (2022.acl-long)

Challenge:	Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin.
Approach:	They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation.
Outcome:	The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin.

Copied to clipboard

Shuyan Zhou, Li Zhang, Yue Yang, Qing Lyu, Pengcheng Yin, Chris Callison-Burch, Graham Neubig

CTR-Guided Generative Query Suggestion in Conversational Search (2025.emnlp-industry)

Challenge:	Existing work has treated procedures as shallow structures without modeling the parent-child relation.
Approach:	They propose to construct an open-domain hierarchical knowledge-base (KB) of procedures based on wikiHow . they link steps in an article to other articles with similar goals, recursively building the KB .
Outcome:	The proposed method significantly outperforms baselines according to automatic evaluation, human judgment, and application to downstream tasks such as instructional video retrieval.

Copied to clipboard

Erxue Min, Hsiu-Yuan Huang, Xihong Yang, Min Yang, Xin Jia, Yunfang Wu, Hengyi Cai, Junfeng Wang, Shuaiqiang Wang, Dawei Yin

Natural Language Interfaces

Challenge:	Generating effective query suggestions requires aligning model outputs with user click preferences.
Approach:	They propose a generative framework that leverages click modeling to denoise implicit feedback and enables reliable preference optimization for improving real-world user engagement.
Outcome:	The proposed framework outperforms strong baselines in CTR, relevance, diversity and diversity.

UniCoder: Scaling Code Large Language Model via Universal Code (2024.acl-long)

Copied to clipboard

Tao Sun, Linzheng Chai, Jian Yang, Yuwei Yin, Hongcheng Guo, Jiaheng Liu, Bing Wang, Liqun Yang, Zhoujun Li

Contextual Modeling for Document-level ASR Error Correction (2024.lrec-main)

Challenge:	Experimental results show that UniCoder with the universal code significantly outperforms the previous prompting methods by a large margin.
Approach:	They introduce the universal code (UniCode) as the intermediate representation of algorithm steps using conventions of programming languages.
Outcome:	The proposed model outperforms previous prompting methods by a large margin . the proposed model is based on a dataset of natural-language questions and code solutions .

Copied to clipboard

Jin Jiang, Xunjian Yin, Xiaojun Wan, Wei Peng, Rongjun Li, Jingyuan Yang, Yanquan Zhou

SAME: Signer-Aware Mixture-of-Experts for Test-Time Adaptation in Sign Language Translation (2026.acl-long)

Challenge:	Existing work on document-level ASR error correction ignores contextual information . however, there are limited studies on incorporating contextual information into AEC .
Approach:	They propose a context-aware method that retrieves contextual information from a datastore . they use two English and two Chinese datasets to model document-level AEC .
Outcome:	The proposed model can utilize contextual information to improve document-level AEC . the data store containing contextual information provides even better results .

Copied to clipboard

Lujia Yang, Weicai Yan, Yongbo He, Qifei Zhang, Tao Jin, Jinshan Zhang, Meng Xi, Jianwei Yin

Machine Translation

Challenge:	Existing methods for supervised fine-tuning are limited due to labeled data . existing methods require long adaptation times and batch statistics are unavailable in streaming settings .
Approach:	They propose a plug-and-play, signer-aware Mixture-of-Experts (MoE) TTA architecture for SLT . they use a combination of lightweight MoE modules and unsupervised regularizers to decouple domain shift .
Outcome:	The proposed test-time adaptation outperforms existing TTA methods in sign language translation . the proposed architecture can be used in real-world deployments without labeling .

Chinese Morpheme-informed Evaluation of Large Language Models (2024.lrec-main)

Copied to clipboard

Yaqi Yin, Yue Wang, Yang Liu

Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering (2025.emnlp-main)

Challenge:	Existing evaluations of large language models focused on the perspective of various tasks or abilities.
Approach:	They propose to evaluate large language models from a linguistic perspective and use morpheme to measure morphology and syntax.
Outcome:	The proposed model outperforms ChatGPT in Chinese scenarios with a morpheme-informed benchmark and human exam questions.

Copied to clipboard

Zetong Li, Qinliang Su, Minhua Huang, Yin Yang

StructBreak: Structural Cognitive Overload-Induced Safety Failures in MLLMs (2026.findings-acl)

Challenge:	Existing methods for text clustering use static pseudo-oracles, i.e., unidirectionally querying them for similarity assessment or data augmentation.
Approach:	They propose a training framework that enables bidirectional refinement between LLMs and embedding models by using task-aware prompts to guide the LLM in generating interpretations for the input texts.
Outcome:	Experiments on 14 benchmark datasets across 5 tasks demonstrate the effectiveness of the proposed training framework.

Copied to clipboard

Yang Luo, Liu Xinran, TianTian Ji, Zhiyi Yin, Lingyun Peng, Shuyu Li

Robustness in NLP

Challenge:	Prior work focused on typographic and pixel-level perturbations, leaving the study of SCO unexplored.
Approach:	They propose a framework that exploits MLLMs' diagrammatic reasoning capabilities to bypass safety guardrails.
Outcome:	The proposed framework exploits the model's reasoning capabilities to bypass safety guardrails.

Weights-Rotated Preference Optimization for Large Language Models (2025.emnlp-main)

Copied to clipboard

Chenxu Yang, Ruipeng Jia, Mingyu Zheng, Naibin Gu, Zheng Lin, Siyuan Chen, Weichong Yin, Hua Wu, Weiping Wang

CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation (2023.findings-emnlp)

Challenge:	Existing methods to align large language models with high reward hacking are limited by the complexity of the parameter space and the complexity.
Approach:	They propose a weights-rotated preference optimization algorithm that constrains the output layer logits with the KL divergence inherited from DPO and fine-tunes the intermediate hidden states.
Outcome:	The proposed algorithm achieves a 3.27-point improvement on AlpacaEval 2 and surpasses the best baseline by 6.2 to 7.5 points on MT-Bench with merely 0.015% of the trainable parameters.

Copied to clipboard

Lianzhang Lou, Xi Yin, Yutao Xie, Yang Xiang

KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding (2025.findings-acl)

Challenge:	Multilingual machine translation (MMT) has gained more importance due to international business development and cross-cultural exchanges.
Approach:	They propose to use Chinese-centric MMT evaluation dataset to build an impartial and representative evaluation benchmark.
Outcome:	The proposed dataset covers more diverse linguistic features than other benchmarks and is highly representative and humancorrelated.

Copied to clipboard

Zhangchen Xu, Yang Liu, Yueqin Yin, Mingyuan Zhou, Radha Poovendran

ATRI: Mitigating Multilingual Audio Text Retrieval Inconsistencies by Reducing Data Distribution Errors (2025.acl-long)

Challenge:	Existing code-focused resources typically fail to ensure either the breadth of coverage or verifiable correctness.
Approach:	They propose a synthetic dataset that provides high-quality, verifiable training data for Large Language Models for coding.
Outcome:	The proposed dataset surpasses Qwen2.5-Coder-32B-Instruct and DeepSeek-R1-Distill-Llama-70B in performance on coding benchmarks.

Copied to clipboard

Yuguo Yin, Yuxin Xie, Wenyuan Yang, Dongchao Yang, Jinghan Ru, Xianwei Zhuang, Liming Liang, Yuexian Zou

3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding (2023.emnlp-main)

Challenge:	Existing multilingual audio-text retrieval schemes suffer from inconsistencies for instance similarity matching across languages.
Approach:	They propose a multilingual audio-text retrieval scheme that mitigates the impact of data distribution error on recall and consistency.
Outcome:	The proposed scheme achieves state-of-the-art performance on recall and consistency metrics for eight mainstream languages, including English.

Copied to clipboard

Zehan Wang, Haifeng Huang, Yang Zhao, Linjun Li, Xize Cheng, Yichen Zhu, Aoxiong Yin, Zhou Zhao

Permutative Preference Alignment from Listwise Ranking of Human Judgments (2025.emnlp-main)

Challenge:	3D visual grounding aims to localize the desired objects in a 3D point cloud by a free-form language description.
Approach:	They propose a relation-aware framework which captures relative spatial relationships between objects and enhances object attributes.
Outcome:	The proposed framework outperforms state-of-the-art methods on three benchmarks . it captures relative spatial relationships between objects and enhances object attributes .

Copied to clipboard

Yang Zhao, Yixin Wang, Mingzhang Yin

Challenge:	Existing methods to align Large Language Models with human preferences are based on the Bradley-Terry model, but when multiple responses are available, the B-T model fails to guarantee an accurate list ranking of the responses.
Approach:	They propose an offline listwise approach that incorporates the Normalized Discounted Cumulative Gain (NDCG) as an alternative training objective for LLM alignment.
Outcome:	The proposed approach outperforms existing pairwise and listwise methods on evaluation sets and general benchmarks such as AlpacaEval.

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation (2023.acl-long)

Copied to clipboard

Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan

OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Challenge:	Existing work generates long videos segment by segment sequentially, which is inefficient.
Approach:	They propose a Diffusion over Difference architecture for eXtremely Long video generation.
Outcome:	The proposed architecture reduces the average inference time from 7.55min to 26s (94.26%) and generates high-quality long videos with both global and local coherence.

Copied to clipboard

Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu

AEA: Adaptive Expert Allocation Improves Sentence Embeddings from Mixture-of-Experts LLM (2026.acl-long)

Challenge:	a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach:	They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome:	The proposed agents are based on operating systems (OS) and operating systems frameworks.

Copied to clipboard

Shufan Yang, Zifeng Cheng, Zhiwei Jiang, Qingfeng Qi, Yafeng Yin, Cong Wang, Ao Zhou, Qing Gu

Meta Distant Transfer Learning for Pre-trained Language Models (2021.emnlp-main)

Challenge:	Existing methods to improve embeddings from Mixture-of-Experts models allocate a fixed number of experts uniformly across all layers and tokens, ignoring inter-layer and inter-token heterogeneity.
Approach:	They propose an Adaptive Expert Allocation framework that performs layer-wise and token-wise expert allocation to enhance embedding quality.
Outcome:	The proposed method improves embedding quality across multiple MoE models.

Copied to clipboard

Chengyu Wang, Haojie Pan, Minghui Qiu, Jun Huang, Fei Yang, Yin Zhang

NewsDialogues: Towards Proactive News Grounded Conversation (2023.findings-acl)

Challenge:	Notable PLMs are available for text classification tasks, but performance of PLM on downstream tasks may be limited by the availability of training set.
Approach:	They propose a meta-learning framework to learn the transferable knowledge across tasks using PLMs.
Outcome:	The proposed framework outperforms baselines on seven datasets and is task-agnostic and unbiased.

Copied to clipboard

Siheng Li, Yichun Yin, Cheng Yang, Wangjie Jiang, Yiwei Li, Zesen Cheng, Lifeng Shang, Xin Jiang, Qun Liu, Yujiu Yang

Natural Language Interfaces

Challenge:	Hot news is one of the most popular topics in daily conversations.
Approach:	They propose a task where a dialogue system can lead the conversation based on key topics of the news.
Outcome:	The proposed method can lead conversations based on key topics of the news . it can also be used in information-seeking and chit-chat scenarios .

SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)

Copied to clipboard

Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song

The Fall of ROME: Understanding the Collapse of LLMs in Model Editing (2024.findings-emnlp)

Challenge:	Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used.
Approach:	They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark.
Outcome:	The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history.

Copied to clipboard

Wanli Yang, Fei Sun, Jiajun Tan, Xinyu Ma, Du Su, Dawei Yin, Huawei Shen

Efficient Multi-Task Auxiliary Learning: Selecting Auxiliary Data by Feature Similarity (2021.emnlp-main)

Challenge:	Recent studies have found that model editing methods can cause large language models to collapse with just a single edit.
Approach:	They propose a method that uses prefixed keys and adds prefixes during testing to prevent model collapse.
Outcome:	The proposed method prevents model collapse while maintaining effectiveness, the authors show . Rank-One Model Editing (ROME) has been found to cause model collapse with just a single edit .

Copied to clipboard

Po-Nien Kung, Sheng-Siang Yin, Yi-Cheng Chen, Tse-Hsuan Yang, Yun-Nung Chen

MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL (2025.coling-main)

Challenge:	Multi-task auxiliary learning uses a set of relevant auxiliary tasks to improve performance of a primary task.
Approach:	They propose a time-efficient sampling method to select the most beneficial sub-datasets from the auxiliary tasks to achieve efficient multi-task auxiliary learning.
Outcome:	The proposed method significantly outperforms random sampling and ST-DNN on three benchmark datasets.

Copied to clipboard

Bing Wang, Changyu Ren, Jian Yang, Xinnian Liang, Jiaqi Bai, LinZheng Chai, Zhao Yan, Qian-Wen Zhang, Di Yin, Xing Sun, Zhoujun Li

Programming Languages in NLP

Challenge:	Recent LLM-based Text-to-SQL methods suffer from performance degradation on “huge” databases and complex user questions that require multi-step reasoning.
Approach:	They propose a framework that integrates a decomposer agent and auxiliary agents to generate SQL queries from natural language text.
Outcome:	The proposed framework achieves comparable execution accuracy on SQL-Llama tasks compared to the baseline model.

Learn to Cross-lingual Transfer with Meta Graph Learning Across Heterogeneous Languages (2020.emnlp-main)

Copied to clipboard

Zheng Li, Mukul Kumar, William Headden, Bing Yin, Ying Wei, Yu Zhang, Qiang Yang