Papers by Yi Yan
A Deep Learning-Based System for PharmaCoNER (D19-57)
Copied to clipboard
Ying Xiong, Yedan Shen, Yuanhang Huang, Shuai Chen, Buzhou Tang, Xiaolong Wang, Qingcai Chen, Jun Yan, Yi Zhou
| Challenge: | Efficient access to mentions of clinical entities is very important for using clinical text. |
| Approach: | They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 . |
| Outcome: | The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2. |
ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge (2025.emnlp-main)
Copied to clipboard
Chaoyue He, Xin Zhou, Yi Wu, Xinjia Yu, Yan Zhang, Lei Zhang, Di Wang, Shengfei Lyu, Hong Xu, Wang Xiaoqiao, Wei Liu, Chunyan Miao
| Challenge: | ESGenius is a comprehensive benchmark for evaluating Large Language Models on ESG and sustainability knowledge. |
| Approach: | They introduce ESGenius, a benchmark for evaluating and enhancing ESG proficiency . they use a rigorous two-stage evaluation protocol and a repository of foundational frameworks . |
| Outcome: | ESGenius is a benchmark for evaluating and enhancing the proficiency of Large Language Models (LLMs) in ESG and sustainability-focused question answering. |
Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG methods focus on external retrieval, while ignoring the rich content of the model. |
| Approach: | They propose a framework that enhances explicit synergy over parametric and retrieved knowledge by integrating external retrieval components into the input context of the LLMs. |
| Outcome: | The proposed framework enhances explicit synergy over parametric and retrieved knowledge. |
Document-Level Relation Extraction with Global Relations and Entity Pair Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing document-level relation extraction models focus on individual entity pairs, limiting their ability to handle complex reasoning tasks. |
| Approach: | They propose a document-level relation extraction framework based on global relations and entity pair reasoning that captures fine-grained interactions between entity pairs. |
| Outcome: | The proposed framework outperforms existing models on widely-used datasets. |
RLKGF: Reinforcement Learning from Knowledge Graph Feedback Without Human Annotations (2025.findings-acl)
Copied to clipboard
| Challenge: | Lack of human preference labels remains a significant bottleneck when applying RLHF to a downstream domain. |
| Approach: | They propose a method that leverages human priors encoded in Knowledge Graphs (KGs) to derive RL rewards in the absence of manual annotations. |
| Outcome: | Experiments on three public and one private medical dialogue datasets show that the proposed method outperforms the competitive RLAIF in improving LLM diagnostic accuracy. |
SRF: Enhancing Document-Level Relation Extraction with a Novel Secondary Reasoning Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for document-level relation extraction ignore bidirectional mention interaction when generating relational features for entity pairs. |
| Approach: | They propose a document-level relation extraction model that incorporates bidirectional mention fusion and a simple yet effective evidence extraction module for relation prediction. |
| Outcome: | The proposed model achieves SOTA performance and the proposed method is effective and general when integrated into existing models. |
Agri-CM3: A Chinese Massive Multi-modal, Multi-level Benchmark for Agricultural Understanding and Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks lack comprehensive evaluations, particularly in multi-level reasoning, making it difficult to identify model limitations. |
| Approach: | They propose to use Agri-CM3 to assess multi-level reasoning in agricultural management by integrating multiple data modalities. |
| Outcome: | The Agri-CM3 benchmark includes 3,939 images and 15,901 multi-level multiple-choice questions with detailed explanations. |
SocialEval: Evaluating Social Intelligence of Large Language Models (2025.acl-long)
Copied to clipboard
Jinfeng Zhou, Yuxuan Chen, Yihan Shi, Xuanming Zhang, Leqi Lei, Yi Feng, Zexuan Xiong, Miao Yan, Xunzhi Wang, Yaru Cao, Jianing Yin, Shuai Wang, Quanyu Dai, Zhenhua Dong, Hongning Wang, Minlie Huang
| Challenge: | Existing work on LLMs does not address their social intelligence (SI) and their discrepancy with humans. |
| Approach: | They propose a script-based bilingual SI benchmark that integrates outcome-oriented goal achievement evaluation and process-oriented interpersonal ability evaluation by manually crafting narrative scripts. |
| Outcome: | The proposed model is based on a script-based bilingual evaluation paradigm that integrates outcome- and process-oriented evaluation by manually crafting narrative scripts. |
Reinforcement Learning on Pre-Training Data (2026.acl-long)
Copied to clipboard
Siheng Li, Kejiao Li, Zenan Xu, Guanhua Huang, Kun Li, Haoyuan Wu, null Wujiajia, Zihao Zheng, Chenchen Zhang, Kun Shi, Xue Gong, Qi Yi, Ruibin Xiong, Tingqiang Xu, Yuhao Jiang, Jianfeng Yan, Yuyuan Zeng, Guanghui Xu, Jinbao Xue, Zhijiang xu, Zheng Fang, Shuai LI, Qibin Liu, Xiaoxue Li, Zhuoyu Li, Yangyu Tao, Fei Gao, Cheng Jiang, Bochao Wang, Kai Liu, Jianchen Zhu, Wai Lam, Bo Zhou, Di Wang
| Challenge: | Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings. |
| Approach: | They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data. |
| Outcome: | Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base. |
Demonstration Augmentation for Zero-shot In-context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated an impressive capability known as In-context Learning (ICL), which enables them to acquire knowledge from textual demonstrations without the need for parameter updates. |
| Approach: | They propose to use model’s previously predicted historical samples as demonstrations for subsequent ones to improve model’ s performance. |
| Outcome: | The proposed method significantly outperforms the previous method and its predecessors in terms of inference cost and time. |
DeepGen: Diverse Search Ad Generation and Real-Time Customization (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Existing systems that generate ads manually are not effective in generating ad copy and generating millions of ads for large businesses. |
| Approach: | They propose a system that generates fluent ads from advertiser’s web pages in an abstractive fashion and solves practical issues such as factuality and inference speed. |
| Outcome: | The proposed system generates fluent ads from advertiser’s web pages in an abstractive fashion and solves practical issues such as factuality and inference speed. |
Abstract Meaning Representation for Paraphrase Detection (N18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) parsing is ideal for paraphrase detection . it abstracts away from the syntactic realization of a sentence, and denotes only its meaning in a canonical form. |
| Approach: | They propose a technique that uses latent semantic analysis to translate sentences into AMR graphs . they show that the technique can be used to detect whether two sentences have the same meaning . |
| Outcome: | The proposed technique significantly advances state-of-the-art paraphrase detection for the Microsoft Research Paraphrase Corpus. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Chunks as Arms: Multi-Armed Bandit-Guided Sampling for Long-Context LLM Preference Optimization (2026.acl-long)
Copied to clipboard
Shaohua Duan, Pengcheng Huang, Xinze Li, Zhenghao Liu, Xiaoyuan Yi, Yukun Yan, Shuo Wang, Yu Gu, Ge Yu, Maosong Sun
| Challenge: | Recent studies have explored fine-tuning Large Language Models with synthetic data to enhance their long-context capabilities. |
| Approach: | They propose a framework that leverages a Multi-Armed Bandit rollout strategy to identify the most informative chunks from the given long context for sampling high-quality and diverse responses. |
| Outcome: | The proposed framework achieves 4% improvement on long-context reasoning benchmarks on Llama and Qwen. |
Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to steer LLMs towards human preference suffer from noisy positive-negative training pairs. |
| Approach: | They propose a distributional preference optimization method which maximizes discrepancy between dispreferred responses and generated non-negative ones. |
| Outcome: | The proposed method achieves comparable generation quality and surpasses the latest strong baselines in producing less harmful and more informative responses with better training stability and faster convergence. |
ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to radiology report generation lack inter-report consistency, exhibiting biases towards common patterns and susceptibility to lesion variants. |
| Approach: | They propose a method which improves the inter-report consistency of radiology report generation by extracting lesions from input images and examining their characteristics. |
| Outcome: | The proposed system captures similarities in semantically equivalent lesions and can be used to generate reports for two semantically identical cases. |
Dialogue Meaning Representation for Task-Oriented Dialogue Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on dialogue meaning representations is limited in scalability for complex expressions. |
| Approach: | They propose a pliable and easily extendable representation for task-oriented dialogue . they propose an inheritance hierarchy mechanism focusing on domain extensibility . |
| Outcome: | The proposed representation can be easily extended to a task-oriented dialogue dataset. |
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)
Copied to clipboard
Yu Zou, Yan Chen, Lida He, Qi Zhou, Xiaorui Zhou, Aixi Zhong, Yi Wang, Wei Li, Qingyu Wang, Jiatao Li, Wei Gong, Jialei Zeng, Jingmei Zhao, Ke Jiang, Qing Li
| Challenge: | Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge. |
| Approach: | They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage. |
| Outcome: | The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold. |
Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Visual Document Retrieval (VDR) is of importance in multimodal retrieval applications. |
| Approach: | They propose a two-stage pruning and merging frameworks that combine pruning and merge techniques to achieve higher compression rates. |
| Outcome: | The proposed framework outperforms existing methods on 29 visual document retrieval datasets. |
Graph-to-Tree Learning for Solving Math Word Problems (2020.acl-main)
Copied to clipboard
| Challenge: | Existing tree-based neural models do not capture the relationships and order information among the quantities well. |
| Approach: | They propose a novel deep learning architecture that combines the merits of the graph-based encoder and tree-based decoder to generate better solution expressions. |
| Outcome: | The proposed framework outperforms the state-of-the-art on two available datasets significantly. |
DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models (2025.emnlp-industry)
Copied to clipboard
Yi Shen, Jian Zhang, Jieyun Huang, Shuming Shi, Wenjing Zhang, Jiangze Yan, Ning Wang, Kai Wang, Zhaoxiang Liu, Shiguo Lian
| Challenge: | Recent advances in slow-thinking reasoning models have shown exceptional performance in complex reasoning tasks. |
| Approach: | They propose a framework that enables models to automatically adjust Chain-of-Thought (CoT) length based on problem difficulty. |
| Outcome: | The proposed framework penalizes inefficiency on simple problems while incentivizing deep reasoning for complex ones. |
NLoPT: N-gram Enhanced Low-Rank Task Adaptive Pre-training for Efficient Language Model Adaption (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained Language Models (PLMs) have superior performance on downstream tasks . however, conventional TAPT adjusts all parameters of the PLMs, which distorts the learned generic knowledge embedded in the original PLM's weights. |
| Approach: | They propose a two-step n-gram enhanced low-rank task adaptive pre-training method to customize a PLM to the downstream task. |
| Outcome: | The proposed method improves performance on six datasets from four domains. |
mABC: Multi-Agent Blockchain-inspired Collaboration for Root Cause Analysis in Micro-Services Architecture (2024.findings-emnlp)
Copied to clipboard
Wei Zhang, Hongcheng Guo, Jian Yang, Zhoujin Tian, Yi Zhang, Yan Chaoran, Zhoujun Li, Tongliang Li, Xu Shi, Liangfan Zheng, Bo Zhang
| Challenge: | Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes. |
| Approach: | They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis. |
| Outcome: | The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow. |
An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint (2025.emnlp-main)
Copied to clipboard
Yi Sun, Han Wang, Jiaqiang Li, Jiacheng Liu, Xiangyu Li, Hao Wen, Yizhen Yuan, Huiwen Zheng, Yan Liang, Yuanchun Li, Yunxin Liu
| Challenge: | Large Language Models (LLMs) are a powerful tool for test-time scaling, but they are often used under time constraints. |
| Approach: | They propose to use LLMs to make models think before answering questions . they also use self-correction and best-of-N decoding to encourage deeper thinking . |
| Outcome: | The proposed models are able to achieve higher inference accuracy with extra inference computation under time constraints. |
Zero-shot User Intent Detection via Capsule Neural Networks (D18-1)
Copied to clipboard
| Challenge: | Existing methods to classify intents are labor-intensive and time-consuming as intents will be diverse and new intents may be involved. |
| Approach: | They propose a zero-shot intent detection problem which aims to detect emerging user intents where no labeled utterances are currently available. |
| Outcome: | The proposed model can discriminate emerging intents when no labeled utterances are available in training data. |
RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to enhance radiology report generation overlook the knowledge already embedded within the models, leading to redundant information integration. |
| Approach: | They propose a framework for enhancing radiology report generation with supplementary knowledge injection that leverages both internal and external knowledge. |
| Outcome: | Extensive experiments on MIMIC-CXR, CheXpert-Plus, and IU X-ray show that the proposed model outperforms state-of-the-art LLMs in both language quality and clinical accuracy. |