Papers by Qingyu Wang
ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue (2026.findings-acl)
Copied to clipboard
Jiawei Shen, Jia Zhu, Hanghui Guo, Weijie Shi, Yue Cui, Qingyu Niu, Guoqing Ma, Jingjiang Liu, Yidan Liang, Yilin Wang, Shimin Di, Jiajie Xu
| Challenge: | Existing approaches to multi-turn dialogues lack contextual consistency and dependencies, and models struggle to maintain factual faithfulness as interaction turns increase. |
| Approach: | They propose an adaptive context refactoring framework that monitors and reshapes the interaction history to mitigate contextual inertia and state drift. |
| Outcome: | The proposed model outperforms baselines while reducing token consumption. |
DrAgent: Empowering Large Language Models as Medical Agents for Multi-hop Medical Reasoning (2025.findings-emnlp)
Copied to clipboard
Fenglin Liu, Zheng Li, Hongjian Zhou, Qingyu Yin, Jingfeng Yang, Xin Liu, Zhengyang Wang, Xianfeng Tang, Shiyang Li, Xiang He, Ruijie Wang, Bing Yin, Xiao Gu, Lei Clifton, David A. Clifton
| Challenge: | commercial LLMs can be difficult to use in real-world clinical decision-making . a lightweight LLM can be used to collaborate with diverse clinical tools . |
| Approach: | They propose a lightweight LLM that can be used to build medical LLMs as agents . they use recursive curriculum learning to optimize the LLM in an easy-to-hard progression . |
| Outcome: | The proposed approach outperforms human experts in medical examinations on diverse datasets. |
IterAlign: Iterative Constitutional Alignment of Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Empirical results show that iterAlign improves truthfulness, helpfulness, harmlessness and honesty, improving the LLM alignment by up to 13.5% in harmlessness. |
| Approach: | They propose a data-driven constitution discovery and self-alignment framework called IterAlign to overcome these drawbacks by leveraging red teaming to uncover weaknesses of an LLM. |
| Outcome: | Empirical results show that iterAlign improves truthfulness, helpfulness, harmlessness and honesty by up to 13.5%. |
Zero Pronoun Resolution with Attention-based Neural Network (C18-1)
Copied to clipboard
| Challenge: | Recent neural network methods for zero pronoun resolution use contextual information to encode the zero pronomins since they contain no actual content. |
| Approach: | They propose a self-attention mechanism for encoding zero pronouns that focus on some informative parts of the associated texts and produce an efficient way of encode them. |
| Outcome: | The proposed model significantly surpasses existing Chinese zero pronoun resolution baseline systems. |
Knowledge-Selective Pretraining for Attribute Value Extraction (2023.findings-emnlp)
Copied to clipboard
Hui Liu, Qingyu Yin, Zhengyang Wang, Chenwei Zhang, Haoming Jiang, Yifan Gao, Zheng Li, Xian Li, Chao Zhang, Bing Yin, William Wang, Xiaodan Zhu
| Challenge: | Existing methods for AVE are limited on rare attributes due to poor generalization ability. |
| Approach: | They propose to leverage pretraining and transfer learning to address weaknesses in existing methods. |
| Outcome: | The proposed method achieves new state-of-the-art performance without pretraining on rare attributes with limited training resources. |
A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction (2026.findings-acl)
Copied to clipboard
Chengguang Gan, Sunbowen Lee, Qingyu Yin, Yunhao Liang, Xinyang He, Hanjun Wei, Younghun Lim, Shijian Wang, Hexiang Huang, QingHao Zhang, Shiwen Ni, Tatsunori Mori
| Challenge: | Existing work on the Mutual Reinforcement Effect in information extraction has not been empirically validated . 76 percent of the 21 sub-datasets exhibit the Mutual Reforcement effect across languages . |
| Approach: | They propose a multilingual MRE mix dataset that integrates 21 sub-datasets covering English, Japanese, and Chinese. |
| Outcome: | The proposed framework reduces manual annotation effort while preserving structural requirements of MRE tasks. |
IHEval: Evaluating Language Models on Following the Instruction Hierarchy (2025.naacl-long)
Copied to clipboard
Zhihan Zhang, Shiyang Li, Zixuan Zhang, Xin Liu, Haoming Jiang, Xianfeng Tang, Yifan Gao, Zheng Li, Haodong Wang, Zhaoxuan Tan, Yichuan Li, Qingyu Yin, Bing Yin, Meng Jiang
| Challenge: | Instruction-tuned language models (LMs) are increasingly deployed as interactive services across various applications. |
| Approach: | They propose a benchmark to evaluate models' ability to follow the instruction hierarchy by comparing their models to a set of benchmarks. |
| Outcome: | The proposed benchmark covers 3,538 examples across nine tasks covering cases where instructions in different priorities either align or conflict. |
MEVTR: A Multilingual Model Enhanced with Visual Text Representations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models that generate multilingual text representations perform poorly on low-resource languages due to lack of representation space and model capacity. |
| Approach: | They propose a multilingual model enhanced with visual text representations which complements textual representations and extends multilingual representation space with visual representations. |
| Outcome: | The proposed model outperforms state-of-the-art models on zero-shot cross-lingual transfer tasks without the target language adapter. |
Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct erroneous characters for usergenerated text in Chinese. |
| Approach: | They propose a Chinese spell checker that leverages multimodal Chinese characters' information to predict the correct output. |
| Outcome: | The proposed model outperforms strong baselines on the SIGHAN benchmarks by a large margin. |
MTLS: Making Texts into Linguistic Symbols (2024.emnlp-main)
Copied to clipboard
| Challenge: | In linguistics, all languages can be considered as symbolic systems . most work overlooks the properties of languages as symbol systems - aaron et al., 1989). |
| Approach: | They propose a method to make texts into linguistic symbols to improve multilingual capability . they use a pre-training method to replace pre-trained language models with a vocabulary map . |
| Outcome: | The proposed method improves multilingual capabilities on multilingual tasks using BERT and RoBERTa as the backbone. |
Can Language Models Follow Multiple Turns of Entangled Instructions? (2025.findings-emnlp)
Copied to clipboard
Chi Han, Xin Liu, Haodong Wang, Shiyang Li, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Qingyu Yin, Liang Qiu, Changlong Yu, Yifan Gao, Zheng Li, Bing Yin, Jingbo Shang, Heng Ji
| Challenge: | Despite of significant achievements in improving instruction-following capabilities of large language models, the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge. |
| Approach: | They construct multi-turn instruction with 1.1K high-quality multi-turned conversations using the human-in-the-loop approach and examine their capabilities. |
| Outcome: | The proposed model shows that it is difficult to integrate multiple turns and balance competing objectives when instructions intersect or conflict. |
Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for shaping large reasoning models rely on reinforcement learning or fine-tuning with gold-standard reasoning traces. Existing techniques for behavior shaping rely only on additional reward modeling. |
| Approach: | They propose a framework that aligns a model's self-concept with a target belief blueprint and internalizes desired traits by fine-tuning on synthesized, self-reflective QA pairs that affirm the target belief. |
| Outcome: | The proposed framework outperforms behavior-supervised and preference-based models while requiring significantly lower training costs. |
Improving Consistency for Text Summarization with Energy Functions (2023.findings-emnlp)
Copied to clipboard
Qi Zeng, Qingyu Yin, Zheng Li, Yifan Gao, Sreyashi Nag, Zhengyang Wang, Bing Yin, Heng Ji, Chao Zhang
| Challenge: | Current abstractive summarization models generate inconsistent content due to the inherently noisy dataset and the discrepancy between maximum likelihood estimation based training objectives and consistency measurements. |
| Approach: | They propose a new consistency taxonomy that categorizes inconsistent content into faithfulness, factuality, and self-supportiveness. |
| Outcome: | Experiments on XSUM and CNN/DM datasets show that EnergySum mitigates the trade-off between accuracy and consistency. |
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect (2025.findings-acl)
Copied to clipboard
Xin Men, Mingyu Xu, Qingyu Zhang, Qianhao Yuan, Bingning Wang, Hongyu Lin, Yaojie Lu, Xianpei Han, Weipeng Chen
| Challenge: | Recent studies have identified significant redundancy in large language models . quantization and pruning are two methods that reduce computational resources . |
| Approach: | They propose simple pruning methods that prune redundant layers based on their BI scores. |
| Outcome: | The proposed pruning methods demonstrate superior performance over previous pruning methods. |
From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for writing reward models are coarse-grained. |
| Approach: | They propose a benchmark and a fine-grained training framework to evaluate writing reward models. |
| Outcome: | The proposed model improves on various writing benchmarks and exhibits strong generalization. |
AutoAlign: Get Your LLM Aligned with Minimal Annotations (2025.acl-demo)
Copied to clipboard
Xinyu Lu, Dong Xu, Chunkang Zhang, Xinyan Guan, Junxiang Wang, Qingyu Zhang, Pengbo Wang, Yingzhi Mao, Hao Xiang, Xueru Wen, Zichao Li, Yaojie Lu, Hongyu Lin, Le Sun, Xianpei Han
| Challenge: | Automated Alignment (ALM) is a set of algorithms designed to align Large Language Models (LLMs) with human intentions and values while minimizing manual intervention. |
| Approach: | They propose an open-source toolkit that integrates mainstream automated algorithms through a consistent interface and an accessible workflow supporting one-click execution for prompt synthesis and automatic alignment signal construction. |
| Outcome: | The proposed framework enables easy reproduction of existing results through extensive benchmarks and facilitates the development of novel approaches via modular components. |
Towards Explainable NLP: A Generative Explanation Framework for Text Classification (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for explainable machine learning systems focus on interpreting outputs or connections between inputs and outputs. |
| Approach: | They propose a generative explanation framework that learns to make classification decisions and generates fine-grained explanations at the same time. |
| Outcome: | The proposed framework surpasses all baselines on two datasets and generates concise explanations at the same time. |
RSDA: Restoring Stale Data Affinity via Dynamic Renovation Strategy for Mitigating Data Scarcity (2026.acl-long)
Copied to clipboard
Yidan Liang, Jia Zhu, Weijie Shi, Hanghui Guo, Yue Cui, Jiawei Shen, Guoqing Ma, Jingjiang Liu, Qingyu Niu, Yilin Wang, Shimin Di, Jiajie Xu
| Challenge: | High-quality data is the cornerstone of advancing large language models, but the supply of premium data is nearing depletion, while vast stale corpora remain underutilized. |
| Approach: | They propose a framework to restore stale data affinity by quantifying the latent value of samples and employing a dynamic renovation strategy selection mechanism to determine the optimal component-level strategy. |
| Outcome: | The proposed framework achieves performance improvements using less than 10% of the data volume, underscoring that the latent potential of stale corpora remains largely untapped. |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)
Copied to clipboard
Yu Zou, Yan Chen, Lida He, Qi Zhou, Xiaorui Zhou, Aixi Zhong, Yi Wang, Wei Li, Qingyu Wang, Jiatao Li, Wei Gong, Jialei Zeng, Jingmei Zhao, Ke Jiang, Qing Li
| Challenge: | Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge. |
| Approach: | They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage. |
| Outcome: | The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold. |
Identifying Collective Intelligence Factor in LLM Agent Groups for Generalizable Multi-Agent System Design (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior studies have focused on designing customized MAS for specific tasks . a critical research question remains: do LLM agent groups exhibit a form of "general intelligence" |
| Approach: | They find a Collective Intelligence factor in human groups that captures their general capability. |
| Outcome: | The proposed model predicts the ACI factor based on the features of LLM agent groups and can improve generalization abilities. |
KCVR: Knowledge-Centric Video Reconstruction for Structured Pedagogical Summarization via Dynamic Graph Planning (2026.acl-long)
Copied to clipboard
Jingjiang Liu, Jia Zhu, Hanghui Guo, Weijie Shi, Yue Cui, Xiaokang Jin, Yilin Wang, Qingyu Niu, Jiawei Shen, Guoqing Ma, Yidan Liang, Shimin Di, Jiajie Xu
| Challenge: | Existing summarization methods compress content for gist browsing, but they break prerequisite logic in instructional videos. |
| Approach: | They propose a framework that decouples epistemic planning from content generation. |
| Outcome: | The proposed framework outperforms strong end-to-end baselines on Knowledge Progression Consistency and Learning Objective Coverage. |
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to tagging tasks are limited to predefined classes and require large-scale annotated data. |
| Approach: | They propose an Enhanced Span-based Decomposition method for Few-Shot Sequence Labeling to generalize on emerging, resource-scare domains. |
| Outcome: | The proposed method achieves state-of-the-art results on two popular FSSL benchmarks, FewNERD and SNIPS, and is more robust in noisy and nested tagging scenarios. |
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)
Copied to clipboard
Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, Mahani Aljunied, Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing
| Challenge: | Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages. |
| Approach: | They propose a series of language models that specifically focuses on Southeast Asian languages. |
| Outcome: | SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations . |
MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding (2024.emnlp-main)
Copied to clipboard
Baixuan Xu, Weiqi Wang, Haochen Shi, Wenxuan Ding, Huihao Jing, Tianqing Fang, Jiaxin Bai, Xin Liu, Changlong Yu, Zheng Li, Chen Luo, Qingyu Yin, Bing Yin, Long Chen, Yangqiu Song
| Challenge: | Existing methods for acquiring large-scale intentions generate product-centric intentions without product images and incur high costs for scalability. |
| Approach: | They propose a multimodal framework that allows Large Vision-Language Models to infer purchase intentions from multimodal product metadata and prioritize human-centric ones. |
| Outcome: | The proposed framework shows that it is robust to different prompts and superior to previous methods. |
Why Safeguarded Ships Run Aground? Aligned Large Language Models’ Safety Mechanisms Tend to Be Anchored in The Template Region (2025.acl-long)
Copied to clipboard
| Challenge: | Infilling a fixed template between the input instruction and initial model output is a common practice for existing LLMs, but it is vulnerable to inference-time jailbreak attacks. |
| Approach: | They propose to fill a fixed template between the input instruction and initial model output and to detach safety mechanisms from the template region to mitigate the risk of inference-time jailbreak attacks. |
| Outcome: | The proposed method is widespread across aligned LLMs and shows that it mitigates inference-time jailbreak vulnerabilities. |
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce (2024.findings-emnlp)
Copied to clipboard
Wenxuan Ding, Weiqi Wang, Sze Kwok, Minghao Liu, Tianqing Fang, Jiaxin Bai, Xin Liu, Changlong Yu, Zheng Li, Chen Luo, Qingyu Yin, Bing Yin, Junxian He, Yangqiu Song
| Challenge: | Existing approaches that distill intentions from LMs fail to generate meaningful and human-centric intentions applicable in real-world E-commerce contexts. |
| Approach: | They propose a double-task multiple-choice question answering benchmark to evaluate LMs' comprehension of purchase intentions in E-commerce. |
| Outcome: | The proposed benchmark consists of 4,360 carefully curated problems across three difficulty levels, constructed using an automated pipeline to ensure scalability on large E-commerce platforms. |
Deep Reinforcement Learning for Chinese Zero Pronoun Resolution (P18-1)
Copied to clipboard
| Challenge: | Recent models for zero pronoun resolution in Chinese are short-sighted and do not capture semantic information for zeros and candidate antecedents. |
| Approach: | They propose to integrate a deep reinforcement learning approach to Chinese zero pronoun resolution. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods in three experimental settings. |
Dialogue Response Selection with Hierarchical Curriculum Learning (2021.acl-long)
Copied to clipboard
Yixuan Su, Deng Cai, Qingyu Zhou, Zibo Lin, Simon Baker, Yunbo Cao, Shuming Shi, Nigel Collier, Yan Wang
| Challenge: | Empirical studies on three benchmark datasets with three state-of-the-art matching models demonstrate that the proposed learning framework significantly improves the model performance across various evaluation metrics. |
| Approach: | They propose a hierarchical curriculum learning framework that trains matching models in an “easy-to-difficult” scheme. |
| Outcome: | The proposed framework significantly improves the model performance across evaluation metrics on three benchmark datasets with three state-of-the-art matching models. |
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Fine-tuning and in-context learning are two prevalent methods in imbuing large language models with task-specific knowledge. |
| Approach: | They propose to use a circuit shift theory to explain why in-context learning is superior to fine-tuning for tasks with implicit patterns. |
| Outcome: | The proposed method can grasp deep patterns and significantly improve accuracy on implicit patterns, compared with fine-tuning and in-context learning. |
SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)
Copied to clipboard
Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
| Challenge: | Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used. |
| Approach: | They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark. |
| Outcome: | The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history. |
Beyond Correctness: Confidence-Aware Reward Modeling for Enhancing Large Language Model Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shifted the post-training paradigm from instruction tuning and human preference alignment to reinforcement learning (RL) based on rule-based evaluations of answer correctness, these models often receive rewards for speculative answers without generating coherent reasoning chains. |
| Approach: | They propose a confidence-based reward model tailored for enhancing STEM reasoning capabilities. |
| Outcome: | The proposed model outperforms state-of-the-art open-source reward models across diverse STEM benchmarks. |
The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking (2022.findings-acl)
Copied to clipboard
Yinghui Li, Qingyu Zhou, Yangning Li, Zhongli Li, Ruiyang Liu, Rongyi Sun, Zizhen Wang, Chao Li, Yunbo Cao, Hai-Tao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct spelling errors, which are caused by the phonological or visual similarity. |
| Approach: | They propose an Error-driven COntrastive Probability Optimization framework to refine the knowledge representations of pre-trained language models to avoid predicting common characters. |
| Outcome: | Extensive experiments and detailed analyses on SIGHAN datasets demonstrate that ECOPO is simple yet effective. |