Papers by Yuan Qu
Self-Criticism: Aligning Large Language Models with their Understanding of Helpfulness, Honesty, and Harmlessness (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models are useful, honest, harmless (HHH) however, RLHF requires high hardware resources and human efforts. |
| Approach: | They propose a framework that allows LLMs to align themselves with HHH . they use IF and reinforcement learning from human feedback to fine-tune their models . |
| Outcome: | The proposed framework achieves similar performance to RLHF and human-generated models with a minimal alignment tax. |
NAP2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Human (2025.findings-emnlp)
Copied to clipboard
Shuo Huang, William Maclean, Xiaoxi Kang, Qiongkai Xu, Zhuang Li, Xingliang Yuan, Gholamreza Haffari, Lizhen Qu
| Challenge: | a large number of large language models are being used to protect user privacy . sanitizing sensitive text using two common strategies is the answer . |
| Approach: | They propose sanitizing sensitive text using deleting expressions and abstracting them . they propose a tool for text rewriting that uses crowdsourcing and large language models . |
| Outcome: | The proposed approach protects privacy before sending sensitive data to large language models . it combines crowdsourcing and large language modeling to create a text rewrite tool . |
HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical Applications (2021.findings-acl)
Copied to clipboard
Qiao Cheng, Juntao Liu, Xiaoye Qu, Jin Zhao, Jiaqing Liang, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan, Yanghua Xiao
| Challenge: | Relation extraction (RE) is an essential topic in natural language processing and has attracted extensive attention. |
| Approach: | They propose a case-oriented construction framework to build a hard case relation extraction dataset with 65,225 relational facts annotated from 9,231 documents. |
| Outcome: | The proposed model achieves a high 96% F1 score on data quality and is far lower than humans. |
ULMR: Unlearning Large Language Models via Negative Response and Model Parameter Average (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have attracted significant interest from the research community due to their broad applicability in many language-oriented tasks. |
| Approach: | They propose a framework which uses pre-training datasets to rewrite instructions and generate negative responses to preserve the performance of the original LLM. |
| Outcome: | The proposed framework can erase the pre-training data while maintaining the performance of the original model. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
Delving Deep into Regularity: A Simple but Effective Method for Chinese Named Entity Recognition (2022.findings-naacl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a system for identifying text spans pertaining to specific entity types. |
| Approach: | They propose a method to investigate the regularity of Chinese NER's entity mentions by a regularity-aware module and a periodicity-gnostic module. |
| Outcome: | The proposed model significantly outperforms previous state-of-the-art methods on three benchmark datasets and a practical medical dataset. |
CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)
Copied to clipboard
Yizhi Li, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li, Noah Wang, Hao Li, Ruibin Yuan, Yinghao Ma, Kai Zhang, Wangchunshu Zhou, Yiming Liang, Lei Zhang, Lei Ma, Jiajun Zhang, Zuowen Li, Wenhao Huang, Chenghua Lin, Jie Fu
| Challenge: | a recent study shows that large language models have limited generalization in low-resource languages like Chinese. |
| Approach: | They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private . |
| Outcome: | The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language. |
PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) has been used to adapt Large Language Models to a variety of tasks, but it requires substantial computational resources to perform. |
| Approach: | They propose a low-rank adaptive learning approach that leverages LoRA's in-context learning capability through prompt matching via reinforcement learning in resource-constrained environments. |
| Outcome: | The proposed model improves LoRA performance on evaluation metrics and utilises consumer-grade GPU resources. |
Zero-Shot Privacy-Aware Text Rewriting via Iterative Tree Search (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text anonymization and de-identification struggle to balance privacy preservation with text naturalness and utility. |
| Approach: | They propose a tree-search-based iterative sentence rewriting algorithm that obfuscates or deletes private information while preserving coherence, relevance, and naturalness. |
| Outcome: | The proposed algorithm outperforms existing baselines on privacy-sensitive datasets. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
TREA: Tree-Structure Reasoning Schema for Conversational Recommendation (2023.acl-long)
Copied to clipboard
| Challenge: | Recent reasoning-based models cannot fully figure out complex causal relationships between mentioned entities with external knowledge. |
| Approach: | They propose a Tree structure Reasoning schEmA that constructs a multi-hierarchical scalable tree as the reasoning structure to clarify the causal relationships between mentioned entities. |
| Outcome: | Extensive experiments on two public CRS datasets show the proposed model works. |
SaFER: A Robust and Efficient Framework for Fine-tuning BERT-based Classifier with Noisy Labels (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing noise-handling methods could not improve performance of BERT on noisy datasets . existing methods could only improve performance on noisy data, authors say . |
| Approach: | They propose a fine-tuning framework for BERT-based text classifiers that combats label noises without access to clean data for training or validation. |
| Outcome: | The proposed framework achieves superior performance on multiple text classification benchmarks. |
Exploring Dual Encoder Architectures for Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Dual encoders have been used for question-answering and information retrieval tasks with good results. |
| Approach: | They propose to use two different versions of dual encoders for QA retrieval tasks . they propose to share parameters in projection layers between two encoder towers . |
| Outcome: | The proposed architectures outperform SDE and ADE on QA retrieval tasks. |
FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current NLP models heavily rely on pre-trained models, such as BERT and RoBERTa. |
| Approach: | They propose a lightweight method for personalized NLP classification tasks post-backbone replacement using a personalized matrix calculated from documents corresponding to users' old and new backbones. |
| Outcome: | The proposed method achieves over 1000 times computation reduction in Flops for backpropagation and brings the user-specific initialization for personal matrix yielding significant performance boost compared with popular transfer learning methods. |