Papers by Shu Yao
Enabling Real-time Neural IME with Incremental Vocabulary Selection (N19-2)
Copied to clipboard
| Challenge: | Input method editor (IME) converts sequential alphabet key inputs to words in a target language. |
| Approach: | They propose a neural-based language model that incrementally builds a subset vocabulary from the word lattice. |
| Outcome: | The proposed approach achieves 50x speedup on Japanese IME benchmark without losing conversion accuracy. |
A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sparse Autoencoders (SAEs) can disentangle complex features into more interpretable components. |
| Approach: | They propose to use Sparse Autoencoders to disentangle LLM features into more interpretable components. |
| Outcome: | The proposed method disentangles complex features into more interpretable components. |
Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducements (2025.findings-acl)
Copied to clipboard
Shu Yang, Shenzhe Zhu, Zeyu Wu, Keyu Wang, Junchi Yao, Junchao Wu, Lijie Hu, Mengdi Li, Derek F. Wong, Di Wang
| Challenge: | Existing fraud detection benchmarks focus on single-turn classification tasks, failing to capture dynamic nature of real-world fraud attempts. |
| Approach: | They propose a bilingual benchmark to assess LLMs' ability to resist fraud and phishing attacks across five key fraud categories: Fraudulent Services, Impersonation, Phishing Scams, Fake Job Postings, and Online Relationships. |
| Outcome: | The proposed model improves in role-play settings and in e-commerce and recommendation systems. |
Understanding the Repeat Curse in Large Language Models from a Feature Perspective (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models suffer from repetitive text generation, a phenomenon we refer to as the ”Repeat Curse”. |
| Approach: | They propose a method to induce and analyze the Repeat Curse in large language models by using mechanistic interpretability. |
| Outcome: | The proposed method induces and analyzes the Repeat Curse in large language models using mechanistic interpretability. |
PAFT: Prompt-Agnostic Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prompt-agnostic fine-tuning (PAFT) improves performance by reducing overfitting to specific prompts. |
| Approach: | They propose a method that enhances robustness through dynamic prompt variation during training. |
| Outcome: | The proposed method achieves higher generalization accuracy on unseen prompts than standard methods with similar training efficiency. |
TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios (2025.findings-acl)
Copied to clipboard
Xiaokang Zhang, Sijia Luo, Bohan Zhang, Zeyao Ma, Jing Zhang, Yang Li, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-Li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang
| Challenge: | TableLLM is a robust large language model capable of handling tabular data manipulation tasks. |
| Approach: | They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy. |
| Outcome: | The proposed model has 8 billion parameters and is capable of handling tabular data tasks. |
Flexora: Flexible Low-Rank Adaptation for Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized artificial intelligence, but performance on specific tasks is limited by knowledge boundaries. |
| Approach: | They propose a method that automatically selects the most critical layers for fine-tuning to optimize performance across diverse downstream tasks. |
| Outcome: | The proposed method outperforms baseline models and natural language tasks. |
Position Paper: Data-Centric AI in the Age of Large Language Models (2024.findings-emnlp)
Copied to clipboard
Xinyi Xu, Zhaoxuan Wu, Rui Qiao, Arun Verma, Yao Shu, Jingtan Wang, Xinyuan Niu, Zhenfeng He, Jiangwei Chen, Zijian Zhou, Gregory Kang Ruey Lau, Hieu Dao, Lucas Agussurja, Rachael Hwee Ling Sim, Xiaoqiang Lin, Wenyang Hu, Zhongxiang Dai, Pang Wei Koh, Bryan Kian Hsiang Low
| Challenge: | a paper proposes a data-centric perspective of AI research, focusing on large language models. |
| Approach: | They propose a data-centric viewpoint of AI research, focusing on large language models . they propose four scenarios centered around data, including data curation, attribution, knowledge transfer . |
| Outcome: | The proposed research focuses on large language models with data centric benchmarks . the proposed benchmarks can be used to develop new data curation methods . |
Self-Reflective Generation at Test Time (2026.acl-long)
Copied to clipboard
| Challenge: | Existing self-reflection mechanisms are reactive and inefficient for large language models . a fundamental tension persists between the ability to execute complex multi-step reasoning and the ability of the model to generate coherent traces. |
| Approach: | They propose a test-time framework that reflects before generating at uncertain points . SRGen utilizes dynamic entropy thresholding to identify high-uncertainty tokens . |
| Outcome: | The proposed framework can significantly strengthen large language models' reasoning process. |
Example Quality Matters: Multi-Aspects Example Augmentation for Private Library Programming (2026.acl-long)
Copied to clipboard
Yuhao Li, Haifeng Sun, Xuesong Zhang, Shu Yao, Haoyu Zheng, Yvchuan Wang, Huazheng Wang, Zirui Zhuang, Qi Qi, Jianxin Liao, Jingyu Wang
| Challenge: | Existing approaches to code generation fail to consider the quality of retrieved examples. |
| Approach: | They propose a retrieval-augmented generation method that combines existing API examples to improve complexity and readability. |
| Outcome: | The proposed method achieves up to 22% accuracy improvement over baseline methods. |