Papers by Shuaiyi Li
Consecutive Batch Model Editing with HooK Layers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that retrain are time- and resource-consuming, but they lack the memory to support sequential and batch editing. |
| Approach: | They propose a model editing method that supports sequential and batch editing . they use a small amount of memory to store several hook layers that remain unchanged over time . |
| Outcome: | The proposed method is memory-friendly and can store hook layers that remain unchanged over time. |
AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models (2024.findings-emnlp)
Copied to clipboard
Xiyang Wu, Tianrui Guan, Dianqi Li, Shuaiyi Huang, Xiaoyu Liu, Xijun Wang, Ruiqi Xian, Abhinav Shrivastava, Furong Huang, Jordan Boyd-Graber, Tianyi Zhou, Dinesh Manocha
| Challenge: | Large vision-language models are prone to hallucinations, where contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. |
| Approach: | They propose to automate the generation of hallucination-related questions using images . they propose to use three image manipulation strategies to induce hallucinosity . |
| Outcome: | The proposed approach reduces human bias in crafting such examples and improves accuracy. |
DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for spatial reasoning in text overlook the gap between natural language and symbolic structures. |
| Approach: | They propose a novel depth-wise Graph Neural Network to aggregate spatial information over the depth dimension instead of the breadth dimension of the graph. |
| Outcome: | The proposed model outperforms existing methods on two multi-hop spatial reasoning datasets. |
Knowledge Boundary of Large Language Models: A Survey (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) store vast amount of knowledge in their parameters, but they still have limitations in the memorization and utilization of certain knowledge. |
| Approach: | They propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. |
| Outcome: | The proposed definition of the LLM knowledge boundary and taxonomy categorizes knowledge into four distinct types . aims to offer a comprehensive overview, facilitate access to key issues, and inspire further advancements in LLM research. |
ExpSeek: Self-Triggered Experience Seeking for Web Agents (2026.findings-acl)
Copied to clipboard
Wenyuan Zhang, Xinghua Zhang, Haiyang Yu, Shuaiyi Nie, Bingli Wu, Juwei Yue, Tingwen Liu, Yongbin Li
| Challenge: | Existing methods for integrating experience into web agents are struggling to adapt to dynamically changing contextual observations during agent-environment interaction. |
| Approach: | They propose a model that shifts experience toward step-level proactive seeking by estimating step- level entropy thresholds and designing step-Level tailored experience content. |
| Outcome: | The proposed model achieves 9.3% and 7.5% performance improvements on Qwen3-8B and 32B models across four challenging web agent benchmarks. |
Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models (2025.acl-long)
Copied to clipboard
Zhisong Zhang, Yan Wang, Xinting Huang, Tianqing Fang, Hongming Zhang, Chenlong Deng, Shuaiyi Li, Dong Yu
| Challenge: | Large language models have demonstrated remarkable performance across a wide range of language tasks due to their remarkable ability in context modeling. |
| Approach: | They propose to use parallel context encoding to reduce attention entropy by incorporating attention sinks and selective mechanisms to reduce irregular attention . they also propose to incorporate attention sink mechanisms into the parallel encoded context to reduce the irregular attention. |
| Outcome: | The proposed methods lower irregular attention entropy and narrow performance gaps. |
WatME: Towards Lossless Watermarking Through Lexical Redundancy (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text watermarking rely on arbitrary vocabulary partitioning during decoding, which compromises the availability of suitable tokens and significantly degrades the quality of responses. |
| Approach: | They propose a method that leverages linguistic prior knowledge of lexical redundancies in LLM vocabularies to seamlessly integrate watermarks. |
| Outcome: | The proposed approach preserves the expressive power of large language models while preserving watermark detectability. |
A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression (2025.acl-long)
Copied to clipboard
| Challenge: | gist-based context compression methods can achieve only slight performance loss on tasks like retrieval-augmented generation and long-document QA, but it faces challenges in tasks like synthetic recall. |
| Approach: | They propose two strategies to improve gist-based context compression in large language models. |
| Outcome: | The proposed methods can achieve only slight performance loss on retrieval-augmented generation and long-document QA tasks, but they face challenges in tasks like synthetic recall. |