Papers by Zhanpeng Ni
StruNRAG: Evaluation of OCR-Induced Structural Noise on RAG Robustness (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of RAG systems ignore structural noise, authors say . complex layouts can cause OCR failures and disrupt semantic flow of text . advanced LLMs demonstrate robustness against local noise, but struggle to maintain reasoning capabilities under severe structural disruption that fragments global context. |
| Approach: | They propose a benchmark to evaluate RAG robustness against OCR-induced structural perturbations. |
| Outcome: | The proposed benchmark systematically injects three categories of real-world structural noise into a bilingual dataset of 2,132 question-answer pairs . results show that advanced LLMs demonstrate robustness against local noise, but struggle to maintain reasoning capabilities under severe structural disruption . |