Papers by Wenhui Liao
PPTSER: A Plug-and-Play Tag-guided Method for Few-shot Semantic Entity Recognition on Visually-rich Documents (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visually-rich document information extraction are limited . Xu et al., 2020: visually rich document information is a vital aspect of document understanding . |
| Approach: | They propose a plug-and-play Tag-guided method for few-shot Semantic Entity Recognition (PPTSER) on visually-rich documents. |
| Outcome: | The proposed method outperforms fine-tuning and few-shot methods on visual-rich documents. |
RedundancyLens: Revealing and Exploiting Visual Token Processing Redundancy for Efficient Decoder-Only MLLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Current decoder-only architectures achieve higher performance but lower efficiency . cross-attention-based architectures skip visual token computations . |
| Approach: | They propose a training-free framework for analyzing trained MLLMs to investigate redundancy . they propose 'probe-activated Dynamic FFN and Hollow Attention' algorithms for visual token reductions and a layer ranking algorithm for inference acceleration. |
| Outcome: | The proposed framework achieves comparable performance to or better than state-of-the-art methods while remaining compatible with them. |