Papers by Zhuoyan Xu
Conv-Basis: A New Paradigm for Efficient Attention Inference and Gradient Computation in Transformers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a large computational cost for attention computation in large language models is a major obstacle . |
| Approach: | They propose a convolution-like structure for attention computation using convolution matrices . they then propose an efficient approximation method to approximate the attention matrix . |
| Outcome: | The proposed method achieves nearly linear time complexity in n1+o(1) time. |
Efficient Table Retrieval and Understanding with Multimodal Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Tabular data is often captured in image form across a wide range of real-world scenarios. |
| Approach: | They propose a framework that enables MLLMs to answer queries over large tables. |
| Outcome: | The proposed framework outperforms existing methods by 7.0% in retrieval recall and 6.1% in answer accuracy on a newly constructed dataset with 48,504 unique tables. |