Papers by Xiaoyun Zheng
CNSL-bench: Benchmarking the Sign Language Understanding Capabilities of MLLMs on Chinese National Sign Language (2026.acl-long)
Copied to clipboard
| Challenge: | CNSL-bench is the first comprehensive Chinese National Sign Language benchmark . current MLLMs are inferior to human performance, despite advances in multimodal modeling . |
| Approach: | They propose a Chinese National Sign Language benchmark to evaluate multimodal large language models in sign language understanding. |
| Outcome: | The proposed benchmark evaluates 21 open-source and proprietary MLLMs . results show that current models are inferior to human performance . |