Papers by Yubo Ma
Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings (2025.findings-acl)
Copied to clipboard
Yubo Ma, Jinsong Li, Yuhang Zang, Xiaobao Wu, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Haodong Duan, Jiaqi Wang, Yixin Cao, Aixin Sun
| Challenge: | Visualized Document Retrieval (VDR) uses large vision-language models to encode document pages into embeddings. |
| Approach: | They evaluate methods to reduce patch embeddings per page while minimizing performance degradation. |
| Outcome: | The proposed method maintains 98.2% of retrieval performance with only 11.8% of original memory usage and preserves 94.6% effectiveness at 2% memory footprint. |
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)
Copied to clipboard
Ying He, Zhouhong Gu, Zhecheng Hu, Yubo Zhou, Hao Shen, Jiaqing Liang, Zhaoqian Dai, Ma Shuguang, Fei Yu, Yanghua Xiao, Zhixu Li
| Challenge: | Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly. |
| Approach: | They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show . |
| Outcome: | The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models. |
Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples! (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have made remarkable strides in various tasks, but whether they are competitive few-shot solvers remains an open question. |
| Approach: | They propose an adaptive filter-then-rerank paradigm to combine the strengths of LLMs and SLMs. |
| Outcome: | The proposed system achieves promising improvements on various IE tasks with acceptable time and cost investment. |
InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model (2025.findings-acl)
Copied to clipboard
Yuhang Zang, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Ziyu Liu, Shengyuan Ding, Shenxi Wu, Yubo Ma, Haodong Duan, Wenwei Zhang, Kai Chen, Dahua Lin, Jiaqi Wang
| Challenge: | Despite the promising performance of Large Vision Language Models, they sometimes generate incorrect outputs. |
| Approach: | They propose a multi-modal reward model that aligns LVLMs with human preferences. |
| Outcome: | The proposed model achieves excellent results on the latest multi-modal reward model benchmark and shows competitive performance on text-only reward model. |
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)
Copied to clipboard
Yuzhen Shi, Huanghai Liu, Yiran HU, Song Gaojie, Xu Xinran, Yubo Ma, Tianyi Tang, Li Zhang, Qingjing Chen, Feng Di, Wenbo Lv, Weiheng Wu, Kexin Yang, Sen Yang, Wei Wang, Rongyao Shi, Qiu Yuanyang, Yuemeng Qi, Zhang Jingwen, Sui Xiaoyu, Yifan Chen, Zhang Yi, An Yang, Bowen Yu, Dayiheng Liu, Junyang Lin, Weixing Shen, Bing Zhao, Charles L. A. Clarke, HU Wei
| Challenge: | Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning. |
| Approach: | They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios. |
| Outcome: | The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics. |
AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge (2025.acl-long)
Copied to clipboard
Xiaobao Wu, Liangming Pan, Yuxi Xie, Ruiwen Zhou, Shuai Zhao, Yubo Ma, Mingzhe Du, Rui Mao, Anh Tuan Luu, William Yang Wang
| Challenge: | Existing studies solve this challenge by updating benchmarks with newly collected data, but they fail to guarantee contamination-free evaluation as the newly collected knowledge may contain pre-existing knowledge. |
| Approach: | They propose an automated anti-leakage benchmarking framework that builds and updates benchmarks without human labor instead of using newly collected data. |
| Outcome: | The proposed framework significantly reduces the cost of benchmark maintenance to accommodate emerging LLMs. |
MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities (2022.acl-demo)
Copied to clipboard
Yubo Ma, Zehao Wang, Mukai Li, Yixin Cao, Meiqi Chen, Xinze Li, Wenqi Sun, Kunquan Deng, Kun Wang, Aixin Sun, Jing Shao
| Challenge: | Recent Knowledge Graphs (KGs) store billions of world facts in a directed graph, but expression ability of such entity-centric KGs is limited. |
| Approach: | They propose a large-scale multi-modal event knowledge graph named MMEKG that unifies different modalities of knowledge via events. |
| Outcome: | The proposed system unifies different modalities of knowledge via events, which complement and disambiguate each other. |
Are Large Language Models Chronically Online Surfers? A Dataset for Chinese Internet Meme Explanation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are trained on vast amounts of text from the Internet, but do they understand the viral content that rapidly spreads online? |
| Approach: | They introduce a dataset for CHinese Internet Meme Explanation that includes popular phrase-based memes from the Chinese Internet. |
| Outcome: | The proposed dataset includes popular phrase-based memes from the Chinese Internet, annotated with detailed information on their meaning, origin, example sentences, types, etc. |
TART: An Open-Source Tool-Augmented Framework for Explainable Table-based Reasoning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current Large Language Models lack ability to understand table structures and apply precise numerical reasoning. |
| Approach: | They propose a tool-augmented reasoning framework for table-based tasks that integrates LLMs with specialized tools. |
| Outcome: | The proposed framework improves on the TOOLTAB dataset, a benchmark for LLMs in table–tool integration. |
MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation (2026.acl-long)
Copied to clipboard
Xiaoyuan Li, Keqin Bao, Yubo Ma, Moxin Li, Wenjie Wang, Rui Men, Yichang Zhang, Fuli Feng, Dayiheng Liu
| Challenge: | Recent advances in Large Language Models (LLMs) have shown promising results in complex reasoning tasks. |
| Approach: | They propose to use a multi-turn reasoning evaluation framework to cover multi-turn interactions with the environments of large language models. |
| Outcome: | The proposed framework covers diverse reasoning capabilities, fine-grained difficulty granularity, and necessitates multi-turn interactions with the environments. |
Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation metrics and benchmarks to attribute large language models to structured knowledge are lacking. |
| Approach: | They propose a task of Knowledge-aware Language Model Attribution that improves upon three core concerns with conventional attributed LMs. |
| Outcome: | The proposed model improves upon core concerns with conventional attributed LMs. |
Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new evaluation framework for vision-language navigation is proposed . current evaluation standards hinge on endpoint success rates and path alignment metrics . |
| Approach: | They propose a semi-automatic method for CFG construction with Large-Language Models . they induct data spanning five principal instruction categories and analyze them . |
| Outcome: | The proposed framework diagnoses current models for the Vision-Language Navigation task at a finer-grained level. |
Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale language models (LLMs) like ChatGPT have demonstrated impressive abilities in generating responses based on human instructions. however, their use in the medical domain can be challenging due to their lack of specific, in-depth knowledge. |
| Approach: | They propose a system that integrates authoritative medical textbooks into LLMs’ framework using plug-and-play modules. |
| Outcome: | The proposed system outperforms the specialized Med-PaLM 2 model on three medical QA tasks by 11.6% to 16.6%. |
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Using a prompt-based model, we find that event argument extraction is efficient and generalized well to few-shot settings. |
| Approach: | They propose a model PAIE for event argument extraction using prompt tuning for extractive objectives. |
| Outcome: | The proposed model can extract arguments with the same role instead of heuristic threshold tuning. |
SciAgent: Tool-augmented Language Models for Scientific Reasoning (2024.emnlp-main)
Copied to clipboard
Yubo Ma, Zhibin Gou, Junheng Hao, Ruochen Xu, Shuohang Wang, Liangming Pan, Yujiu Yang, Yixin Cao, Aixin Sun
| Challenge: | SciAgent surpasses other LLMs with the comparable size by more than 8.0% in absolute accuracy. |
| Approach: | They propose a tool-augmented scientific reasoning setting that supplements LLMs with scalable toolsets and builds a benchmark to evaluate LLM’s abilities with tool assistance. |
| Outcome: | The proposed setting augments LLMs with scalable toolsets and shifts the focus from pursuing an omniscient problem solver to a proficient tool-user. |
Improving Large Language Models in Event Relation Logical Prediction (2024.acl-long)
Copied to clipboard
| Challenge: | Event relation extraction tasks require rigorous logical reasoning and semantic comprehension, a challenge for narrative understanding and reasoning. |
| Approach: | They propose three approaches to endow LLMs with event relation logic to generate more coherent answers across different scenarios. |
| Outcome: | The proposed approach improves on a set of ERE tasks and provides insights for future work. |
Synergistic Weak-Strong Collaboration by Aligning Preferences (2025.acl-long)
Copied to clipboard
Yizhu Jiao, Xuchao Zhang, Zhaoyang Wang, Yubo Ma, Zhun Deng, Rujia Wang, Chetan Bansal, Saravan Rajmohan, Jiawei Han, Huaxiu Yao
| Challenge: | Current Large Language Models excel in general reasoning yet struggle with specialized tasks requiring proprietary or domain-specific knowledge. |
| Approach: | They propose a collaborative framework that pairs a specialized weak model with a general strong model to optimize collaboration. |
| Outcome: | The proposed framework outperforms each model alone by leveraging complementary strengths. |
Few-shot Event Detection: An Empirical Study and a Unified View (2023.acl-long)
Copied to clipboard
| Challenge: | Extensive studies have been carried out on fewshot event detection (ED) however, there are noticeable discrepancies among existing methods from three aspects. |
| Approach: | They propose a unified view of ED models and a better unified baseline for fair evaluation. |
| Outcome: | The proposed framework outperforms existing methods by a large margin on three datasets. |