Challenge: Large Language Models (LLMs) and Retrieval-augmented Generation (RAG) systems show promise, but their performance on cross-document MEQA remains underexplored due to the lack of tailored benchmarks.
Approach: They propose a scalable multi-document, multi-entity benchmark to evaluate LLMs' capacity to retrieve, consolidate, and reason over scattered and dense information.
Outcome: The proposed benchmarks show that even advanced models achieve only 59% accuracy on MEBench.

Similar Papers

LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing SEA-focused benchmarks miss Lao-specific cultural grounding and linguistic properties.
Approach: They propose a multi-dimensional benchmark for assessing large language models in Lao . they use open-source and held-out subsets to evaluate languages with a hybrid pipeline .
Outcome: LaoBench is the first large-scale, high-quality, and multidimensional benchmark for assessing LLM language understanding and reasoning in Lao.
MuBench: Assessment of Multilingual Capabilities of Large Language Models Across 61 Languages (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation datasets lack cross-lingual alignment, leaving assessments of multilingual capabilities fragmented in both language and skill coverage.
Approach: They propose to use multilingual consistency as a complementary metric to assess performance bottlenecks and guide model improvement.
Outcome: The proposed model lacks cross-lingual alignment and language coverage gaps between state-of-the-art models.
MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance (2025.findings-acl)

Copied to clipboard

Challenge: Multi-document reasoning is an area of increasing relevance given LLM capabilities in handling longer-context inputs, but few benchmarks exist to rigorously examine model behavior in this setting.
Approach: They propose a new dataset for evaluating LLMs on the task of multi-document reasoning that uses condensed structured seed knowledge to modify it through LLM-assisted edits.
Outcome: The proposed method generates document sets and QA examples on a multi-document reasoning task using a synthetic generation process.
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) can only handle texts a few thousand tokens long, limiting their applications on longer sequence inputs, such as books, reports, and codebases.
Approach: They propose a bilingual, multi-task benchmark for long context understanding that extends context windows and more sophisticated memory mechanisms to improve models' long context capabilities.
Outcome: The proposed model outperforms open-source models but struggles on longer contexts.
AfroBench: How Good are Large Language Models on African Languages? (2025.findings-acl)

Copied to clipboard

Challenge: Large-scale multilingual evaluations often include only a handful of African languages due to the scarcity of high-quality data and the limited discoverability of existing datasets.
Approach: They propose a multi-task benchmark to evaluate the performance of LLMs across 64 African languages, 15 tasks and 22 datasets.
Outcome: The proposed benchmark compares LLMs across 64 African languages, 15 tasks and 22 datasets.
BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing multilingual benchmarks focus primarily on language understanding tasks.
Approach: They develop a multi-way multilingual benchmark that measures critical capabilities of large language models across languages.
Outcome: Extensive experiments on BenchMAX reveal uneven utilization of core capabilities across languages, emphasizing the performance gaps that scaling model size alone does not resolve.
Question Answering over Tabular Data with DataBench: A Large-Scale Empirical Evaluation of LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are showing emerging abilities, but they are not large enough to assess their capabilities.
Approach: They propose a benchmark that compares large language models with open and closed source models.
Outcome: The proposed benchmark compares open and closed-source models with open-source and closed source models.
LongTableBench: Benchmarking Long-Context Table Reasoning across Real-World Formats and Domains (2025.findings-emnlp)

Copied to clipboard

Challenge: Evaluating 52 LLMs reveals that only the strongest models maintain robust performance under increasing context lengths and format diversity.
Approach: They propose a benchmark for evaluating long-context reasoning over semi-structured tables across diverse formats, tasks, and domains.
Outcome: The proposed model outperforms compression-based approaches on tasks requiring semantic integration.
ACEBench: A Comprehensive Evaluation of LLM Tool Usage (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for evaluating LLMs’ tool usage face several limitations: limited evaluation scenarios, lacking assessments in real multi-turn dialogue contexts; narrow evaluation dimensions, with insufficient detailed assessments of how LLM use tools; and reliance on LLM or real API executions for evaluation, which introduces significant overhead.
Approach: ACEBench is a benchmark for evaluating tool usage in Large Language Models . it categorizes data into three primary types based on evaluation methodology: Normal, Special, and Agent.
Outcome: ACEBench categorizes data into three primary types based on evaluation methodology: Normal, Special, and Agent.
M3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge-based VQA benchmarks focus on coarse-grained categories and simple reasoning over single entities.
Approach: They propose a knowledge-based Visual Question Answering benchmark to enhance multimodality evaluation.
Outcome: The proposed benchmark improves evaluation of multimodal large language models in fine-grained multimodal entity understanding and complex multihop reasoning.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations