Challenge: evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations.
Approach: They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge.
Outcome: The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results.

Similar Papers

ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)

Copied to clipboard

Challenge: Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 .
Approach: They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks.
Outcome: The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority.
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)

Copied to clipboard

Challenge: introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.
Approach: They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them.
Outcome: The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods.
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains.
Approach: They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks .
Outcome: The proposed evaluations are reproducible, reliable, and robust.
Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs) (2024.lrec-tutorials)

Copied to clipboard

Challenge: General-purpose Language Models have changed the world of Natural Language Processing, if not the world itself.
Approach: This tutorial will lay the foundations and explain the basics of evaluation and compare traditional methods to newly developed methods.
Outcome: The tutorial assumes little familiarity with metrics, datasets, prompts and benchmarks . it will compare traditional methods to newly developed methods .
LHMKE: A Large-scale Holistic Multi-subject Knowledge Evaluation Benchmark for Chinese Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Existing benchmarks for comprehensively evaluating Chinese Large Language Models are insufficient.
Approach: They propose a Large-scale, Holistic, and Multi-subject Knowledge Evaluation benchmark to evaluate Chinese Large Language Models.
Outcome: The proposed benchmark measures the knowledge acquisition capabilities of Chinese Large Language Models across 75 subjects from primary school to professional certification exams.
Large Language Models for Generative Recommendation: A Survey and Visionary Discussions (2024.lrec-main)

Copied to clipboard

Challenge: Large language models (LLMs) have revolutionized the field of natural language processing but are not fully able to leverage the generative power of LLM.
Approach: They examine the progress, methods, and future directions of large language models . they examine what generative recommendation is, why RS should advance to generative recommendations .
Outcome: The proposed approach can be simplified to generate recommendations from the entire pool of items.
Benchmarking Large Language Models on CFLUE - A Chinese Financial Language Understanding Evaluation Dataset (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have revolutionized natural language processing (NLP) there is an urgent need for new benchmarks to keep pace with the development of LLMs.
Approach: They propose a benchmark to assess the capability of large language models (LLMs) they use a dataset to provide both knowledge assessment and application assessment .
Outcome: The proposed benchmark provides datasets tailored for knowledge assessment and application assessment.
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: specialized LLMs are often limited in domain-specific applications that require specialized knowledge.
Approach: They provide a comprehensive overview of four key methods to enhance large language models by integrating domain-specific knowledge.
Outcome: The proposed methods are categorized into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization.
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence.
Approach: They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics .
Outcome: The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations