Challenge: Modern large language models often "hallucinate" plausible but factually incorrect information, which reduces their trustworthiness especially in settings where accurate and up-to-date information is critical.
Approach: They develop a human evaluation procedure to measure correctness and hallucination and use it to benchmark both closed and open-source LLMs.
Outcome: The proposed method outperforms both competing search engine-augmented prompting methods and commercial systems on search-augmented QA.

Similar Papers

SAGE: A Search-AuGmented Evaluation of Large Language Models on Free-Form QA (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are prone to hallucination and rely on static, pre-annotated references for evaluation.
Approach: They propose a framework to assess large language models without fixed ground-truth answers by iteratively generating web queries and synthesizing external evidence.
Outcome: The proposed framework achieves substantial to perfect agreement with human evaluations on multiple free-form QA benchmarks.
ReEval: Automatic Hallucination Evaluation for Retrieval-Augmented Large Language Models via Transferable Adversarial Attacks (2024.findings-naacl)

Copied to clipboard

Challenge: Existing static benchmarks do not guarantee that models can use the provided evidence for answering, which is essential to avoid hallucination when the required knowledge is new or private.
Approach: They propose to automatically perturb existing static one for dynamic evaluation by using a chatGPT framework and a set of open-domain QA datasets.
Outcome: The proposed framework generates new test cases on two open-domain QA datasets and is human-readable and useful to trigger hallucination in LLMs.
Automatic Evaluation of Attribution by Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Generative large language models (LLMs) incorporate external references to generate and support claims. however, evaluating the attribution remains an open problem.
Approach: They investigate automatic evaluation of attribution given by large language models . they define different types of attributed errors and then explore two approaches .
Outcome: The proposed methods highlight promising signals and challenges.
PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are useful for low-resource scenarios and time-restricted applications.
Approach: They propose a large-scale evaluation tool for large language models that uses prompts . they evaluate 720 prompt templates for open-source LLM-based metrics on MT and summarization datasets a 6.6M evaluations.
Outcome: The proposed model evaluates 720 prompt templates on machine translation and summarization datasets.
How Credible Is an Answer From Retrieval-Augmented LLMs? Investigation and Evaluation With Multi-Hop QA (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented large language models (RaLLMs) are reshaping knowledge acquisition, offering long-form, knowledge-grounded answers through advanced reasoning and generation capabilities.
Approach: They propose a benchmarking system to evaluate RaLLMs' correctness and Groundedness to determine their reliability in multi-hop question-answering tasks.
Outcome: The proposed model-based evaluation pipeline for multi-hop question-answering tasks reveals that the model generates inaccuracies when dealing with flawed or partial knowledge.
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Recent research shows that large language models (LLMs) perform poorly at segment level.
Approach: They propose a new prompting method that emulates the commonly accepted human evaluation framework . they will release their code and scripts to facilitate the community .
Outcome: The proposed method is based on the human evaluation framework MQM and produces explainable and reliable MT evaluations at both the system and segment level.
Enabling Large Language Models to Generate Text with Citations (2023.emnlp-main)

Copied to clipboard

Challenge: Existing work relies on commercial search engines and human evaluation, making it difficult to reproduce and compare different modeling approaches.
Approach: They propose a new generation paradigm that requires large language models to provide citations to one or a few text passages for any statement they generate.
Outcome: The proposed model improves factual correctness and verifiability of large language models by providing citations to a set of questions and retrieval corpora and generating answers with citation.
LLM-Evolve: Evaluation for LLM’s Evolving Capability on Benchmarks (2024.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks for large language models evaluate LLMs on i.i.d. tasks, overlooking their ability to learn iteratively from past experiences.
Approach: They propose a framework which extends established benchmarks to sequential problem-solving settings and provides feedback after each round to build a demonstration memory that the models can query in future tasks.
Outcome: The proposed framework can improve performance of LLMs by learning from past interactions and improve models' performance over time.
RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods rely on separate retrievers to fetch top-k text chunks for generating evidence, and they lack joint optimization.
Approach: They propose a framework that integrates retrieval and generation into a single, auto-regressive process, enabling LLMs to directly generate fine-grained evidence from the corpus with constrained decoding.
Outcome: Extensive experiments on five open-domain QA datasets demonstrate the proposed framework’s superior performance across both in-domain and out-of-domain tasks.
Large Language Models Require Curated Context for Reliable Political Fact-Checking—Even with Reasoning and Web Search (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results.
Approach: They evaluate 15 large language models on 6,000 claims fact-checked by PolitiFact . standard models perform poorly, reasoning offers minimal benefits, and web search provides only moderate gains .
Outcome: The models predict claim veracity and a curated RAG system improved macro F1 by 233% on average across model variants.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations