Challenge: Large Language Models (LLMs) have impressive capabilities on a wide range of tasks, such as question answering and the generation of coherent text and code.
Approach: They propose a framework for automatic evaluation of large language models on open-ended planning problems and a dataset of biology protocols with corresponding pseudocode representations.
Outcome: The proposed framework evaluates an LLM on a dataset of biology protocols with corresponding pseudocode representations.

Similar Papers

Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks (2023.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape . established automatic evaluation metrics are poor surrogates, correlating weakly with human judgement.
Approach: They propose to use both automatic and human evaluation to evaluate generative LLMs on three NLP benchmarks: text summarisation, text simplification and grammatical error correction.
Outcome: The proposed model outperforms many popular models according to human reviewers on the majority of metrics, while scoring much worse when using classic automatic evaluation metrics.
LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models excel in various natural language tasks but struggle with long-horizon planning problems requiring structured reasoning.
Approach: They propose to integrate large language models into AP and NLP planning frameworks by reviewing current research and identifying critical challenges and future directions.
Outcome: The proposed frameworks are used to support reliable off-the-shelf AP planners.
GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond (2024.findings-naacl)

Copied to clipboard

Challenge: Existing LLM leaderboards often reference scores reported in other papers without consistent settings and prompts, which may encourage cherry-picking favored settings and for better results.
Approach: They propose an open-source and reproducible LLM evaluation suite built on top of OpenAI Evals that systematically evaluates 10+ leading LLMs and OpenAI’s legacy models on 20+ curated benchmarks across 7 capability categories.
Outcome: The evaluation suite is built on top of OpenAI Evals and evaluates 10+ leading LLMs and OpenAI’s legacy models on 20+ curated benchmarks across 7 capability categories.
Executing Natural Language-Described Algorithms with Large Language Models: An Investigation (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have revolutionized the field of natural language processing and artificial intelligence, creating new SOTAs and reaching human-level language understanding performance on a series of tasks and benchmarks.
Approach: They propose to use an algorithm test set sourced from Introduction to Algorithm to assess LLMs' code execution abilities.
Outcome: The proposed model can execute programs described in natural language as long as no heavy numeric computation is involved.
On the Limit of Language Models as Planning Formalizers (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models can create plans that are neither executable nor verifiable in grounded environments.
Approach: They use Large Language Models to generate a formal representation of the planning domain in some language, such as Planning Domain Definition Language (PDDL).
Outcome: The proposed model outperforms the models directly generating plans while being robust to lexical perturbation.
Unifying Inference-Time Planning Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are used to generate a formal representation of a plan in a planning language.
Approach: They propose a unifying organizational framework based on intermediate representations to unify the inference-time LLM-as-formalizer methodology for classical planning.
Outcome: The proposed framework subsumes most existing work and proposes new ones that involve syntactically similar but high-resource intermediate languages.
AIRepr: An Analyst-Inspector Framework for Evaluating Reproducibility of LLMs in Data Science (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models are increasingly used to automate data analysis, but data science tasks often admit multiple statistically valid solutions.
Approach: They propose a framework to evaluate LLM-generated code and assess its reproducibility . they introduce two reproducibility-enhancing prompting strategies and benchmark them against standard prompting .
Outcome: The proposed framework improves reproducibility of large language models . it provides a foundation for transparent, reliable, and efficient human–AI collaboration in data science.
The Program Testing Ability of Large Language Models for Code (2024.emnlp-industry)

Copied to clipboard

Challenge: Recent development of large language models (LLMs) for code shows promise in achieving code intelligence.
Approach: They explore the ability of large language models to generate automated test cases . they show +11.77% and +4.22% higher code pass rates on HumanEval+ .
Outcome: The proposed models show higher pass rates on humanEval+ compared with the current state-of-the-art models.
LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient (2026.acl-long)

Copied to clipboard

Challenge: Using generic and efficient benchmark generators, human annotators are limited by inefficiency . current benchmark generator methods rely on seed signals, leading to long cycles and high costs .
Approach: They propose a framework to evaluate LLMs as generic benchmark generators and integrate them as BenchMaker.
Outcome: The proposed framework achieves comparable performance to human-annotated benchmarks on most metrics.
Learning to Judge: LLMs Designing and Applying Evaluation Rubrics (2026.findings-eacl)

Copied to clipboard

Challenge: Large language models are increasingly used as evaluators for natural language generation . human rubrics are often static and misaligned with how models internally represent language quality.
Approach: They propose to use large language models to generate interpretable and task-aware evaluation dimensions and apply them within models.
Outcome: The proposed model improves the semantic coherence and scoring reliability of LLM-defined criteria and their alignment with human criteria.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations