Challenge: Recent research has leveraged Large Language Models to accelerate materials discovery and design.
Approach: They propose a dataset that features goals, constraints, and methods for designing real-world applications and a method that emulates the process a materials scientist would use to evaluate a hypothesis critically.
Outcome: The proposed method emulates the process a materials scientist would use to evaluate a hypothesis critically.

Similar Papers

ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition (2026.findings-acl)

Copied to clipboard

Challenge: Large language models have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark.
Approach: They propose a benchmark for evaluating large language models on a sufficient set of scientific discovery sub-tasks.
Outcome: The proposed framework extracts critical components from papers across 12 disciplines with expert validation confirming its accuracy.
A Survey of Large Language Models for Text-Guided Molecular Discovery: From Molecule Generation to Optimization (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language and symbolic notations.
Approach: They analyze the current LLM learning paradigms to tackle four critical evaluation dimensions that have emerged as critical dimensions in recent studies.
Outcome: The proposed models are able to interact with chemical spaces through natural language and symbolic notations, and have emerging extensions to incorporate multi-modal inputs.
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) provide a data-centric solution to alleviate limitations of real-world data with synthetic data generation.
Approach: They propose a generic workflow for LLM-driven synthetic data generation.
Outcome: The proposed workflows highlight gaps in existing research and outline avenues for future studies.
The Data Frontier for Large Language Models: Selection, Synthesis, and Tools (2026.acl-tutorials)

Copied to clipboard

Challenge: acquiring and curating high-quality training data remains a significant bottleneck . acquiring such high-quality data is a key challenge for researchers and practitioners .
Approach: This tutorial provides a comprehensive and practical guide to the state-of-the-art in data research directions for LLMs.
Outcome: The tutorial covers methods for curating the most valuable information from vast, noisy datasets and the synthetic data revolution.
LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models have been proposed as general-purpose agents for experimental design . eval: LLMs show no sensitivity to experimental feedback.
Approach: They propose a method that combines LLM prior knowledge with nearest-neighbor sampling to guide the design of experiments.
Outcome: The proposed method outperforms classical methods in the design of experiments.
Can Large Language Models Unlock Novel Scientific Research Ideas? (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) and ChatGPT have marked a turning point in the integration of Artificial Intelligence (AI) into people’s everyday lives.
Approach: They conduct a human evaluation of the novelty, relevancy, and feasibility of the generated future research ideas.
Outcome: The proposed models generate more diverse ideas than GPT-4, GPT-3.5, and Gemini 1.0.
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) struggle with hallucinations, handling domain-specific data effectively, and integrating experimental workflows.
Approach: They propose a hierarchical multi-agent framework to emulate the materials science research workflow by combining a new uncertainty and confidence estimate to evaluate the self-consistency of responses from LLaMP and baseline methods.
Outcome: The proposed framework performs better than existing methods in material property retrieval, crystal structure editing, and annealing molecular dynamics simulations.
Systematic Task Exploration with LLMs: A Study in Citation Text Generation (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) provide unprecedented flexibility in defining and executing complex, creative natural language generation tasks.
Approach: They propose a framework that consists of input manipulation, reference data, and output measurement to explore citation text generation.
Outcome: The proposed framework explores citation text generation, a popular scholarly NLP task that lacks consensus on the task definition and evaluation metric and has not yet been tackled within the LLM paradigm.
A Survey on LLM-powered Agents for Recommender Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have demonstrated remarkable capabilities in natural language understanding, reasoning, and generation.
Approach: They present a comprehensive synthesis of large language models and their applications . they dissect a four-module agent architecture and review representative designs .
Outcome: The proposed models address fundamental challenges in traditional recommender systems . they include limited comprehension of complex user intents, insufficient interaction capabilities .
HoneyComb: A Flexible LLM-Based Agent System for Materials Science (2024.findings-emnlp)

Copied to clipboard

Challenge: specialized large language models (LLMs) have shown promise in materials science but often struggle with the distinct complexities of materials science tasks.
Approach: They propose a new LLM-based agent system specifically designed for materials science that leverages a reliable materials science knowledge base and a sophisticated tool hub.
Outcome: The proposed system outperforms baseline models across tasks in materials science while ensuring accuracy and relevance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations