IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery (2025.acl-demo)
Copied to clipboard
| Challenge: | Recent work on automated hypothesis generation focuses on multi-agent frameworks and extending test-time compute, but none incorporates human-in-the-loop (HITL) integration. |
| Approach: | They propose an open-source platform to enable researchers to leverage LLM-assisted scientific ideation. |
| Outcome: | The proposed system empowers researchers with greater control throughout ideation process. |
Similar Papers
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | a new system that leverages the encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models (LLMs) is proposed to enhance the productivity of researchers . a researcher's research idea generation process involves problem identification, method development, experiment design and iterative revision . |
| Approach: | They propose a system that leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models to assist researchers in their work. |
| Outcome: | The proposed system generates novel ideas based on human and model-based evaluations . it leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models based systems . |
Can Large Language Models Unlock Novel Scientific Research Ideas? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and ChatGPT have marked a turning point in the integration of Artificial Intelligence (AI) into people’s everyday lives. |
| Approach: | They conduct a human evaluation of the novelty, relevancy, and feasibility of the generated future research ideas. |
| Outcome: | The proposed models generate more diverse ideas than GPT-4, GPT-3.5, and Gemini 1.0. |
Agent Laboratory: Using LLM Agents as Research Assistants (2025.findings-emnlp)
Copied to clipboard
Samuel Schmidgall, Yusheng Su, Ze Wang, Ximeng Sun, Jialian Wu, Xiaodong Yu, Jiang Liu, Michael Moor, Zicheng Liu, Emad Barsoum
| Challenge: | Agent Laboratory is an autonomous LLM-based framework that can complete the entire research process. |
| Approach: | Agent Laboratory is an autonomous LLM-based framework that can complete the entire research process. |
| Outcome: | Agent Laboratory is an autonomous LLM-based framework that can complete the entire research process. |
Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System (2025.acl-long)
Copied to clipboard
Haoyang Su, Renqi Chen, Shixiang Tang, Zhenfei Yin, Xinzhe Zheng, Jinzhe Li, Biqing Qi, Qi Wu, Hui Li, Wanli Ouyang, Philip Torr, Bowen Zhou, Nanqing Dong
| Challenge: | Recent AI methods have shown promise in tasks such as hypothesis generation and experimental design, but they fail to replicate the collaborative nature of real-world scientific practices. |
| Approach: | They propose a virtual scientific system that mimics the collaborative nature of scientific research by organizing a team of agents to generate, evaluate, and refine research ideas. |
| Outcome: | The proposed system outperforms the state-of-the-art method in producing new scientific ideas and offers valuable insights to guide future research. |
ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition (2026.findings-acl)
Copied to clipboard
Yujie Liu, Zonglin Yang, Tong Xie, Jinjie Ni, Ben Gao, Yuqiang Li, Shixiang Tang, Wanli Ouyang, Erik Cambria, Dongzhan Zhou
| Challenge: | Large language models have shown potential in assisting scientific research, yet their ability to discover high-quality research hypotheses remains unexamined due to the lack of a dedicated benchmark. |
| Approach: | They propose a benchmark for evaluating large language models on a sufficient set of scientific discovery sub-tasks. |
| Outcome: | The proposed framework extracts critical components from papers across 12 disciplines with expert validation confirming its accuracy. |
TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agents (2025.emnlp-demos)
Copied to clipboard
Haofei Yu, Keyang Xuan, Fenghai Li, Kunlun Zhu, Zijie Lei, Jiaxun Zhang, Ziheng Qi, Kyle Richardson, Jiaxuan You
| Challenge: | Existing research systems often design and use agentic workflows to perform research tasks such as ideation, scientific coding, review writing, and tree-based search. |
| Approach: | They propose an open-source codebase, an interactive web demonstration, and a PyPI Python package to make state-of-the-art auto-research pipelines broadly accessible to every researcher and developer. |
| Outcome: | The proposed framework adapts easily to new tools and supports iterative growth. |
CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation (2025.findings-acl)
Copied to clipboard
Peter Jansen, Oyvind Tafjord, Marissa Radensky, Pao Siangliulue, Tom Hope, Bhavana Dalvi Mishra, Bodhisattwa Prasad Majumder, Daniel S Weld, Peter Clark
| Challenge: | Automated scientific discovery (ASD) systems are limited in their evaluation of software artifacts and large volumes of research artifs are typically evaluated using conference-style paper review with limited evaluation of code. |
| Approach: | They propose a novel ASD system that frames ideation and experiment construction as a form of genetic search jointly over combinations of research articles and codeblocks defining common actions in a domain. |
| Outcome: | The proposed system returns 19 discoveries on machine-generated ideas in the domain of agents and virtual environments. |
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents. |
| Approach: | They introduce a foundational three-level taxonomy to delineate their escalating autonomy and evolving responsibilities within the research lifecycle. |
| Outcome: | The proposed frameworks provide a conceptual architecture and strategic foresight to navigate and shape the future of AI-driven scientific discovery. |
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)
Copied to clipboard
Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Yu Rong, Deli Zhao, Tian Feng, Lidong Bing
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
OpenResearcher: Unleashing AI for Accelerated Scientific Research (2024.emnlp-demo)
Copied to clipboard
Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang, Xuefeng Li, Jifan Lin, Binjie Wang, Yun Luo, Renjie Pan, Yang Xu, Qingkai Min, Zizhao Zhang, Yiwen Wang, Wenjie Li, Pengfei Liu
| Challenge: | Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024). |
| Approach: | They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers. |
| Outcome: | OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge. |