Completing A Systematic Review in Hours instead of Months with Interactive AI Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Systematic reviews (SRs) are vital for evidence-based practice in high stakes disciplines, such as healthcare. |
| Approach: | They propose a human-centered interactive AI agent powered by large language models that partitions a large literature corpus based on semantics and employs . |
| Outcome: | InsightAgent improves quality of synthesized SRs by 27.2%, reaching 79.7% of human-written quality. |
Similar Papers
ReviewEval: An Evaluation Framework for AI-Generated Reviews (2025.findings-emnlp)
Copied to clipboard
| Challenge: | escalating volume of academic research necessitates innovative approaches to peer review . authors propose reviewEval, ReviewAgent and ReviewEval to improve on existing reviews . |
| Approach: | They propose a framework for AI-generated reviews that measures alignment with human assessments . they propose 'reviewAgent' that iteratively optimizes its intermediate outputs and external improvement loops . |
| Outcome: | The proposed framework improves actionable insights and analytical depth by 6.78% and 47.62% over baselines and expert reviews. |
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | a new system that leverages the encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models (LLMs) is proposed to enhance the productivity of researchers . a researcher's research idea generation process involves problem identification, method development, experiment design and iterative revision . |
| Approach: | They propose a system that leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models to assist researchers in their work. |
| Outcome: | The proposed system generates novel ideas based on human and model-based evaluations . it leverages encyclopedic knowledge and linguistic reasoning capabilities of Large Language Models based systems . |
CodeAgent: Autonomous Communicative Agents for Code Review (2024.emnlp-main)
Copied to clipboard
Xunzhu Tang, Kisub Kim, Yewei Song, Cedric Lothritz, Bei Li, Saad Ezzini, Haoye Tian, Jacques Klein, Tegawendé Bissyandé
| Challenge: | Existing methods for code review rely on single input-output generative models and thus lack the collaborative nature of code review. |
| Approach: | They propose a multi-agent Large Language Model (LLM) system for code review automation that incorporates a supervisory agent to ensure that all the agents’ contributions address the initial review question. |
| Outcome: | The proposed system detects inconsistencies between code changes and commit messages, identify vulnerabilities, validates code style adherence, and suggests code revisions. |
ReflecTool: Towards Reflection-Aware Tool-Augmented Clinical Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown promising potential in the medical domain, assisting with tasks like clinical note generation and patient communication. |
| Approach: | They propose a framework that excels at utilizing domain-specific tools within two stages. |
| Outcome: | The proposed framework surpasses the pure LLMs with more than 10 points and the well-established agent-based methods with 3 points. |
DocAgent: A Multi-Agent System for Automated Code Documentation Generation (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing methods for generating documentation using Large Language Models (LLMs) produce incomplete, unhelpful, or factually incorrect outputs. |
| Approach: | They propose a novel collaborative system that uses topological code processing for incremental context building to generate documentation by agents. |
| Outcome: | The proposed system outperforms baselines in completeness, helpfulness, and truthfulness evaluations. |
TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models rely on one-shot output without explicit verification, resulting in rough, incomplete, and potentially unsafe treatment plans. |
| Approach: | They propose an agentic framework that replaces one-shot generation with an iterative generate-judge-refine pipeline. |
| Outcome: | The proposed framework achieves state-of-the-art results on HealthBench, leading in Accuracy and Completeness. |
FRAME: Feedback-Refined Agent Methodology for Enhancing Medical Research Insights (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to automate scientific research are limited by human cognitive constraints and timeintensive workflows. |
| Approach: | They propose a framework that enhances medical paper generation through iterative refinement and structured feedback. |
| Outcome: | The proposed framework achieves significant improvements over conventional methods across multiple models and evaluation dimensions. |
InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents (2026.findings-acl)
Copied to clipboard
Zhenghao Zhu, Yuanfeng Song, Xing Chen, Chengzhong Liu, Cui Yakun, Caleb Chen Cao, Sirui Han, Yike Guo
| Challenge: | Existing frameworks for data analysis and insight exploration are lacking in terms of benchmarks . existing frameworks suffer from format inconsistencies, poorly conceived objectives, and redundant insights. |
| Approach: | They propose a data-curation pipeline to construct a new dataset named InsightEval. |
| Outcome: | The proposed benchmarks highlight prevailing challenges in automated insight discovery and raise key findings to guide future research. |
Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation (2026.acl-long)
Copied to clipboard
Jiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng, Jing Huang, Jiri Gesi, Ying Xu, Bingsheng Yao, Dakuo Wang
| Challenge: | Existing "LLM-as-a-judge" evaluation frameworks are limited by persona descriptions and are not generalizable to other tasks. |
| Approach: | They propose a framework that can automatically construct multiple evaluator personas with distinct dimensions from relevant text documents and instantiate LLM agents with the persona. |
| Outcome: | The proposed framework can believably simulate human evaluators . it extracts stakeholders' diverse perspectives from the provided research papers and constructs personas for the agents . |
Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on rigid pipelines that overlook user needs and provide numerical results without clear explanations. |
| Approach: | They propose an evaluation framework that employs human-like strategies for efficient, dynamic, multi-round evaluations using only a few samples per round. |
| Outcome: | The evaluation agent framework reduces evaluation time to 10% of traditional methods while delivering comparable results. |