METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling (2025.acl-long)
Copied to clipboard
| Challenge: | Chart generation requires strong visual design skills and precise coding capabilities that embed the desired visual properties into code. |
| Approach: | They propose a vision-language model-based multi-agent framework for effective automatic chart generation. |
| Outcome: | The proposed framework achieves a 5.2% improvement in the F1 score over the current best chart generation task. |
Similar Papers
AMACE: Automatic Multi-Agent Chart Evolution for Iteratively Tailored Chart Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that chart generation requires manual input of code and intent . despite the benefits of large language models, chart generation still requires user input of many parameters . |
| Approach: | They propose a loop-based framework for automatically evolving charts in a multi-agent environment using large language models. |
| Outcome: | The proposed framework improves performance by 29.97% compared to first generation while reducing generation time by 86.9% compared with manual prompt-based methods. |
Does It Run and Is That Enough? Revisiting Text-to-Chart Generation with a Multi-Agent Approach (2025.findings-emnlp)
Copied to clipboard
| Challenge: | 15% of generated scripts fail to execute, even after supervised fine-tuning and reinforcement learning. |
| Approach: | They propose a lightweight multi-agent pipeline that separates drafting, execution, repair, and judgment . the system reduces execution errors to 4.5% within three repair iterations . |
| Outcome: | The proposed pipeline reduces execution errors to 4.5% within three repair iterations while requiring significantly less compute. |
C2: Scalable Auto-Feedback for LLM-based Chart Generation (2025.naacl-long)
Copied to clipboard
Woosung Koh, Janghan Yoon, MinHyung Lee, Youngjin Song, Jaegwan Cho, Jaehyun Kang, Taehyeon Kim, Se-Young Yun, Youngjae Yu, Bongshin Lee
| Challenge: | generating high-quality charts with Large Language Models presents significant challenges due to limited data and the high cost of curation. |
| Approach: | They propose a referencefree automatic feedback generator to generate high-quality charts with Large Language Models. |
| Outcome: | The proposed framework outperforms baselines and shows that it significantly improves data diversity. |
ChartM3: A Multi-Stage Code-Driven Pipeline for Constructing Multi-Dimensional and Multi-Step Visual Reasoning Data in Chart Comprehension (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, research on complex chart understanding tasks is limited . a pipeline for visual reasoning datasets addresses these limitations . |
| Approach: | They propose a code-driven pipeline for generating visual reasoning datasets . pipeline integrates retrieval-augmented generation to retrieve professional chart templates . |
| Outcome: | The proposed pipeline enhances chart diversity and data quality through model-based evaluation. |
S*: Test Time Scaling for Code Generation (2025.findings-emnlp)
Copied to clipboard
Dacheng Li, Shiyi Cao, Chengkun Cao, Xiuyu Li, Shangyin Tan, Kurt Keutzer, Jiarong Xing, Joseph E. Gonzalez, Ion Stoica
| Challenge: | S* is the first hybrid test-time scaling framework that significantly improves the coverage and selection accuracy of generated code. |
| Approach: | They propose a hybrid test-time scaling framework that augments parallel scaling with sequential scaling to further increase the performance. |
| Outcome: | The proposed framework outperforms existing scaling approaches in large-scale modeling and reasoning models. |
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive proficiency in natural language processing, but performance in code generation tasks remains limited. |
| Approach: | They propose a framework that emulates the full cycle of program synthesis as observed in humans. |
| Outcome: | The proposed framework replicates the full cycle of program synthesis as observed in human developers. |
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Yuying Li, Zhixun Li, Xingyu Guo, Jingzhuo Wu, Leqi Zheng, Yiran Yang, Jianke Zhang, Qingbin Li, Shannan Yan, Changguo Jia, Junfei Wu, Zilei Wang, Qiang Liu, Liang Wang
| Challenge: | Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed. |
| Approach: | They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting. |
| Outcome: | The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data. |
ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing open-source MLLMs fail to fully capture dense information embedded in charts . current models still face significant challenges in understanding and analyzing visual tasks such as captioning and question answering. |
| Approach: | They propose a chart-to-code MLLM which leverages Code LLMs as the language backbone to enhance the executability of the generated code. |
| Outcome: | The proposed model surpasses existing open-source models on chart-to-code benchmarks with only 7B parameters and provides lossless representations that contain all critical details. |
Distill Visual Chart Reasoning Ability from LLMs to MLLMs (2025.findings-emnlp)
Copied to clipboard
Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | a new method for generating chart annotations is proposed to improve visual reasoning in multimodal large language models. |
| Approach: | They propose a code-as-intermediary translation method for distilling visual reasoning abilities from LLMs to MLLMs. |
| Outcome: | The proposed method is cost-effective, efficient and scalable. |
Can Intelligent Agents Revolutionize Scale Generation? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing measurement scales require extensive manual labor and require extensive validation and validation. |
| Approach: | They propose a multi-agent framework that automates scale development by leveraging collaborative AI agents. |
| Outcome: | The proposed framework automates scale development while maintaining rigorous quality standards. |