Zhaoyang Wang, Yiming Liang, Xuchao Zhang, Qianhui Wu, Siwei Han, Anson Bastos, Rujia Wang, Chetan Bansal, Baolin Peng, Jianfeng Gao, Saravan Rajmohan, Huaxiu Yao
| Challenge: | Existing studies have focused on synthetic supervision but have encountered data quality issues. |
| Approach: | They propose a fully synthetic supervision framework that aims at improving data quality via dual refinement of both tasks and trajectories. |
| Outcome: | The proposed framework outperforms existing methods on standardized benchmarks and shows promising results on a standardized test. |
Similar Papers
WebSynthesis: World Model-Guided Monte Carlo Tree Search for Efficient WebAgent Trajectory Synthesis (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have enabled increasingly capable web agents . however, training such agents at scale still relies on high-quality interaction trajectories that are difficult to obtain at scale. |
| Approach: | They propose a framework for scalable trajectory synthesis that simulates state transitions without network dependencies and integrates Monte Carlo Tree Search to enable reversible exploration over the simulated state space. |
| Outcome: | Experiments on WebArena, WebVoyager, and Mind2Web-Online show that agents trained exclusively on synthesized trajectories outperform those trained on real-world data. |
Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Existing agentic training data are narrow in task variety and easily solved . real-world APIs lack diversity and are unstable for large-scale reinforcement learning rollout processes. |
| Approach: | They propose a framework that synthesizes diverse tool-use training data and simulates complete environments. |
| Outcome: | The proposed framework synthesizes diverse tool-use training data and simulates complete environments. |
GTA: Generating Long-horizon Tasks for Web Agents at Scale (2026.acl-long)
Copied to clipboard
Tenghao Huang, Kung-Hsiang Huang, Prafulla Kumar Choubey, Yilun Zhou, Muhao Chen, Jonathan May, Chien-Sheng Wu
| Challenge: | Existing benchmarks provide only coarse start–goal annotations without intermediate trajectories . Existing frameworks provide no supervision over the agent's latent decision process . |
| Approach: | They propose a framework that integrates crawling, retrieval-based seeding, in-context generation and automated quality control to produce realistic tasks paired with executable trajectories. |
| Outcome: | The proposed framework decouples crawling from generation for greater efficiency and ensures dense supervision through deterministic replays and systematic validation. |
Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents (2025.findings-acl)
Copied to clipboard
Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou, Arindam Mitra, Spencer Whitehead, Yu Su, Ahmed Hassan Awadallah
| Challenge: | Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. |
| Approach: | They propose a scalable recipe to synthesize the largest and most diverse trajectory-level dataset to date. |
| Outcome: | The proposed model synthesizes the largest and most diverse trajectory-level dataset to date, with 94K successful multimodal web trajectories, 720K screenshots, and 33M web elements. |
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)
Copied to clipboard
Runnan Fang, Xiaobin Wang, Yuan Liang, Shuofei Qiao, Jialong Wu, Zekun Xi, Ningyu Zhang, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen
| Challenge: | Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks. |
| Approach: | They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment. |
| Outcome: | The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment. |
Anchor: Branch-Point Data Generation for GUI Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing GUI agents for real desktop environments require large amounts of high-quality interaction data, but collecting human demonstrations is expensive. |
| Approach: | They propose a framework that bootstraps scalable desktop supervision from seed demonstrations. |
| Outcome: | Experiments on standard desktop benchmarks show that the framework improves on zero-shot agents and representative synthesis baselines. |
TailorRPA: A Retrieval-Based Framework for Eliciting Personalized and Coherent Role-Playing Agents in General Domain (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has shown that general domain oriented role-playing agents can maintain character properties in a wide range of tasks beyond scenario based chit-chatting. |
| Approach: | They propose a retrieval-based framework to harvest tailored general domain instructions . they use general-domain protective queries to shape character-wise knowledge boundary . |
| Outcome: | The proposed framework improves integration of fine-grained memories and protects character knowledge boundary . it also improves character hallucination in general domain, compared to baseline methods . |
ProductResearch: Training E-Commerce Deep Research Agents via Multi-Agent Synthetic Trajectory Distillation (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing LLM-based agents lack the interaction depth and contextual breadth required for complex product research. |
| Approach: | They propose a multi-agent framework that synthesizes high-fidelity tool-use trajectories for training robust e-commerce shopping agents. |
| Outcome: | The proposed framework synthesizes high-fidelity, long-horizon tool-use trajectories for training robust e-commerce shopping agents. |
WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing datasets rely on human demonstrations, limiting scalability. |
| Approach: | They propose a scalable data synthesis pipeline that transforms noisy rollouts into reliable supervision without human annotation. |
| Outcome: | The proposed pipeline transforms noisy rollouts into reliable supervision without human annotation. |
SynthTextEval: Synthetic Text Data Generation and Evaluation for High-Stakes Domains (2025.emnlp-demos)
Copied to clipboard
Krithika Ramesh, Daniel Smolyak, Zihao Zhao, Nupoor Gandhi, Ritu Agarwal, Margrét V. Bjarnadóttir, Anjalie Field
| Challenge: | SynthTextEval is a toolkit for conducting comprehensive evaluations of synthetic text. |
| Approach: | They propose a toolkit for conducting comprehensive evaluations of synthetic text using large language models. |
| Outcome: | The proposed toolkit can be run over any dataset, but it is aimed at two high-stakes domains: healthcare and law. |