Papers with SOPs
How to Train a Real-World Silicon Concierge? Internalizing Complex Business Workflow to Only OneModel (2026.acl-industry)
Copied to clipboard
| Challenge: | Traditional industrial agents rely on modular workflows that fracture into a labyrinth of ad-hoc patches, leading to cascading errors and high latency. |
| Approach: | They propose a paradigm shift from external workflows to internalized knowledge representation that consolidates complex business logic and SOPs directly into the model’s parameters. |
| Outcome: | The proposed model breaks the impossible triangle of latency, accuracy, and complexity. |
I-SEE: An Instruction-tuned, SOP-Enhanced Quality Evaluator for Product Content (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to content evaluation treat information uniformly without prioritizing based on customer relevance. |
| Approach: | They propose a framework that combines domain expertise with a single instruction to improve content. |
| Outcome: | a new framework outperforms existing models in detecting inconsistencies across 20 product categories and 150 product specific features. |
MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-agent systems lack agent coordination and rely on predefined procedures . existing systems lack adaptive task coordination when task is big and complex . |
| Approach: | They propose a large-scale autonomous LLM-based multi-agent system that generates agents based on task complexity and enables dynamic task decomposition, parallel execution, efficient communication and comprehensive system monitoring. |
| Outcome: | The proposed system outperforms existing systems in task completion efficiency and scalability. |
SupChain-Bench: Benchmarking Large Language Models for Real-World Supply Chain Management (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have shown promise in complex reasoning and tool-based decision making, but supply chain workflows require reliable long-horizon, multi-step orchestration grounded in domain-specific procedures. |
| Approach: | They propose a unified real-world benchmark that assesses supply chain domain knowledge and long-horizon tool-based orchestration grounded in standard operating procedures. |
| Outcome: | The proposed framework achieves the strongest and consistent tool-calling performance in real-world operational settings. |
SOP-Maze: Evaluating Large Language Models on Complicated Business Standard Operating Procedures (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are widely deployed as domain-specific agents, but evaluation of their capabilities in such contexts has not been fully explored. |
| Approach: | They propose a benchmark to evaluate LLMs' ability to follow instructions and make decisions in real-world scenarios. |
| Outcome: | The proposed benchmark is constructed from real-world business data and adapted into 23 complex SOP scenarios. |