MARIO-0.5B: A Multi-Agent Lightweight Model for Real-Time Open Information Extraction in Low-Resource Settings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have shown remarkable capabilities in open information extraction, but their resource requirements often restrict their deployment in resource-constrained industrial settings. |
| Approach: | They introduce an ultra-lightweight large language model trained on instruction-based samples in Chinese, English, Korean, and Russian. |
| Outcome: | The proposed model outperforms large-scale models with up to 70B parameters, reducing computational resources by 140x and delivering 11x faster response times. |
Similar Papers
CROSSAGENTIE: Cross-Type and Cross-Task Multi-Agent LLM Collaboration for Zero-Shot Information Extraction (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models struggle with producing structured output while maintaining accuracy in zero-shot information extraction (IE) |
| Approach: | They propose a multi-agent framework that enhances zero-shot IE through multi-task collaboration. |
| Outcome: | CROSSAGENTIE outperforms state-of-the-art models in structured prediction . the framework significantly reduces inference cost while preserving accuracy . |
MMUIE: Massive Multi-Domain Universal Information Extraction for Long Documents (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing document-level information extraction systems operate at the sentence level or within narrow domains due to annotation constraints. |
| Approach: | They propose a large-scale universal dataset for multi-domain, document-level information extraction from long texts. |
| Outcome: | The proposed dataset integrates traditional knowledge bases with large language models to extract fine-grained entities, aliases, and relation triples across 34 domains. |
ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing systems with opaque architectures are limiting deep search capabilities for web-augmented large language models. |
| Approach: | They propose a transparent and modular multi-agent framework to democratize deep search for LLMs. |
| Outcome: | The proposed framework outperforms open-source systems in deep reasoning tasks. |
Towards Effective and Efficient Multi-Agent Language Model Systems: Foundations, Prospects, and Applications (2026.acl-tutorials)
Copied to clipboard
| Challenge: | Multi-agent systems powered by large language models still face challenges . tutorial focuses on three core components to build effective and efficient systems . |
| Approach: | This tutorial introduces recent advances in building effective and efficient multi-agent LLM systems . it focuses on three core components: model distillation, dynamic routing, memory- and compute efficient serving . |
| Outcome: | This tutorial introduces state-of-the-art techniques for building efficient and efficient multi-agent LLM systems . it covers coordination and communication among agents, crucial for collective performance . |
AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Model (LLM) agents have demonstrated remarkable capabilities in task automation and intelligent decision-making. |
| Approach: | They propose a Fully-Automated and highly Self-Developing framework that enables users to create and deploy LLM agents using natural language alone. |
| Outcome: | AutoAgent is a fully-automated and highly self-developing framework that enables users to create and deploy LLM agents using natural language alone. |
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)
Copied to clipboard
Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, Chenyang Liao, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang
| Challenge: | Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents. |
| Approach: | They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
| Outcome: | The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
LMDX: Language Model-based Document Information Extraction and Localization (2024.findings-acl)
Copied to clipboard
Vincent Perot, Kai Kang, Florian Luisier, Guolong Su, Xiaoyu Sun, Ramya Sree Boppana, Zilong Wang, Zifeng Wang, Jiaqi Mu, Hao Zhang, Chen-Yu Lee, Nan Hua
| Challenge: | Large Language Models have revolutionized Natural Language Processing but their application in extracting information from visually rich documents has not been successful. |
| Approach: | They propose a language model-based document information extraction and localization methodology to reframe the document information extract task for a LLM. |
| Outcome: | The proposed method enables extraction of singular, repeated, and hierarchical entities with and without training data. |
CycleOIE: A Low-Resource Training Framework For Open Information Extraction (2025.coling-main)
Copied to clipboard
Zhihong Jin, Chunhong Zhang, Zheng Hu, Jibin Yu, Ruiqi Ma, Qingyun Chen, Xiaohao Liao, Yanxing Zhang
| Challenge: | Open Information Extraction (OpenIE) models rely heavily on large amounts of annotated data. |
| Approach: | They propose a training framework that maximizes data efficiency through a cycle-consistency mechanism. |
| Outcome: | The proposed approach improves the quality of training data by curating low-quality datasets annotated by a large language model. |
Multiˆ2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERT (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing open IE systems were based on handcrafted features or fine-grained rules. |
| Approach: | They propose a multi-head argument extraction method using multi-lingual BERT . they use a query, key, and value setting inspired by the Multimodal Transformer . |
| Outcome: | The proposed method outperforms existing sequence-labeling systems on two benchmark datasets and on two languages without training data. |
TinyAgent: Function Calling at the Edge (2024.emnlp-demo)
Copied to clipboard
Lutfi Erdogan, Nicholas Lee, Siddharth Jha, Sehoon Kim, Ryan Tabrizi, Suhong Moon, Coleman Hooper, Gopala Anumanchipalli, Kurt Keutzer, Amir Gholami
| Challenge: | Recent large language models (LLMs) have enabled the development of advanced agentic systems that can integrate various tools and APIs to fulfill user queries. |
| Approach: | They propose an end-to-end framework for training and deploying task-specific small language model agents capable of function calling for driving agentic systems at the edge. |
| Outcome: | The proposed model outperforms existing models by reducing the input prompt length and quantizing the inference speed. |