SlimLM: An Efficient Small Language Model for On-Device Document Assistance (2025.acl-demo)
Copied to clipboard
| Challenge: | Small language models (SLMs) show promise for mobile deployment, but their real world performance and applications on smartphones remain understudied. |
| Approach: | They propose a slim language model with a model size of 125M to 8B and a context length of 8B for efficient on-device processing. |
| Outcome: | The proposed model is based on a Samsung Galaxy S24 and shows comparable or superior performance. |
Similar Papers
Demystifying Small Language Models for Edge Deployment (2025.acl-long)
Copied to clipboard
Zhenyan Lu, Xiang Li, Dongqi Cai, Rongjie Yi, Fangming Liu, Wei Liu, Jian Luan, Xiwen Zhang, Nicholas D. Lane, Mengwei Xu
| Challenge: | Small language models (SLMs) are a promising solution for resource-constrained devices such as smartphones and the Web of Things. |
| Approach: | They propose to use SLMs to build and optimize a set of small language models that are publicly accessible. |
| Outcome: | The proposed models outperform 7B models in general tasks, while their in-context learning capabilities remain limited and their efficiency has significant optimization potential. |
CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Methods for adapting language models to new tasks and domains have traditionally assumed white-box access to the model and work by modifying its parameters. |
| Approach: | They propose a method for adapting large language models to new domains and tasks . they fine-tune a small white-box LM and combine it with a large black-box model at the probability level through a network, learned on a smaller validation set. |
| Outcome: | The proposed method improves performance in all cases, while using a domain expert 23x smaller. |
Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) provide robots with contextual reasoning abilities to comprehend human instructions. |
| Approach: | They propose a framework that enables reliable SLM-driven robot operation by distilling LLMs’ knowledge and reasoning. |
| Outcome: | The proposed framework enables reliable SLM-driven robot operation by distilling LLMs’ knowledge and reasoning. |
Evaluating Small Language Models for News Summarization: Implications and Factors Influencing Performance (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) provide superior summarization quality, but their high computational resource requirements limit practical use applications. |
| Approach: | They evaluate 19 small language models for news summarization across 2,000 news samples . they find that top-performing models achieve comparable results to those of 70B LLMs . |
| Outcome: | The proposed models achieve comparable results to 70B LLMs while generating more concise summaries. |
MiniRAG: A Lightweight RAG system with Small Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RAG frameworks rely on Large Language Models (LLMs) for all stages of the process, resulting in high computational costs and resource demands. |
| Approach: | They propose a semantic-aware heterogeneous graph indexing mechanism that combines text chunks and named entities in a unified structure and a lightweight topology-enhanced retrieval approach that leverages graph structures for efficient knowledge discovery without requiring advanced language capabilities. |
| Outcome: | The proposed system achieves comparable performance to LLM-based methods while requiring only 25% of the storage space. |
TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks (2026.findings-acl)
Copied to clipboard
Yuanze Hu, Xinyu Wang, Zhichao Yang, Gen Li, Ye Qiu, Zhaoxin Fan, Yifan Sun, Wenjun wu, Jin Dong, Xiaotie Deng
| Challenge: | Lightweight Vision-Language Models (VLMs) are indispensable for resource-constrained applications. |
| Approach: | They propose a framework that retrieves context from a memory bank to enhance alignment . they propose EMI-based approach to align vision and language models . |
| Outcome: | The proposed framework reduces training loss, accelerates convergence, and enhances task performance with negligible computational overhead. |
Rethinking Scale: Deployment Trade-offs of Small Language Models under Agent Paradigms (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing research focuses on enhancing large language models through scaling laws or fine-tuning strategies, but ignores the potential of using agent paradigms to compensate for the inherent weaknesses of small models. |
| Approach: | They propose to use structured agent frameworks to improve effectiveness over direct prompting . they also propose to employ routing-based multi-agent systems with collaborative capabilities . |
| Outcome: | The proposed model significantly outperforms direct prompting with single-agent systems . the proposed model is more reliable and cost-effective than other models . |
Counterspeech Generation using Small Language Models (2026.acl-srw)
Copied to clipboard
| Challenge: | Social media use is growing annually with about 68.5% of the global population active on these platforms as of July 2025. |
| Approach: | They evaluate SLMs ranging from 100 million to 3 billion parameters using simple prompting strategies as well as fine-tuning, combining automatic and robust human evaluations. |
| Outcome: | The proposed models generate relevant, coherent, and high-quality counterspeech, suggesting their suitability for efficient and responsible deployments. |
SLM-Bench: A Comprehensive Benchmark of Small Language Models on Environmental Impacts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | SLMs offer computational efficiency and accessibility, yet a systematic evaluation of their performance and environmental impact remains lacking. |
| Approach: | SLM-Bench evaluates 15 SLMs on 9 NLP tasks using 23 datasets . compared accuracy, computational efficiency, and sustainability metrics . |
| Outcome: | SLM-Bench evaluates 15 SLMs on 9 NLP tasks using 23 datasets spanning 14 domains. |
On-device System of Compositional Multi-tasking in Large Language Models (2025.emnlp-industry)
Copied to clipboard
Ondrej Bohdal, Konstantinos Theodosiadis, Asterios Mpatziakas, Dimitrios Filippidis, Iro Spyrou, Christos Zonios, Anastasios Drosou, Dimosthenis Ioannidis, Kyenghun Lee, Jijoong Moon, Hyeonmok Ko, Mete Ozay, Umberto Michieli
| Challenge: | Existing approaches to generative AI for large language models struggle when executing complex tasks simultaneously. |
| Approach: | They propose a novel approach tailored specifically for compositional multi-tasking scenarios . they add a learnable projection layer on top of the combined summarization and translation adapters. |
| Outcome: | The proposed approach performs well and is fast in both cloud-based and on-device implementations. |