Challenge: Multi-modal Large Language Models (MLLMs) incur significant computational overhead due to the large number of vision tokens processed, limiting their practicality in resource-constrained environments.
Approach: They propose a language-guided vision token pruning method that can be integrated into existing MLLMs with minimal architectural changes.
Outcome: The proposed method reduces vision tokens by 90% and preserves model performance.

Similar Papers

DCP: Dual-Cue Pruning for Efficient Large Vision-Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods for large vision language models use visual tokens to prune . existing methods fail to balance efficiency and semantic alignment due to large number of visual token.
Approach: They propose a cross-modal pruning framework that considers textual semantics and visual self-attention to combine them to achieve efficient inference acceleration.
Outcome: The proposed pruning framework can retain only 25% of the visual tokens, with a minimal performance degradation of only 0.063% on LLaVA-1.5-13B.
Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem? (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal large language models have shown remarkable performance for cross-modal understanding and generation, yet suffer from severe inference costs.
Approach: They propose to prune redundant tokens in MLLMs to reduce computation and storage costs.
Outcome: The proposed method reduces the computational and storage costs of MLLMs by identifying redundant tokens and pruning them.
TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing pruning methods fail to account for unique token attributes across layers and modalities inherent to MLLMs.
Approach: They propose a pruning framework that takes into account unique token attributes across layers and modalities inherent to MLLMs.
Outcome: The proposed pruning framework outperforms existing pruning techniques on two state-of-the-art MLLMs.
Reducing Token Redundancy in LVLMs: A Systematic Review of Token Pruning Methods (2026.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) excel at visual understanding but face severe computational bottlenecks when processing high-resolution images and long videos due to massive visual token counts.
Approach: They propose a taxonomy categorizing methods into vision-side, LLM-side and hybrid paradigms and analyze token selection mechanisms and pruning strategy.
Outcome: The proposed method selectively removes less informative tokens while maintaining performance.
CoViPAL: Layer-wise Contextualized Visual Token Pruning for Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to prune redundant vision tokens struggle in shallow layers due to the lack of contextual information.
Approach: They propose a layer-wise contextualized visual token pruning method that uses a plug-and-play Pruning Module to prune redundant vision tokens.
Outcome: The proposed method outperforms training-free pruning methods under equal token budgets and surpasses training based methods with comparable supervision.
VisiPruner: Decoding Discontinuous Cross-Modal Dynamics for Efficient Multimodal LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) suffer from significant computational overhead due to the quadratic growth of attention computations with the number of multimodal tokens.
Approach: They propose a training-free pruning framework that prunes multimodal tokens without a trained pruning method.
Outcome: The proposed pruning framework outperforms existing token pruning methods and generalizes across diverse MLLMs.
TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing token pruning methods rely on costly calibration or suboptimal importance metrics, leading to redundant retained tokens.
Approach: They propose a token pruning strategy that preserves cross-modal alignment and informational diversity.
Outcome: The proposed method maintains strong performance while reducing tokens by 88.9% on two models.
Semantically Comprehensive Token Pruning in LVLMs via Maximizing Concept Coverage (2026.acl-long)

Copied to clipboard

Challenge: Existing visual token pruning methods leverage simple metrics derived from human experience, such as attention or similarity, to rank and select tokens within a highly entangled feature space.
Approach: They propose a novel visual token pruning method that uses a concept-driven paradigm to quantify the Marginal Semantic Gain of each token's contribution to uncovered concepts.
Outcome: The proposed method outperforms state-of-the-art methods in a concept-driven model while maintaining semantic completeness.
Less is More: A Simple yet Effective Token Reduction Method for Efficient Multi-modal LLMs (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models have led to a significant surge in the resource consumption of these models.
Approach: They propose a method to reduce image tokens using visual query data by using CLIP metrics to reduce computational overhead and maintain consistent performance.
Outcome: The proposed method has been extensively tested across 12 datasets and shows a significant reduction in computational overhead while maintaining a consistent level of performance.
AdaTP: Attention-Debiased Token Pruning for Video Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing visual token compression methods rely on attention scores but have inherent biases . global and local attention biased scores cause excessive computational overhead .
Approach: They propose a token pruning pipeline that targets global and local attention biases . the pipeline is designed to reduce computational overhead of Video Large Language Models based on visual tokens compiled from multiple video frames .
Outcome: The proposed method significantly reduces the computational overhead of Video Large Language Models while retaining the performance of vanilla models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations