Challenge: Existing approaches to video token pruning face significant computational challenges due to the redundancy inherent in video data.
Approach: They propose a training-free visual token pruning method that reduces the redundancy inherent in video data and leverages LLMs’ inherent ability to selectively prune visual tokens irrelevant to specific queries.
Outcome: The proposed method can prune over 80% of tokens while maintaining competitive performance when combined with different video LLMs.

Similar Papers

TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing token pruning methods rely on costly calibration or suboptimal importance metrics, leading to redundant retained tokens.
Approach: They propose a token pruning strategy that preserves cross-modal alignment and informational diversity.
Outcome: The proposed method maintains strong performance while reducing tokens by 88.9% on two models.
Vista-LLM: Decoupled Query-Guided Visual Token Pruning for Efficient Long-Video Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Long-video understanding is bottlenecked by the high cost of processing massive visual tokens.
Approach: They propose a decoupled framework for query-guided visual token pruning . their method reduces visual tokens by 90% and accelerates inference by 98% .
Outcome: The proposed framework reduces visual tokens by 90% and accelerates inference while retaining over 98% of baseline performance on average.
MoPrune: Scene-Guided Motion-Aware Token Pruning for Efficient Video Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Prior approaches to token pruning ignore video dynamics and the fact that different scenes exhibit different redundancy patterns.
Approach: They propose a token pruning framework that is train-free and scene-guided to accelerate VideoLLMs by removing redundant visual information from video frames.
Outcome: MoPrune is a training-free, scene-guided and motion-centric token pruning framework for accelerating VideoLLMs.
Reducing Token Redundancy in LVLMs: A Systematic Review of Token Pruning Methods (2026.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) excel at visual understanding but face severe computational bottlenecks when processing high-resolution images and long videos due to massive visual token counts.
Approach: They propose a taxonomy categorizing methods into vision-side, LLM-side and hybrid paradigms and analyze token selection mechanisms and pruning strategy.
Outcome: The proposed method selectively removes less informative tokens while maintaining performance.
CoViPAL: Layer-wise Contextualized Visual Token Pruning for Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to prune redundant vision tokens struggle in shallow layers due to the lack of contextual information.
Approach: They propose a layer-wise contextualized visual token pruning method that uses a plug-and-play Pruning Module to prune redundant vision tokens.
Outcome: The proposed method outperforms training-free pruning methods under equal token budgets and surpasses training based methods with comparable supervision.
Language-Guided Temporal Token Pruning for Efficient VideoLLM Processing (2025.emnlp-main)

Copied to clipboard

Challenge: Current models struggle with long-form videos due to the quadratic complexity of attention mechanisms.
Approach: They propose a model-agnostic framework that leverages temporal cues from queries to prune video tokens.
Outcome: The proposed framework reduces computation by 65% while preserving 97-99% of original performance.
AdaTP: Attention-Debiased Token Pruning for Video Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing visual token compression methods rely on attention scores but have inherent biases . global and local attention biased scores cause excessive computational overhead .
Approach: They propose a token pruning pipeline that targets global and local attention biases . the pipeline is designed to reduce computational overhead of Video Large Language Models based on visual tokens compiled from multiple video frames .
Outcome: The proposed method significantly reduces the computational overhead of Video Large Language Models while retaining the performance of vanilla models.
SpecVLM: Enhancing Speculative Decoding of Video LLMs via Verifier-Guided Token Pruning (2025.emnlp-main)

Copied to clipboard

Challenge: Video large language models (Vid-LLMs) rely on dense video token representations and require substantial memory and computational overhead in both prefilling and decoding.
Approach: They propose a training-free speculative decoding framework that prunes up to 90% of video tokens to enable efficient speculation without sacrificing accuracy.
Outcome: The proposed framework achieves 2.68 speedup on LLaVA-OneVision-72B and 2.11 speed up on Qwen2.5-VL-32B.
VisPCO: Visual Token Pruning Configuration Optimization via Budget-Aware Pareto-Frontier Learning for Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for visual token pruning rely on predefined configurations without determining whether they achieve optimal performance.
Approach: They propose a framework that formulates visual token pruning as a Pareto configuration optimization problem to automatically identify optimal configurations.
Outcome: The proposed framework approximates the empirical Pareto frontier obtained through grid search and generalizes well across pruning methods and VLM architectures.
Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem? (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal large language models have shown remarkable performance for cross-modal understanding and generation, yet suffer from severe inference costs.
Approach: They propose to prune redundant tokens in MLLMs to reduce computation and storage costs.
Outcome: The proposed method reduces the computational and storage costs of MLLMs by identifying redundant tokens and pruning them.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations