Challenge: LVLMs have been shown to perform well on simple uni-modal benchmarks, but their detailed study on multi-modal models is still lacking.
Approach: They propose a framework to analyze the impact of compression on LVLMs on multi-modal input driven tasks.
Outcome: The proposed framework analyzes the impact of compression on generative performance of large vision language models on multi-modal input driven tasks.

Similar Papers

EffiVLM-BENCH: A Comprehensive Benchmark for Evaluating Training-Free Acceleration in Large Vision-Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for accelerating Large Vision-Language Models lack comprehensive evaluation across diverse backbones, benchmarks, and metrics.
Approach: They propose EffiVLM-BENCH framework for evaluating absolute performance and generalization and loyalty.
Outcome: The proposed framework offers insights into optimal strategies for accelerating LVLMs.
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing research on LLM compression focuses on general metrics like perplexity or downstream task accuracy.
Approach: They propose to quantify the effect of pruning and quantization on model quality . they use the LAMA and LM-Harness benchmarks to quantify compression techniques .
Outcome: The proposed compression techniques provide faster inference, smaller memory footprints, and enables local deployment.
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing quantization techniques have been categorized as 'simple' and 'highly efficient' however, their configurations vary from each other and cannot be fairly compared .
Approach: They propose a plug-and-play compression toolkit to explore the impact of quantization.
Outcome: The proposed toolkit explores the impact of quantization on large language models.
What Do Compressed Multilingual Machine Translation Models Forget? (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show that pre-trained models achieve state-of-the-art results in NLP tasks but their size makes it more challenging to apply them in resource-constrained environments.
Approach: They assess the impact of compression methods on multilingual Neural Machine Translation models for various language groups, gender, and semantic biases.
Outcome: The proposed compression methods improve models on different benchmarks for language groups, gender, and semantic biases.
An Examination of the Compositionality of Large Generative Vision-Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Recent studies have focused on the compositionality of vision-language models (VLMs) however, the performance of GVLMs in multimodal compositional reasoning remains under-explored.
Approach: They propose a syntactical bias score to quantify GVLMs' syntaktical bias . they propose 'SADE' task to assess GVLs's robustness against inclination toward syntical correctness.
Outcome: The proposed benchmarks are based on evaluation metrics and current benchmarks.
Beyond Perplexity: Multi-dimensional Safety Evaluation of LLM Compression (2024.findings-emnlp)

Copied to clipboard

Challenge: Prior work on compression prioritizes preserving perplexity, which is analogous to training loss.
Approach: They examine the impact of model compression along four dimensions: degeneration harm, representational harm, dialect bias, and language modeling and downstream task performance.
Outcome: The proposed compression methods can lead to unexpected consequences, the authors show . quantization preserves bias while pruning degrades quickly.
Comparing Text Compression Capabilities of Large Language Models with Traditional Compression Algorithms (2026.eacl-srw)

Copied to clipboard

Challenge: Experimental results show that large language models outperform baselines on non-English datasets . traditional methods remained dataset-agnostic, and the results suggest that current methods are impractical for the compression task.
Approach: They evaluate the non-English and unstructured text compression performance of Large Language Models . they compare them with traditional baselines on datasets from eight most widely spoken languages .
Outcome: The evaluated LLM outperformed baselines on non-English datasets . the results show that the current methods are highly impractical for the compression task .
Benchmarking Deflection and Hallucination in Large Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections when incomplete knowledge is retrieved.
Approach: They propose a dynamic curation pipeline that preserves benchmark difficulty over time . they propose 'vlm-DeflectionBench' benchmark to probe model behaviour under conflicting evidence .
Outcome: The proposed benchmarks overlook conflicts between visual and textual evidence and are prone to obsolescence . the proposed benchmark is based on 2,775 samples spanning diverse retrieval settings .
Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease.
Approach: They propose to use a multiple granularity attribute-centric benchmark and training mixture to evaluate LVLMs’ fine-grained visual comprehension ability.
Outcome: The proposed model improves on LLaVa-1.5, InstructBLIP and GPT-4V and demonstrates that they struggle to generate descriptive visual attributes based on a concept that appears within an input image despite their prominent zero-shot image captioning ability.
Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods (2026.acl-long)

Copied to clipboard

Challenge: Recent efforts to accelerate inference in Multimodal Large Language Models have focused on visual token compression.
Approach: They propose a framework that leverages downsampling as a discriminator to denoise existing benchmarks.
Outcome: The proposed evaluation framework leverages downsampling as a discriminator to denoise existing benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations