Challenge: Existing studies have explored textual graph descriptions and visual modalities for VLMs to understand graphs.
Approach: They propose a unified framework that enhances both scalability and modality coordination in graph understanding by integrating textual and visual modalities.
Outcome: GraphVista scales to large graphs, 200 larger than those used in existing benchmarks, and consistently outperforms existing textual, visual, and fusion-based methods.

Similar Papers

Advancement in Graph Understanding: A Multimodal Benchmark and Fine-Tuning of Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Graph data organizes complex relationships and interactions between objects . Graph neural networks (GNNs) are becoming more popular in graph learning .
Approach: They propose a new paradigm for interactive and instructional graph data understanding and reasoning . they first evaluate the capabilities of public VLMs in graph learning from multiple aspects .
Outcome: The proposed model achieves an accuracy increase of 5%-15% compared to baseline models . the best-performing model achieve scores comparable to Gemini in GPT-asissted Evaluation .
Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains.
Approach: They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks.
Outcome: Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information.
Graph-Assisted Large Language Models: A Perspective on Mitigating Intrinsic Limitations (2026.findings-acl)

Copied to clipboard

Challenge: Large language models exhibit intrinsic limitations such as knowledge cutoff, single-threaded reasoning that hinders finer-grained branch and aggregation, and rigid collaboration mechanisms that struggle to coordinate specialized capabilities.
Approach: They propose a taxonomy spanning *Graph-Assisted Knowledge Augmentation*, *Graph Assisted Reasoning and Planning*, and *Graphed LLM Collaboration*.
Outcome: The proposed models show that graphs can augment and correct LLMs and support dynamic coordination among experts and agents in collaborative settings.
MuSe: Multi-Stage Graph Reasoning via Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Graph Neural Networks (GNNs) and graph transformers are inadequate for tasks with limited generalization.
Approach: They propose a multi-stage graph reasoning framework based on vision-language models that incrementally samples and visualizes task-relevant subgraphs.
Outcome: The proposed framework outperforms existing benchmarks in Graph-related tasks.
GraphInsight: Unlocking Insights in Large Language Models for Graph Structure Understanding (2025.acl-long)

Copied to clipboard

Challenge: Large language models struggle with comprehending graphical structure information through prompts of graph description sequences, especially as the graph size increases.
Approach: They propose a framework to improve LLMs’ comprehension of both macro- and micro-level graphical information by placing critical graphical data in positions where LLM's exhibit stronger memory performance.
Outcome: The proposed framework outperforms all other graph description methods in understanding graph structures of varying sizes.
Which Modality should I use - Text, Motif, or Image? : Understanding Graphs with Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Current research typically employs limited setups with small real-world graphs.
Approach: They propose a new approach to encoding a graph with diverse modalities, such as text, image, and motif, coupled with prompts to approximate a diagram’s global connectivity.
Outcome: The proposed approach improves performance of LLMs in graph structure analysis by focusing on homophily, motif presence, and graph difficulty.
Can VLMs Actually See and Read? A Survey on Modality Collapse in Vision-Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Vision-language models integrate textual and visual information, enabling them to process visual inputs and generate predictions.
Approach: They review work on modality collapse analysis to provide insights into the reason for this unintended behavior and review probing studies for fine-grained vision-language understanding.
Outcome: The proposed models can achieve competitive performance in vision-language tasks despite relying heavily on textual information and ignoring visual information.
Are Large Vision Language Models up to the Challenge of Chart Comprehension and Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have demonstrated that large vision language models (LVLMs) are not multi-modal and lack multi-tasking capabilities.
Approach: They evaluate the performance of large vision language models (LVLMs) for chart understanding and reasoning tasks and compare them to open-source models.
Outcome: The proposed models demonstrate impressive abilities in generating fluent texts covering high-level data insights, but they also encounter common problems like hallucinations, factual errors, and data bias.
Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects (2026.findings-acl)

Copied to clipboard

Challenge: Large Vision-Language Models are hindered by a systemic efficiency barrier known as visual token dominance.
Approach: They propose a systematic taxonomy of efficiency techniques structured around the inference lifecycle . they examine visual encoding, prefilling, and decoding to understand bottlenecks .
Outcome: The proposed techniques reveal how upstream decisions dictate downstream bottlenecks . the proposed techniques include hybrid compression and modality-aware decoding .
UnifiedVisual: A Framework for Constructing Unified Vision-Language Datasets (2025.emnlp-main)

Copied to clipboard

Challenge: Existing datasets address understanding and generation in isolation, limiting the performance of unified vision large language models.
Approach: They propose a dataset that facilitates mutual enhancement between multimodal understanding and generation.
Outcome: The proposed framework integrates diverse visual and textual inputs and outputs, enabling comprehensive cross-modal reasoning and precise text-to-image alignment.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations