Challenge: Existing adaptation methods overlook structural knowledge between text and image modalities or create overly complex graphs containing redundant information for alignment.
Approach: They propose a method to adapt visual models to downstream tasks using text and image modalities.
Outcome: The proposed method improves classification accuracy by 1.51% for 1-shot and 0.74% for 16-shot on 11 datasets.

Similar Papers

Advancement in Graph Understanding: A Multimodal Benchmark and Fine-Tuning of Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Graph data organizes complex relationships and interactions between objects . Graph neural networks (GNNs) are becoming more popular in graph learning .
Approach: They propose a new paradigm for interactive and instructional graph data understanding and reasoning . they first evaluate the capabilities of public VLMs in graph learning from multiple aspects .
Outcome: The proposed model achieves an accuracy increase of 5%-15% compared to baseline models . the best-performing model achieve scores comparable to Gemini in GPT-asissted Evaluation .
How to Make LMs Strong Node Classifiers? (2026.findings-eacl)

Copied to clipboard

Challenge: Language Models (LMs) are increasingly challenging the dominance of domain-specific models, such as Graph Neural Networks (GNNs) and Graph Transformers (GTs).
Approach: They propose a novel approach that empowers off-the-shelf LMs to achieve performance comparable to state-of-the art (SOTA) GNNs on node classification tasks without requiring any architectural modifications.
Outcome: The proposed approach outperforms existing GNNs on node classification tasks and is open-source upon publication.
Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision? (2025.acl-long)

Copied to clipboard

Challenge: Graph Neural Networks (GNNs) with CLIP pipeline are difficult because of the scarcity of labeled data and text supervision, different levels of downstream tasks, and conceptual gaps between domains.
Approach: They propose a multi-modal prompt learning paradigm to adapt pre-trained GNNs to downstream tasks with weak text supervision.
Outcome: The proposed model can generalize graphs to unseen classes with weak text supervision.
Advancing Vision-Language Models with Adapter Ensemble Strategies (2024.findings-emnlp)

Copied to clipboard

Challenge: CLIP revolutes vision-language pretraining by using contrastive learning on paired web data.
Approach: They propose to combine a "adapter ensemble" with traditional machine learning techniques to augment large-scale pretrained vision-language models.
Outcome: The proposed model outperforms baselines and derives improvement when the number of ensemble parameters increases.
MuSe: Multi-Stage Graph Reasoning via Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Graph Neural Networks (GNNs) and graph transformers are inadequate for tasks with limited generalization.
Approach: They propose a multi-stage graph reasoning framework based on vision-language models that incrementally samples and visualizes task-relevant subgraphs.
Outcome: The proposed framework outperforms existing benchmarks in Graph-related tasks.
Which Modality should I use - Text, Motif, or Image? : Understanding Graphs with Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Current research typically employs limited setups with small real-world graphs.
Approach: They propose a new approach to encoding a graph with diverse modalities, such as text, image, and motif, coupled with prompts to approximate a diagram’s global connectivity.
Outcome: The proposed approach improves performance of LLMs in graph structure analysis by focusing on homophily, motif presence, and graph difficulty.
Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification using Graph Neural Networks? (2023.findings-emnlp)

Copied to clipboard

Challenge: Graph Neural Networks have been used for text classification, but only in domains with limited data characteristics.
Approach: They compare graph representation methods for text classification using different architectures and setups.
Outcome: The proposed graph representation methods outperform other models in document comprehension tasks.
Transforming Visual Scene Graphs to Image Captions (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to generate captions using image captioning are based on multi-head attention (MHA)
Approach: They propose to transform scene graphs into more descriptive captions by using multi-head attention to build a Graph Neural Network (GNN) . they construct a Mixture-of-Expert (MOE)-based decoder where each expert is built on MHA for discriminating the graph embeddings to generate different kinds of words.
Outcome: The proposed framework can generate captions from multiple visual features and objects . it is based on a mixture-of-expert (MOE)-based decoder based upon MHA .
Be More with Less: Hypergraph Attention Networks for Inductive Text Classification (2020.emnlp-main)

Copied to clipboard

Challenge: Text classification is a critical research topic with broad applications in natural language processing. graph neural networks (GNNs) have received increasing attention but their performance is jeopardized in practice.
Approach: They propose a model which captures long-distance interactions between words and a graph-based model which can be used to perform text classification.
Outcome: The proposed model can achieve more expressive power with less computational consumption on the text classification task.
Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks (N18-2)

Copied to clipboard

Challenge: Semantic representations have long been argued as potentially useful for enforcing meaning preservation and improving generalization performance of machine translation methods.
Approach: They propose to integrate semantic representations into neural machine translation by injecting a semantic bias into sentence encoders and achieving improvements in BLEU scores.
Outcome: The proposed representations achieve better BLEU scores over the linguistic-agnostic and syntax-aware versions on the English–German language pair.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations