Papers by Georgios Pantazopoulos

5 papers
Multitask Multimodal Prompted Training for Interactive Embodied Task Completion (2023.emnlp-main)

Copied to clipboard

Challenge: Embodied MultiModal Agent (EMMA) is a unified encoder-decoder model that reasons over images and trajectories and casts action prediction as multimodal text generation.
Approach: They propose an Embodied MultiModal Agent (EMMA) that uses a unified encoder-decoder model that reasons over images and trajectories and casts action prediction as multimodal text.
Outcome: The proposed model performs on par with similar models on several VL benchmarks and sets a new state-of-the-art success rate on the Dialog-guided Task Completion (DTC) benchmark.
CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts (2025.naacl-long)

Copied to clipboard

Challenge: Recent Vision and Language models have shown impressive performance across benchmarks . however, frontier models lack cultural awareness and can affect global cultural diversity .
Approach: They propose a visual question answering benchmark to probe the knowledge of culture-specific concepts and evaluate the capacity for cultural adaptation through contextual information.
Outcome: The proposed model shows large performance disparities between culture-specific and common concepts in the parametric setting.
Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling (2024.emnlp-main)

Copied to clipboard

Challenge: a task-agnostic visual encoding yields minimal performance gains on grounding, but Transformers outperform Mamba at in-context multimodal retrieval.
Approach: They propose to replace Transformers in Visual Language Models with Mamba, a structured state space model that demonstrates promising performance in sequence modeling.
Outcome: The proposed model outperforms Transformers-based models in captioning, question answering, and reading comprehension.
Lost in Space: Probing Fine-grained Spatial Understanding in Vision and Language Resamplers (2024.naacl-short)

Copied to clipboard

Challenge: Recent approaches for developing vision and language models leverage existing vision and a language expert and try to learn a mapping between them.
Approach: They propose to use a resampler module to create a ‘visual prompt’ which is then fed to the large language models (LLM) using a textual prompt.
Outcome: The proposed method has been shown to be effective across coarse-grained tasks like image captioning and visual question answering, but more fine-grounded tasks that require spatial understanding have not been thoroughly examined.
Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users (2025.acl-long)

Copied to clipboard

Challenge: Despite high adoption rate of Large Language Models, there are limitations related to contextual understanding, cultural sensitivity, and complex scene understanding.
Approach: They conduct a user survey to identify adoption patterns and key challenges users face with such technologies.
Outcome: The proposed models have high adoption rates but still face limitations in visual aids.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations