Papers by Greta Gandolfi

Papers by Greta Gandolfi

Findings

2020.findings-emnlp

multimodal models
universal multimodal encoders
language and vision tasks

2020

Multimodality

1 papers

Be Different to Be Better! A Benchmark to Leverage the Complementarity of Language and Vision (2020.findings-emnlp)

Copied to clipboard

Sandro Pezzelle, Claudio Greco, Greta Gandolfi, Eleonora Gualdoni, Raffaella Bernardi

Challenge:	BD2BB is a language and vision benchmark that requires multimodal models combine complementary information from the two modalities.
Approach:	They propose a novel language and vision benchmark that requires multimodal models combine complementary information from both modalities.
Outcome:	The proposed model is easy for humans, but poor for humans . it compares state-of-the-art models against human speakers to show that it performs well.