Papers by Iñigo Alonso
PixT3: Pixel-based Table-To-Text Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Table-to-text generation is a visual recognition task that uses textual descriptions from structured inputs. |
| Approach: | They propose to rethink data-to-text generation as a visual recognition task by removing the need for rendering the input in a string format. |
| Outcome: | The proposed model overcomes the challenges of linearization and input size limitations and is applicable to open-ended and controlled generation settings. |
Vision-Language Models Struggle to Align Entities across Modalities (2025.findings-acl)
Copied to clipboard
| Challenge: | Several real-world applications require the ability to perform cross-modal entity linking . cross-functional entity linking is a skill needed for multimodal code generation and scene understanding . |
| Approach: | They propose a task and benchmark to evaluate cross-modal entity linking performance . they use visual scenes aligned with their textual representations to evaluate performance a question-answering task . |
| Outcome: | The proposed task and benchmark aims to improve cross-modal entity linking performance . it evaluates state-of-the-art vision-language models and humans on the task . |