Papers by Javier Chiyah-Garcia
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | In dialogue, the addressee may misunderstand the speaker and respond erroneously. |
| Approach: | They collect, analyse, and publicly release a dataset of multi-modal TPR sequences in dialogue . they evaluate several state-of-the-art Vision and Language Models across multiple settings . |
| Outcome: | The proposed model underperforms in a human-robot interaction task compared to humans . the proposed model can benefit from specialised losses targeting relevant tokens . |