Papers by Mark Colley
Automating eHMI Action Design with LLMs for Automated Vehicle Communication (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, eHMIs employ predefined text messages and manually designed actions to perform these messages . this limits the real-world deployment of ehMIs, where adaptability in dynamic scenarios is essential. |
| Approach: | They propose a pipeline that integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
| Outcome: | The proposed pipeline integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers (2026.acl-long)
Copied to clipboard
| Challenge: | External Human-Machine Interfaces (eHMIs) are emerging as promising solutions to address this communication gap. |
| Approach: | They propose a framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. |
| Outcome: | The proposed framework outperforms prompt-only LLM designers and manually specified baselines in three eHMI modalities and multiple LLM model sizes. |