Papers by Guanzhen Li
V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing large vision-language models suffer from hallucination due to over-reliance on the Large Language Model (LLM) backbone. |
| Approach: | They propose a method to improve visual context learning by using a large-scale preference learning algorithm to improve hallucination. |
| Outcome: | The proposed method improves on human-annotated hallucination datasets. |
ECHo: A Visio-Linguistic Dataset for Event Causality Inference via Human-Centric Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | ECHo is a diagnostic dataset of event causality inference grounded in visio-linguistic social scenarios. |
| Approach: | They propose a diagnostic dataset of event causality inference grounded in visio-linguistic social scenarios. |
| Outcome: | The proposed framework examines the reasoning capability of current AI systems on three human-centric tasks. |
MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LVLMs perform visual perception at multiple levels, but they are not able to perform multi-level tasks. |
| Approach: | They propose a visual–language benchmark to evaluate LVLMs' perceptions . they use manipulated images to examine how LVLs can perform multi-level tasks . |
| Outcome: | The proposed model performs poorly on high-level perception tasks, the authors show . they also show that current models do not generalize in understanding semantics of synthetic images . |