Papers by Morris Alper
ICC : Quantifying Image Caption Concreteness for Multimodal Dataset Curation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to curation text-image data are noisy and lack the fine-grained ability to isolate the most concrete samples that provide the strongest signal for learning in a noisy dataset. |
| Approach: | They propose a metric that evaluates caption text without an image reference to measure its concreteness and relevancy. |
| Outcome: | The proposed method detects the concreteness of captions without an image reference and correlates with human evaluation of concreteness in both single-word and caption-level texts. |
ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipeline (2026.acl-long)
Copied to clipboard
| Challenge: | Constructed languages (conlangs) have played diverse roles in art, philosophy, and international communication. foundation models have revolutionized creative generation in text, images, and beyond. |
| Approach: | They propose a multi-hop pipeline that decomposes language design into modular stages . they use LLMs' metalinguistic reasoning capabilities to encourage diversity . |
| Outcome: | The proposed pipeline decomposes language design into modular stages . it leverages LLMs’ metalinguistic reasoning capabilities to encourage diversity and self-refinement feedback to encourage consistency and typological diversity. |
Mitigating Open-Vocabulary Caption Hallucinations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for image captioning ignore the long-tailed nature of hallucinations . a new framework is proposed to address hallucines in image captions in the open-vocabulary setting . |
| Approach: | They propose a framework to address hallucinations in image captioning in the open-vocabulary setting. |
| Outcome: | The proposed framework surpasses the CHAIR benchmark in diversity and accuracy in open-vocabulary captioning. |