Papers by Junyeong Kim
Are they lovers or friends? Evaluating LLMs’ Social Reasoning in English and Korean Dialogues (2026.acl-long)
Copied to clipboard
Eunsu Kim, Junyeong Park, Juhyun Oh, Kiwoong Park, Seyoung Song, A. Seza Doğruöz, Alice Oh, Najoung Kim
| Challenge: | Existing studies on LLMs' ability to infer social relationships have limited results for Korean and English. |
| Approach: | They propose a social reasoning task based on a 1.1k-dialogue dataset in English and Korean sourced from movie scripts to evaluate LLMs' ability to infer the social relationships between speakers. |
| Outcome: | The proposed task evaluates the ability of LLMs to infer the social relationships between speakers in 1.1k-dialogue datasets in English and Korean. |
QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing video-to-text summarization evaluation methods depend heavily on human-written reference summaries. |
| Approach: | They propose a reference-free metric evaluating candidate summaries directly against source videos through multimodal question answering. |
| Outcome: | The proposed metric assesses candidate summaries directly against source videos through multimodal question answering. |
Selective Test-Time Debiasing for CLIP via Reward Gating (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for debiasing use uniform bias corrections across all input queries . weak debiases retains bias in sensitive queries, while weak dealiases in biased ones . |
| Approach: | They propose a framework that selectively applies debiasing based on input sensitivity . RG-TTA adaptively triggers fairness regularization based upon bias sensitivity of each input . |
| Outcome: | Experiments show that debiasing improves zero-shot performance while maintaining fairness . weak debiased queries distort semantically meaningful information while weak ones fail to mitigate stereotypes . |
See More, Store Less: Memory-Efficient Resolution for Video Moment Retrieval (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing video moment retrieval methods rely on sparse frame sampling, risking information loss. |
| Approach: | a new video-based framework enhances memory efficiency while maintaining high information resolution . SMORE uses query-guided captions to encode semantics aligned with user intent . |
| Outcome: | a new framework improves memory efficiency while maintaining high information resolution . it achieves state-of-the-art performance on QVHighlights, Charades-STA, and ActivityNet-Captions benchmarks . |
Diffusion Models Through a Global Lens: Are They Culturally Inclusive? (2025.acl-long)
Copied to clipboard
Zahra Bayramli, Ayhan Suleymanzade, Na Min An, Huzama Ahmad, Eunsu Kim, Junyeong Park, James Thorne, Alice Oh
| Challenge: | Text-to-image diffusion models have produced compelling, detailed images from text prompts, but their ability to accurately represent cultural nuances remains an open question. |
| Approach: | They propose a benchmark to evaluate whether diffusion models can generate culturally specific images spanning ten countries. |
| Outcome: | The proposed model fails to generate culturally specific images spanning ten countries . it shows significant disparities in cultural relevance, description fidelity, and realism compared to real-world reference images. |
Learning to See through Sound: From VggCaps to Multi2Cap for Richer Automated Audio Captioning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing AAC datasets suffer from short and simplistic captions, limiting expressiveness and semantic depth. |
| Approach: | They propose a multi-modal dataset that pairs audio with corresponding video and leverages large language models to generate rich, descriptive captions. |
| Outcome: | The proposed framework outperforms existing benchmarks in caption length, lexical diversity, and human-rated quality. |
Investigating Counterfactual Unfairness in LLMs towards Identities through Humor (2026.acl-long)
Copied to clipboard
Shubin Kim, Yejin Son, Junyeong Park, Keummin Ka, Seungbeen Lee, Jaeyoung Lee, Hyeju Jang, Alice Oh, Youngjae Yu
| Challenge: | Large Language Models (LLMs) absorb social and cultural biases embedded in vast web-scale corpora and are increasingly deployed in high-stakes domains such as hiring, education, and law. |
| Approach: | They propose a framework to investigate counterfactual unfairness through humor by observing how the model’s responses change when we swap who speaks and who is addressed while holding other factors constant. |
| Outcome: | The proposed framework covers humor generation refusal, speaker intention inference, and relational/societal impact prediction tasks. |
Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing video-grounded dialogue systems suffer from text hallucination problem due to learning spurious correlations from the fact that answer sentences in the dataset usually include the words of input texts. |
| Approach: | They propose to decode an answer sentence to a question using video and dialogue contexts. |
| Outcome: | The proposed framework shows that it generates adequate conversational responses to the queries of humans while following up on video and dialogue context. |
HEAR: Hearing Enhanced Audio Response for Video-grounded Dialogue (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing systems are competent only to incorporate information in the video and text and tend to struggle in extracting the necessary information from the audio when generating appropriate responses to the question. |
| Approach: | They propose to perform sensible listening by selectively attending to audio whenever the question requires it. |
| Outcome: | The proposed framework enhances the accuracy and audibility of VGD systems in a model-agnostic manner. |
Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods for image-to-image translation lack structural integrity and attribute-specific control . Existing approaches lack semantics and provide fine-grained, attribute-based control compared to GAN-based methods . |
| Approach: | They propose a language-grounded attribute-controllable translation framework that grounds semantic differences into corresponding visual transformations while preserving unrelated structural and semantic content. |
| Outcome: | Experiments on CelebA(Dialog) and BDD100K show that LACE achieves high visual fidelity, structural preservation, and interpretable domain-specific control, surpassing baselines. |