Papers by Subin Kim
Transparent Reference-free Automated Evaluation of Open-Ended User Survey Responses (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to evaluate open-ended survey responses are expensive and lack ground-truth reference for comparison. |
| Approach: | They propose a two-stage evaluation framework specifically designed for human survey responses that uses gibberish filtering to remove nonsensical responses. |
| Outcome: | The proposed evaluation framework outperforms existing metrics on English and Korean datasets and shows strong correlations with expert assessment. |
Multimodal Cognitive Reframing Therapy via Multi-hop Psychotherapeutic Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on text-based cognitive reframing, but neglected the importance of non-verbal evidence in real-life therapy. |
| Approach: | They propose a dataset that pairs each GPT-4-generated dialogue with an image that reflects the virtual client’s facial expressions to better mirror real psychotherapy, where facial expression leads to interpreting implicit emotional evidence. |
| Outcome: | The proposed approach outperforms existing methods with LLMs and vision-language models and provides more thoughtful and empathetic suggestions. |
FinHarmBench: Financial Jailbreak Benchmark and Unsupervised Safety Fine-Tuning via Refusal Steering Distillation (2026.acl-industry)
Copied to clipboard
Yubin Choi, Yujin Yang, Subin Kim, Seokil Ham, Seungju Cho, Jungmin Son, Youngjun Kwak, Changick Kim
| Challenge: | Existing safety benchmarks focus on general harms and lack the granularity needed to capture domain-specific financial threats. |
| Approach: | They propose a benchmark to evaluate financially harmful and confusable benign prompts. |
| Outcome: | The proposed framework improves refusal behavior without annotating refusal responses. |
FLUID QA: A Multilingual Benchmark for Figurative Language Usage in Dialogue across English, Chinese, and Korean (2025.emnlp-main)
Copied to clipboard
| Challenge: | Figurative language is a core component of everyday communication . existing benchmarks focus on sentence-level classification or inference tasks . |
| Approach: | They propose a multilingual benchmark that evaluates figurative usage in dialogue . they use a sentence-level diagnostic task to embed figurativ choices into multi-turn contexts . |
| Outcome: | The benchmark evaluates large language models' ability to use figurative expressions coherently in conversation. |
MIRROR: Multimodal Cognitive Reframing Therapy for Rolling with Resistance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored the use of large language models (LLMs) in psychotherapy, however text-based cognitive behavioral therapy models struggle with client resistance, which weakens therapeutic alliance. |
| Approach: | They propose a multimodal approach that incorporates nonverbal cues and a synthetic dataset that pairs each client’s statements with corresponding facial images to train vision language models. |
| Outcome: | The proposed approach outperforms existing text-based cognitive behavioral therapy models in managing client resistance and fostering therapeutic alliance. |