Papers by Sangwon Yu
Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach (2024.acl-long)
Copied to clipboard
| Challenge: | primarily addressed in text-to-image retrieval task using dialogue-form context query . conventionally, text-based retrieval methods rely on initial text descriptions . |
| Approach: | They propose a plug-based retrieval method that uses large language models as questioners to generate non-redundant questions about the attributes of the target image. |
| Outcome: | The proposed method performs better than zero-shot and fine-tuned baselines in benchmarks. |
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have determined that the learned token embeddings of large-scale neural language models are degenerated to be anisotropic with a narrow-cone shape. |
| Approach: | They propose a method to degenerate the learning gradient for rare token embeddings by gating the specific part of the gradient for all tokens during training stage. |
| Outcome: | The proposed method improves the performance of the models but lacks the training dynamics needed to solve the representation degeneration problem. |
Unleashing Multi-Hop Reasoning Potential in Large Language Models through Repetition of Misordered Context (2025.findings-naacl)
Copied to clipboard
| Challenge: | Multi-hop reasoning requires multi-step reasoning based on supporting documents within a given context. |
| Approach: | They propose a method that prompts the model by repeatedly presenting the context. |
| Outcome: | The proposed method improves the F1 score by 30%p on multi-hop QA tasks and increases accuracy by 70%p on a synthetic task. |
Does Your Voice Assistant Remember? Analyzing Conversational Context Recall and Utilization in Voice Interaction Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in multi-turn voice interaction models have improved user-model communication, but whether open-source models share this ability remains unexplored. |
| Approach: | They propose to use ContextDialog to evaluate open-source interaction models' ability to recall past utterances to identify key limitations. |
| Outcome: | The proposed model retains and recalls past utterances better than closed-source models, but still struggles with questions about past . findings highlight key limitations in open-source model and suggest ways to improve memory retention and retrieval robustness. |
Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to control text generation are inapplicable to black-box models or suffer a trade-off between control and fluency. |
| Approach: | They propose a new approach to control text generation that modifies context at the token level during the generation process of a backbone language model and guides subsequent text to naturally include the target attributes. |
| Outcome: | The proposed method can regulate the attributes of the generated text while utilizing the capability of the backbone large language models. |
Exploring Iterative Controllable Summarization with Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) excel at abstractive summarization tasks, but their ability to precisely control summary attributes remains underexplored. |
| Approach: | They propose a guide-to-explain framework for controllable summarization that enables the model to identify misaligned attributes in the initial draft and guides it to self-explan errors in the previous output. |
| Outcome: | The proposed framework generates well-adjusted summaries that satisfy the desired attributes with robust effectiveness while requiring surprisingly fewer iterations than other iterative approaches. |
Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment (2025.naacl-long)
Copied to clipboard
Sangwon Yu, Jongyoon Song, Bongkyu Hwang, Hoyoung Kang, Sooah Cho, Junhwa Choi, Seongho Joe, Taehee Lee, Youngjune Gwon, Sungroh Yoon
| Challenge: | Experimental results show that large language models exhibit a negative bias in binary decision tasks . hallucination is a factor that degrades reliability of LLMs . |
| Approach: | They propose a negative attention score to systematically and quantitatively formulate negative bias by using a parameter-efficient fine-tuning technique. |
| Outcome: | The proposed method reduces the gap between precision and recall caused by negative bias while preserving generalization abilities. |