Papers by Dongyoung Kim
KLAAD: Refining Attention Mechanisms to Reduce Societal Bias in Generative Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models exhibit societal biases in their outputs, prompting ethical and societal challenges. |
| Approach: | They propose an attention-based debiasing framework that implicitly aligns attention distributions between stereotypical and anti-stereotypical sentence pairs without directly modifying model weights. |
| Outcome: | The proposed framework improves on BBQ and BOLD benchmarks while maintaining fluency and coherence. |
Learning to Correct for QA Reasoning with Black-box LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve reasoning capability of large language models rely on accessibility or require significantly increased train- and inference-time costs. |
| Approach: | They propose a method to improve QA reasoning of large language models in a black-box setting by using a trained adaptation model to perform a seq2seq mapping from the often-imperfect reasonings of the original LLM to the correct or improved reasonings. |
| Outcome: | The proposed approach significantly improves reasoning accuracy across various QA benchmarks compared to the best-performing adaptation baselines. |
Debiasing Online Preference Learning via Preference Feature Preservation (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent preference learning frameworks for large language models (LLMs) simplify human preferences with binary pairwise comparisons and scalar rewards. |
| Approach: | They propose a preference feature preservation framework that preserves the distribution of human preference features and maps them throughout the online preference learning process. |
| Outcome: | The proposed framework maintains the distribution of human preference features and utilizing such rich signals throughout the online preference learning process. |