Papers by Joongwon Kim
BiSECT: Learning to Split and Rephrase Sentences with Bitexts (2021.emnlp-main)
Copied to clipboard
| Challenge: | Several past efforts have created Split and Rephrase training sets, which consist of long, complex input sentences paired with multiple shorter sentences that preserve the meaning of the input sentence. |
| Approach: | They propose a new dataset and a model for this task by extracting 1-2 sentence alignments from bilingual parallel corpora and using machine translation to convert both sides of the corpus into the same language. |
| Outcome: | The proposed model can perform a wider variety of split operations and improve upon previous state-of-the-art approaches in automatic and human evaluations. |
TaskWeb: Selecting Better Source Tasks for Multi-task NLP (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work in NLP has shown that knowing task relationships via pairwise task transfer improves choosing one or more source tasks that help to learn a new target task. |
| Approach: | They propose a method to quantify task relationships via pairwise task transfer and build smaller training sets that improve zero-shot performances across 11 different target tasks. |
| Outcome: | The proposed method improves overall rankings and top-k precision of source tasks by 10% and 38%, respectively. |
A Systematic Examination of Preference Learning through the Lens of Instruction-Following (2025.naacl-long)
Copied to clipboard
Joongwon Kim, Anirudh Goyal, Aston Zhang, Bo Xiong, Rui Hou, Melanie Kambadur, Dhruv Mahajan, Hannaneh Hajishirzi, Liang Tan
| Challenge: | a recent study has found that preference learning is a key tool for enhancing LLM training and alignment. |
| Approach: | They use a synthetic data generation pipeline to generate 48,000 unique instruction-following prompts with 23 verifiable constraints to obtain preference pairs. |
| Outcome: | The proposed pipeline generates 48,000 unique instruction-following prompts with 23 verifiable constraints that enable fine-grained and automated quality assessments of model responses. |