Papers by Seonghyeon Bae
Instruction Matters: A Simple yet Effective Task Selection for Optimized Instruction Tuning of Specific Tasks (2024.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that instruction tuning improves zero-shot generalization across various tasks and improves performance of specific tasks. |
| Approach: | They propose a task selection method that leverages instruction information alone to identify relevant tasks and optimize instruction tuning for specific tasks. |
| Outcome: | The proposed method is significantly more efficient than traditional approaches, which require complex measurements of pairwise transferability between tasks or the creation of data samples for the target task. |
Coffee-Gym: An Environment for Evaluating and Improving Natural Language Feedback on Erroneous Code (2024.emnlp-main)
Copied to clipboard
Hyungjoo Chae, Taeyoon Kwon, Seungjun Moon, Yongho Song, Dongjin Kang, Kai Ong, Beong-woo Kwak, Seonghyeon Bae, Seung-won Hwang, Jinyoung Yeo
| Challenge: | Large language models (LLMs) have made great progress in code generation, however, they still produce errors. |
| Approach: | They propose a RL environment that provides feedback on code editing by analyzing the performance of the revised code in unit tests. |
| Outcome: | The proposed model outperforms baselines in enhancing open-source code LLMs’ code editing, making them comparable with closed-source LLM. |
Carpe diem: On the Evaluation of World Knowledge in Lifelong Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Current language models are trained on static data, implying that the encoded knowledge could go wrong as time passes. |
| Approach: | They propose a temporally evolving question-answering benchmark for language models . they use Wikipedia databases to test language models for dynamic knowledge in ever-changing world . |
| Outcome: | The proposed task aims to model the evolution-adaptability of language models in the real world. |