Papers by Deokyeong Kang
Revisiting the Impact of Pursuing Modularity for Code Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study examines the impact of modularity on code generation in large language models . modularity is not a core factor for improving performance of code generation models, argues a new study . |
| Approach: | They introduce a new metric to measure the impact of modularity in code generation . they find modularity is not a core factor for improving performance of LLMs . |
| Outcome: | The proposed metric shows that modularity is not a core factor for improving performance . coding assistants are becoming increasingly essential for programmers . |
X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Cross-lingual transfer (XLT) is an emergent ability of multilingual language models that preserves their performance when evaluated in non-English languages. |
| Approach: | They propose to use sub-network similarity between two languages as a proxy for XLT prediction. |
| Outcome: | The proposed method shows proficiency in ranking candidates for zero-shot XLT, achieving an improvement of 4.6% on average in terms of NDCG@3. |