Papers by Geonmo Gu
Overlapping Context with Variable-Length Stride Increases Diversity when Training Large Language Model for Code (2025.acl-industry)
Copied to clipboard
Geonmo Gu, Jaeho Kwak, Haksoo Moon, Hyun Seung Shim, Yu Jin Kim, Byoungjip Kim, Moontae Lee, Hyejeong Jeon
| Challenge: | Large language models for code (LLMs) are gaining more and more attention due to their wide applicability. |
| Approach: | They propose a method which extracts overlapping contexts from training data using variable-length stride. |
| Outcome: | The proposed method outperforms the conventional approach of controlling the number of epochs in terms of the pass@k rate. |