Papers by Tien Nguyen
Better Language Models of Code through Self-Improvement (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models for code (PLMCs) are pre-taught on large datasets with multi-modal objectives, but fine-tuning them requires extensive supervision and is limited by the size of the dataset provided. |
| Approach: | They propose a data augmentation framework that utilizes knowledge from the pre-training and fine-tuning stage to augment training data, which is then used for the next step. |
| Outcome: | The proposed framework significantly improves pre-trained language models’ performance in sequence-generation tasks, such as code summarization and code generation in the CodeXGLUE benchmark. |
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing code summarization approaches ignore the interplay of dependencies among program elements and code hierarchy. |
| Approach: | They propose a code summarization approach utilizing Heterogeneous Code Representations (HCRs) and HierarchyNet. |
| Outcome: | The proposed method improves on existing models and pre-trained models. |