Papers with IT2ACL
IT2ACL Learning Easy-to-Hard Instructions via 2-Phase Automated Curriculum Learning for Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the pre-training phase of large language models, but this study focuses on the learning phase of pre-trained LLMs. |
| Approach: | They propose a 2-phase automated curriculum learning guided instruction tuning framework that learns easy-to-hard instructions in a self-adjusting dynamic manner. |
| Outcome: | The proposed framework unlocks latent ability in pre-trained large language models and achieving superior performance across diverse tasks. |