Papers by Chi-Jen Lu
Rethinking Why Intermediate-Task Fine-Tuning Works (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained language models can be fine-tuned on intermediate labeled-data tasks before fine- tuning the models on the target task of interest. |
| Approach: | They conduct extensive experiments to study the impact of different factors on STILT . they find that the improvement from an intermediate task could be orthogonal to it containing reasoning or other complex skills. |
| Outcome: | The proposed method improves the performance of pretrained language models on various target tasks. |
Multiple Text Style Transfer by using Word-level Conditional Generative Adversarial Network with Two-Phase Training (D19-1)
Copied to clipboard
| Challenge: | Generative adversarial network (GAN) is a popular model for text style transfer . but, training GAN often suffers from mode collapse problem, which causes that the transferred text is little related to the original text. |
| Approach: | They propose a non-parallel text style transfer model with a word-level conditional architecture and a two-phase training procedure to maintain style-unrelated words while changing others. |
| Outcome: | The proposed model outperforms state-of-the-art models on three real-world datasets in transfer accuracy and fluency. |