Papers by Caimming Xiong
Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgetting (2023.acl-short)
Copied to clipboard
| Challenge: | Existing studies addressing gender bias of pre-trained language models, usually build a small gender-neutral data set and conduct a second phase pre-training with such data. |
| Approach: | They propose a method to improve gender fairness of pre-trained models with less forgetting by evaluating them with general NLP tasks in GLUE. |
| Outcome: | The proposed method improves gender fairness of pre-trained models with less forgetting and performs better on GLUE by a large margin. |