Papers by Wanying Xie
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for domain adaptation suffer from catastrophic forgetting, large domain divergence, and model explosion. |
| Approach: | They propose a method which prunes the model and keeps the important neurons or parameters responsible for both general-domain and in-domain translation. |
| Outcome: | The proposed method improves on different language pairs and domains compared with strong baselines. |
Importance-based Neuron Allocation for Multilingual Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multilingual neural machine translation tend to preserve general knowledge, but ignore language-specific knowledge. |
| Approach: | They propose to divide model neurons into general and language-specific parts based on their importance across languages. |
| Outcome: | The proposed model can preserve general knowledge but ignore language-specific knowledge on several languages, and is universal and cost-effective. |
Token-level Adaptive Training for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural machine translation (NMT). |
| Approach: | They propose to assign tokens with different frequencies to target tokens during training to encourage the model to pay more attention to low-frequency tokens. |
| Outcome: | The proposed model yields consistent improvements on ZH-EN, EN-RO, and EN-DE translation tasks, especially on sentences that contain more low-frequency tokens. |