Papers by Shuailiang Zhang
LIMIT-BERT : Linguistics Informed Multi-Task BERT (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing language models are usually trained on large amounts of unlabeled text data. |
| Approach: | They propose a multi-task language representations learning framework for multi-linguistics tasks by Multi-Task Learning. |
| Outcome: | The proposed model outperforms the baseline Whole Word Masking BERT on both dependency and constituent syntactic/semantic parsing, GLUE benchmark, and SNLI task. |