Challenge: Large-scale pre-trained MLMs can be used to generalize well to a wide range of tasks.
Approach: They propose to append [MASK]s at a later layer to reduce sequence length for earlier layers.
Outcome: The proposed method outperforms RoBERTa for 6 out of 8 GLUE tasks on average by 0.4%.

Similar Papers

Frustratingly Simple Pretraining Alternatives to Masked Language Modeling (2021.emnlp-main)

Copied to clipboard

Challenge: Masked language modeling (MLM) is widely used in natural language processing for self-supervised learning of text representations.
Approach: They propose to use token-level classification tasks as main pretraining objectives instead of Masked language modeling (MLM) . Empirical results show that pretraining a model with 41% of the BERT-BASE’s parameters, BERT MEDIUM results in only a 1% drop in GLUE scores with their best objective.
Outcome: Empirical results show that the proposed methods achieve comparable or better performance to MLM using a BERT-BASE architecture.
Should You Mask 15% in Masked Language Modeling? (2023.eacl-main)

Copied to clipboard

Challenge: Masked language models (MLMs) traditionally mask 15% of tokens due to the belief that more masking would leave insufficient context to learn good representations.
Approach: They revisit the 15% masking rate of MLMs to examine the role of masking in linguistic training.
Outcome: The proposed masking rate outperforms BERT-large size models on GLUE and SQUAD while maintaining 95% accuracy.
Learning Better Masking for Better Language Model Pre-training (2023.acl-long)

Copied to clipboard

Challenge: Existing PrLMs adopt a Random-Token Masking strategy with a fixed masking ratio and different contents are masked by an equal probability throughout the training.
Approach: They propose two scheduled masking approaches that adaptively tune masking ratio and masked content in different training stages, which improves pre-training efficiency and effectiveness.
Outcome: The proposed methods improve the pre-training efficiency and effectiveness on the downstream tasks.
How does the task complexity of masked pretraining objectives affect downstream performance? (2023.findings-acl)

Copied to clipboard

Challenge: Masked language modeling (MLM) is a widely used self-supervised pretraining objective.
Approach: They propose to use a mask-based objective to predict a token that is replaced with a masked token given its context.
Outcome: The proposed objectives show that they should have half the complexity needed to perform comparably to MLM.
Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling (2023.findings-acl)

Copied to clipboard

Challenge: a recent study suggests that masked language models are a useful pre-training technique for natural language processing . a study using mlms pre-trained by a team of researchers has improved performance .
Approach: They propose an alternative to the classic masked language modeling paradigm . they use an unsupervised technique which uses sparse coding to make the prediction possible .
Outcome: The proposed technique improves on pre-trained models compared to vanilla MLM . the proposed model returns distributions over their vocabulary peaking at plausible substitutes .
Curriculum Masking in Vision-Language Pretraining to Maximize Cross Modal Interaction (2024.naacl-long)

Copied to clipboard

Challenge: masked language modeling is widely used as a pretraining component in Vision and language (V+L) but performance on benchmarks has not received the attention it deserves.
Approach: They propose a curriculum masking scheme that uses a parallel mask selection agent to mask tokens at a frequency proportional to the level of cross modal interaction necessary to reconstruct them.
Outcome: The proposed method improves relational understanding on a wide range of V+L tasks.
Improving Pretraining Techniques for Code-Switched NLP (2023.acl-long)

Copied to clipboard

Challenge: Multilingual pretraining models for code-switched inputs are a key component of NLP applications.
Approach: They propose to use masked language modeling techniques to mask code-switched text that are cognizant of language boundaries prior to masking.
Outcome: The proposed techniques improve performance on two downstream tasks, Question Answering (QA) and Sentiment Analysis (SA), compared to standard pretraining techniques.
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking (2022.emnlp-main)

Copied to clipboard

Challenge: Masked language modeling (MLM) has been widely used for pre-training effective bidirectional representations but comes at a substantial training cost.
Approach: They propose a concept-based curriculum masking method that evaluates the MLM difficulty of each token based on a carefully-designed linguistic difficulty criterion.
Outcome: The proposed method significantly improves pre-training efficiency with the original BERT model at half the training cost.
Masked Language Model Scoring (2020.acl-main)

Copied to clipboard

Challenge: Pretrained masked language models require finetuning for most tasks.
Approach: They evaluate pretrained masked language models out of the box via their pseudo-log-likelihood scores (PLLs) they attribute this success to PLL’s unsupervised expression of linguistic acceptability without a left-to-right bias, greatly improving on scores from GPT-2 .
Outcome: The proposed model outperforms autoregressive language models in a variety of tasks.
Masking as an Efficient Alternative to Finetuning for Pretrained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Extensive evaluations of masking BERT, RoBERTa, and DistilBERT on eleven diverse NLP tasks show that our binary masked language models encode information necessary for solving downstream tasks.
Approach: They propose an efficient method of utilizing pretrained language models where selective binary masks are learned instead of finetuning.
Outcome: Extensive evaluations of masking BERT, RoBERTa, and DistilBERT on eleven diverse NLP tasks show that the proposed method yields comparable performance to finetuning, but has a much smaller memory footprint when multiple tasks need to be solved.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations