Papers by Alejo Lopez-Avila
Combining Denoising Autoencoders with Contrastive Learning to fine-tune Transformer Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in NLP have led to the use of pre-trained Transformer models for transfer learning tasks becoming the most common way to solve target tasks. |
| Approach: | They propose a 3-phase technique to adjust a base model for a classification task by adapting the model’s signal to the data distribution and a new data augmentation approach for Supervised Contrastive Learning to correct the unbalanced datasets. |
| Outcome: | The proposed method is compared with other methods and compares it with other approaches. |