CAARMA: Class Augmentation with Adversarial Mixup Regularization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Speaker verification tasks require inference of unseen classes using specialized losses. |
| Approach: | They propose a class augmentation framework that generates synthetic classes through data mixing in the embedding space. |
| Outcome: | The proposed framework improves speaker verification tasks by 8% over baseline models. |
Similar Papers
Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning (2021.findings-acl)
Copied to clipboard
| Challenge: | Pretrained language models perform poorly under adversarial attacks due to the large search space. |
| Approach: | They propose a method to cover a much larger proportion of the attack search space by adding textual adversarial examples during training. |
| Outcome: | The proposed method covers a much larger proportion of the attack search space. |
Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing work on fallacy recognition is still in its early stages, with limited datasets available. |
| Approach: | They propose to use GPT3.5 to generate synthetic examples and explore prompt settings to improve the representation of the infrequent classes. |
| Outcome: | The proposed model improves on existing models and generates synthetic examples with GPT3.5. |
CIAug: Equipping Interpolative Augmentation with Curriculum Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Current methods for interpolative data augmentation select samples at random, which might make it difficult for the model to generalize better and converge faster. |
| Approach: | They propose a curriculum-based learning method that leverages the relative position of samples in hyperbolic embedding space as a complexity measure to gradually mix up increasingly difficult and diverse samples along training. |
| Outcome: | The proposed method achieves state-of-the-art results over existing methods on 10 benchmark datasets across 4 languages in text classification and named-entity recognition tasks. |
Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that powerful pre-trained language models can be fooled by small perturbations or intentional attacks. |
| Approach: | They propose a framework for fine-tuning PLMs using a masked language model and Gaussian noise to augment semantically relevant examples with sufficient diversity. |
| Outcome: | The proposed framework improves the robustness of pre-trained language models and alleviates performance degradation under adversarial attacks. |
MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Various data augmentation strategies have been proposed to improve GEC models . high-quality parallel data for GEC is not as widely available . |
| Approach: | They propose a data augmentation approach that strategically augments real data by generating pseudo data. |
| Outcome: | The proposed approach significantly improves GEC models on English and Chinese datasets. |
Adversarial Mixing Policy for Relaxing Locally Linear Constraints in Mixup (2021.emnlp-main)
Copied to clipboard
| Challenge: | Experiments on five text classification benchmarks and five backbone models have shown that our methods reduce the error rate over Mixup variants in a significant margin (up to 31.3%), especially in low-resource conditions (upto 17.5%). |
| Approach: | They propose to add a small adversarial perturbation to the mixing coefficients rather than the examples to relax locally linear constraints. |
| Outcome: | Experiments on five text classification benchmarks and five backbone models show that the proposed methods reduce the error rate over Mixup variants by 31.3%, especially in low-resource conditions. |
Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that augmenting the training data of pre-trained language models with parametric fine-tuning methods can enhance their robustness under adversarial attacks. |
| Approach: | They propose an approach that fine-tunes PLMs with adapters and adversarial augmentation via mixup to leverage existing knowledge from a set of pre-known attacks. |
| Outcome: | The proposed approach achieves best trade-off between training efficiency and robustness under adversarial attacks compared to baselines on five downstream tasks across six varied black-box attacks and 2 PLMs. |
How DDAIR you? Disambiguated Data Augmentation for Intent Recognition (2026.eacl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) produce ambiguous examples with regard to untargeted classes. |
| Approach: | They propose to use a sentence transformer to detect ambiguous augmented examples generated by Large Language Models for intent recognition. |
| Outcome: | The proposed method improves the quality of augmented data generated by large language models in low-resource scenarios. |
Manifold Adversarial Augmentation for Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that NMT models can drop significantly when small perturbations are added to input sentences. |
| Approach: | They propose a data augmentation approach to sample sentences from the vicinity distributions in higher-level representations. |
| Outcome: | The proposed method improves translation accuracy on training samples from higher-level representations. |
Impact of Adversarial Training on Robustness and Generalizability of Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Adversarial training is widely acknowledged as the most effective defense against adversarial attacks, but achieving both robustness and generalization requires a trade-off. |
| Approach: | They propose to compare pre-training data augmentation and training time input perturbations with embedding space perturbations to find out whether they improve generalization. |
| Outcome: | The proposed methods improve generalization and robustness of the trained models. |