ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions (2024.acl-long)
Copied to clipboard
Sreyan Ghosh, Utkarsh Tyagi, Sonal Kumar, Chandra Kiran Evuru, Ramaneswaran S, S Sakshi, Dinesh Manocha
| Challenge: | ABEX is a novel and effective generative data augmentation methodology for low-resource Natural Language Understanding (NLU) tasks. |
| Approach: | They propose a novel generative data augmentation methodology for low-resource Natural Language Understanding (NLU) tasks based on a paradigm for generating diverse forms of an input document . |
| Outcome: | The proposed method outperforms all baselines qualitatively with improvements of 0.04% - 38.8%. |
Similar Papers
Generative Data Augmentation for Commonsense Reasoning (2020.findings-emnlp)
Copied to clipboard
Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta, Ronan Le Bras, Ji-Ping Wang, Chandra Bhagavatula, Yejin Choi, Doug Downey
| Challenge: | Recent advances in commonsense reasoning depend on large-scale human-authored training data. |
| Approach: | They propose a generative data augmentation technique that augments human-authored training data by using pretrained language models. |
| Outcome: | The proposed technique outperforms existing methods on commonsense reasoning benchmarks and enhances out-of-distribution generalization. |
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) tasks require large amounts of parallel data to augment training. |
| Approach: | They propose a data augmentation paradigm that augments each training instance with an adjacency semantic region that could cover adequate variants of literal expression under the same meaning. |
| Outcome: | The proposed paradigm improves on the state-of-the-art in supervised neural machine translation tasks. |
Getting More Data for Low-resource Morphological Inflection: Language Models and Data Augmentation (2020.lrec-1)
Copied to clipboard
| Challenge: | Morphological inflection is the process that generates the word form given its lexeme and morphological properties. |
| Approach: | They propose to use language models and data augmentation to improve morphological inflection without annotating more data. |
| Outcome: | The proposed model improves by 1.5% with the langauge model and by 9% with the data augmentation. |
PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to build labeled training data from domain-specific data are expensive to obtain. |
| Approach: | They propose a Prompt-based Data Augmentation model which only trains small-scale Soft Promptes in frozen Pre-trained Language Models. |
| Outcome: | The proposed model outperforms several baseline models on four benchmarks and is complementary with unlabeled in-domain data. |
Augmenting NLP models using Latent Feature Interpolations (2020.coling-main)
Copied to clipboard
| Challenge: | Existing data augmentation methods with a large number of parameters are prone to over-fitting and often fail to capture the underlying input distribution. |
| Approach: | They propose a data augmentation technique that uses embeddings and hidden layer representations to construct virtual examples. |
| Outcome: | The proposed method outperforms existing methods in terms of accuracy and robustness to weight pruning. |
AMR-DA: Data Augmentation by Abstract Meaning Representation (2022.findings-acl)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation for NLP/NLU. |
| Approach: | They propose to use AMR-DA for data augmentation in NLP . they use sentence-level techniques like back translation and token-level methods like EDA . |
| Outcome: | The proposed method outperforms EDA and AEDA and improves on STS and text classification tasks. |
Rethinking Data Augmentation for Low-Resource Neural Machine Translation: A Multi-Task Learning Approach (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generating additional parallel sentences are aimed at expanding the support of the empirical data distribution by generating new sentence pairs that contain infrequent words. |
| Approach: | They propose to use data augmentation techniques to generate additional parallel sentences by reversing the order of the target sentence to produce unfluent target sentences. |
| Outcome: | The proposed approach improves on six low-resource translation tasks and the baseline and over DA methods. |
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue (2022.findings-naacl)
Copied to clipboard
| Challenge: | NLU++ provides a more challenging evaluation environment for dialogue NLU models . Typical ToD systems still rely on a modular design . |
| Approach: | They propose to use NLU++ to provide a more challenging evaluation environment for dialogue NLU models. |
| Outcome: | The proposed dataset improves existing datasets and provides a much more challenging evaluation environment for dialogue NLU models. |
Exploring Data Augmentation for Code Generation Tasks (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have impacted how models are trained for programming language tasks. |
| Approach: | They propose to use augmentation methods that yield consistent improvements in code translation and summarization by up to 6.9% and 7.5% respectively. |
| Outcome: | The proposed methods improve translation and summarization by 6.9% and 7.5% respectively. |
MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | Language Models (LLMs) have gained increasing prominence in artificial intelligence, especially Large Language Model (LLm) due to the well-recognized reporting bias, the recording of commonsense information is significantly less than its existence in reality. |
| Approach: | They propose a Multi-mOdal REtrieval framework to leverage both text and images to enhance commonsense ability of language models. |
| Outcome: | The proposed framework can leverage both text and images to enhance commonsense ability of language models. |