Challenge: Large Language Models (LLMs) produce ambiguous examples with regard to untargeted classes.
Approach: They propose to use a sentence transformer to detect ambiguous augmented examples generated by Large Language Models for intent recognition.
Outcome: The proposed method improves the quality of augmented data generated by large language models in low-resource scenarios.

Similar Papers

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for generalized intent discovery lack pseudo label disambiguation and representation learning.
Approach: They propose a prototype learning framework to decouple pseudo label disambiguation and representation learning.
Outcome: The proposed method can decouple pseudo label disambiguation and representation learning.
Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoders (2024.acl-long)

Copied to clipboard

Challenge: Conversational systems often rely on embedding models for intent classification and intent clustering tasks.
Approach: They propose a toolkit that gives a more holistic view of intent embedding models by considering three tasks– (1) intent classification, (2) intent clustering, and (3) a novel triplet task.
Outcome: The proposed model improves on the linguistic dimensions while affecting performance on downstream task metrics.
Generate then Refine: Data Augmentation for Zero-shot Intent Detection (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing data augmentation methods rely on few labelled examples for each intent category, which can be expensive in settings with many possible intents.
Approach: They propose a data augmentation method for intent detection in zero-resource domains by using an open-source large language model and a smaller sequence-to-sequence model.
Outcome: The proposed method significantly improves the data utility and diversity over the zero-shot LLM baseline for unseen domains and over common baseline approaches.
Data Augmentation using LLMs: Data Perspectives, Learning Paradigms and Challenges (2024.findings-acl)

Copied to clipboard

Challenge: Data augmentation (DA) is a key technique for enhancing model performance by diversifying training examples without the need for additional data collection.
Approach: They examine various strategies that utilize LLMs for data augmentation, including a novel exploration of learning paradigms where LLM-generated data is used for diverse forms of further training.
Outcome: The proposed approach addresses the primary open challenges faced by LLMs in the field of large language models and aims to serve as a comprehensive guide for researchers and practitioners.
MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detection (2026.eacl-long)

Copied to clipboard

Challenge: Existing studies on intentionality behind disinformation do not address intent behind disinformative agents.
Approach: They propose an intent-augmented reasoning system that integrates intent analysis to mitigate the persuasive impact of disinformation.
Outcome: The proposed corpus is the first human-annotated English corpus to capture disinformation and its malicious intent.
An Analysis of Simple Data Augmentation for Named Entity Recognition (2020.coling-main)

Copied to clipboard

Challenge: Recent studies have focused on using data augmentation techniques on sentence-level and sentence-pair natural language processing tasks such as text classification.
Approach: They propose to use data augmentation techniques for named entity recognition to increase model performance.
Outcome: The proposed techniques boost performance for both recurrent and transformer-based models, especially for small training sets.
Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information (2023.eacl-main)

Copied to clipboard

Challenge: Intent detection is a fundamental element in task-oriented dialogue systems, usually occurring within the Natural Language Understanding component.
Approach: They propose an in-context data augmentation approach that fine-tunes a pre-trained language model and synthesizes new datapoints that correspond to given intents.
Outcome: The proposed method produces training data that achieves state-of-the-art on three challenging intent detection datasets and performs on par with the state- of-the art in full-shot settings.
Rethinking Data Augmentation for Low-Resource Neural Machine Translation: A Multi-Task Learning Approach (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generating additional parallel sentences are aimed at expanding the support of the empirical data distribution by generating new sentence pairs that contain infrequent words.
Approach: They propose to use data augmentation techniques to generate additional parallel sentences by reversing the order of the target sentence to produce unfluent target sentences.
Outcome: The proposed approach improves on six low-resource translation tasks and the baseline and over DA methods.
MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction (2023.findings-emnlp)

Copied to clipboard

Challenge: Various data augmentation strategies have been proposed to improve GEC models . high-quality parallel data for GEC is not as widely available .
Approach: They propose a data augmentation approach that strategically augments real data by generating pseudo data.
Outcome: The proposed approach significantly improves GEC models on English and Chinese datasets.
TaskMix: Data Augmentation for Meta-Learning of Spoken Intent Understanding (2022.findings-aacl)

Copied to clipboard

Challenge: Meta-Learning requires a large number of training tasks to learn representations that transfer well to unseen tasks.
Approach: They propose a method which synthesizes new tasks by linearly interpolating existing tasks.
Outcome: The proposed method outperforms baselines and does not degrade performance even when it is high.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations