Induction Networks for Few-Shot Text Classification (D19-1)

Copied to clipboard

Challenge: Recent studies have used meta-learning to simulate the few-shot task . however, this sample-wise comparison may be severely disturbed by the various expressions in the same class.
Approach: They propose a meta-learning-based induction network to learn a generalized class-wise representation of each class in a support set.
Outcome: The proposed model outperforms existing state-of-the-art models on a sentiment and dialogue intent datasets.

Similar Papers

Dynamic Memory Induction Networks for Few-Shot Text Classification (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that models can benefit from query-aware methods for few-shot text classification.
Approach: They propose a dynamic memory-based network for few-short text classification that uses static memory to adapt to unseen classes.
Outcome: The proposed model improves on the miniRCV1 and ODIC datasets by 24% . Detailed analysis is performed to show how the proposed network achieves the new performance.
Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for few-shot text classification often encounter problems drawing accurate class prototypes from support set samples.
Approach: They propose a meta-learning method that leverages the information within the task itself . they propose Query-Data-Augmenter and Label-Adapter to build a task-adaptive metric space .
Outcome: The proposed method shows obvious advantages over state-of-the-art models on eight benchmark datasets.
Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches for few-shot text classification rely on exploitation of lexical features and distributional signatures on training data, while neglecting to strengthen the model's ability to adapt to new tasks.
Approach: They propose a meta-learning framework integrated with an adversarial domain adaptation network to improve the model's adaptive ability and generate high-quality text embedding for new classes.
Outcome: The proposed framework outperforms the state-of-the-art models on four datasets and shows clear superiority over existing models.
MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods for text classification fail to generalize to unseen classes with very few labeled text instances per class.
Approach: They propose a meta-learning method which performs instance-wise comparison followed by aggregation to generate class-wise matching vectors instead of prototype learning.
Outcome: Experiments show that the proposed method outperforms existing methods under both the standard and generalized FSL settings.
Learn to Adapt for Generalized Zero-Shot Text Classification (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for generalized zero-shot text classification generalize poorly since the learned parameters are only optimal for seen classes rather than for both classes.
Approach: They propose a network that trains an adaptive classifier by using both seen and virtual unseen classes to simulate a generalized zero-shot learning scenario.
Outcome: The proposed model outperforms several previous approaches on five text classification datasets.
Prompt-Based Meta-Learning For Few-shot Text Classification (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to learn text labels require large amounts of data to build many few-shot tasks.
Approach: They propose a Prompt-Based Meta-Learning model that adds the prompting mechanism to the meta-learning method.
Outcome: The proposed method improves on four text classification datasets with high accuracy and robustness.
Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for few-shot text classification suffer from overfitting due to the lack of matching between the few amount of samples and complicated models.
Approach: They propose a method to improve model generalization ability to a new task by leveraging a meta-learner via gradient similarity method.
Outcome: The proposed method improves few-shot text classification performance on several benchmarks.
Meta-Information Guided Meta-Learning for Few-Shot Relation Classification (2020.coling-main)

Copied to clipboard

Challenge: Existing meta-learning models rely on implicit instance statistics and are unreliability and weak interpretability.
Approach: They propose a meta-information guided meta-learning framework that uses semantics to guide meta- learning . experimental results demonstrate the effectiveness of the proposed framework .
Outcome: The proposed framework can establish connections between instance-based information and semantic-based data, enabling faster initialization and adaptation.
Sentence-aware Adversarial Meta-Learning for Few-Shot Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing studies fail to consider the importance of the semantic interaction between sentence features and neglect to enhance the generalization ability of the model to new tasks.
Approach: They propose to integrate an adversarial network architecture into the meta-learning system and leverage cost-effective modules to build a few-shot classification framework called SaAML.
Outcome: The proposed framework outperforms state-of-the-art methods on four benchmark datasets.
MetaSLRCL: A Self-Adaptive Learning Rate and Curriculum Learning Based Framework for Few-Shot Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing few-shot text classification methods lack labeled data in many scenarios.
Approach: They propose a meta learning framework that obtains different learning rates for different tasks and neural network layers to enable the meta learner to quickly adapt to new training data.
Outcome: The proposed framework can obtain different learning rates for different tasks and neural network layers so as to enable the meta learner to quickly adapt to new tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations