Relevance, Diversity, and Exclusivity: Designing Keyword-augmentation Strategy for Zero-shot Classifiers (2024.starsem-1)
Copied to clipboard
| Challenge: | Existing methods incorporate semantically similar keywords related to class names, but the properties of effective keywords remain unclear. |
| Approach: | They propose a method for acquiring keywords that satisfy these properties without additional knowledge bases or data. |
| Outcome: | The proposed method outperforms existing methods in fully zero-shot and generalized zero- shot settings. |
Similar Papers
Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction (2022.starsem-1)
Copied to clipboard
| Challenge: | Earlier approaches to taxonomy learning focused on mining lexico-syntactic patterns from candidate pairs. |
| Approach: | They propose to use prompts to distill knowledge from language models to refine methods . they also show that linguistic properties of prompts dictate downstream performance . |
| Outcome: | The proposed methods outperform some supervised strategies and are competitive with the current state-of-the-art under adequate conditions. |
Exploring Factual Entailment with NLI: A News Media Study (2024.starsem-1)
Copied to clipboard
| Challenge: | Recent studies have focused on the relationship between factuality and Natural Language Inference (NLI). |
| Approach: | They propose a novel annotation scheme that models factual rather than textual entailment and use it to annotate a dataset of naturally occurring sentences from news articles. |
| Outcome: | The proposed annotation scheme can be used to model factual relationships on a dataset of naturally occurring sentences from news articles. |
Guiding Zero-Shot Paraphrase Generation with Fine-Grained Control Tokens (2023.starsem-1)
Copied to clipboard
| Challenge: | Sequence-to-sequence paraphrase generation models struggle with the generation of diverse paraphrases. |
| Approach: | They propose a translation-based guided paraphrase generation model that learns useful features for promoting surface form variation in generated paraphrases from cross-lingual parallel data. |
| Outcome: | The proposed model learns useful features for promoting surface form variation in generated paraphrases from cross-lingual parallel data. |
ROUGE-K: Do Your Summaries Have Keywords? (2024.starsem-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics for extreme summarization models do not pay explicit attention to keywords in summaries, leaving developers ignorant of their presence. |
| Approach: | They propose a keyword-oriented evaluation metric, dubbed ROUGE-K, which quantifies how well summaries include keywords. |
| Outcome: | The proposed model can be extended to include more keywords while keeping the overall quality. |
Enhancing Self-Attention via Knowledge Fusion: Deriving Sentiment Lexical Attention from Semantic-Polarity Scores (2024.starsem-1)
Copied to clipboard
| Challenge: | Existing methods to inject lexical features into self-attention mechanisms have shown remarkable performance across various downstream tasks in NLP. |
| Approach: | They propose to inject lexical features into the self-attention mechanism of Transformer-based models by injecting lexicon-based Sentiment Lexical Attention into the attention scores throughout the training process. |
| Outcome: | The proposed method shows significant performance improvements on the NSMC sentiment classification benchmark and is able to perform in out-of-domain tasks. |
Estimating Semantic Similarity between In-Domain and Out-of-Domain Samples (2023.starsem-1)
Copied to clipboard
| Challenge: | Prior work typically defines out-of-domain (OOD) or out- of-distribution (OOdist) samples as those that originate from dataset(s) or source(s), but for the same task. |
| Approach: | They propose to use supervised methods to identify OOD/OODist samples without using a trained model. |
| Outcome: | The proposed method is able to identify OOD/OODist samples without a trained model. |
Unsupervised Reinforcement Adaptation for Class-Imbalanced Text Classification (2022.starsem-1)
Copied to clipboard
| Challenge: | Existing models for class imbalanced labels learn domain-invariant representations across domains and evaluate primarily on class-balanced data. |
| Approach: | They propose an unsupervised domain adaptation approach that leverages feature variants and imbalanced labels across domains to learn robust representations. |
| Outcome: | The proposed method can learn robust domain-invariant representations and adapt classifiers on imbalanced classes over domains. |
Generative Data Augmentation for Aspect Sentiment Quad Prediction (2023.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches to analyze text contain rewrites and inconsistency between text and quads. |
| Approach: | They propose a new approach to analyze aspect terms, opinion terms, sentiment polarity in text . they augment quads and train a quads-to-text model to generate corresponding texts . |
| Outcome: | The proposed method outperforms existing methods and achieves state-of-the-art performance on two datasets. |
Learning Embeddings for Rare Words Leveraging Internet Search Engine and Spatial Location Relationships (2021.starsem-1)
Copied to clipboard
| Challenge: | Existing word embedding techniques depend heavily on the frequencies of words in the corpus, and fail to provide reliable representations for rare words. |
| Approach: | They propose an algorithm to learn embeddings for rare words based on an Internet search engine and the spatial location relationships. |
| Outcome: | The proposed algorithm can learn more accurate representations for a wider range of vocabulary. |
When Polysemy Matters: Modeling Semantic Categorization with Word Embeddings (2022.starsem-1)
Copied to clipboard
| Challenge: | Recent work using word embeddings to model semantic categorization has shown that static models outperform contextual models. |
| Approach: | They consider polysemy as a possible confounding factor in categorization decisions . they compare sense-level embeddings with previously studied static embedds . |
| Outcome: | The proposed model outperforms static models on coarse- and fine-grained categorization tasks. |