Challenge: Existing attention models do not take full advantage of sentiment lexicons, which provide rich sentiment information and play a critical role in sentiment analysis.
Approach: They propose a lexicon-based supervised attention model which allows a neural network to focus on the sentiment content, thus generating sentiment-informative representations.
Outcome: The proposed model outperforms existing models on three large-scale sentiment classification datasets.

Similar Papers

Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis (P19-2)

Copied to clipboard

Challenge: End-to-end deep learning systems lack flexibility as one cannot adjust the network to fix an obvious problem.
Approach: They propose a way to leverage lexicon information to make the model more flexible . they also explore the effect of regularizing attention vectors to allow the network to have a broader "focus"
Outcome: The proposed approach leverages lexicon information to make it more flexible and robust.
Attentive Gated Lexicon Reader with Contrastive Contextual Co-Attention for Sentiment Classification (D18-1)

Copied to clipboard

Challenge: Existing sentiment lexicons do not handle word sense and the concept of semantic compositionality is non-existent in simple lexiconic approaches.
Approach: They propose a lexicon-driven contextual attention mechanism and a contrastive co-attention mechanism that models contrasting polarities between all positive and negative words in a sentence.
Outcome: The proposed model outperforms many other neural baselines on sentiment classification tasks on multiple benchmark datasets.
A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification (P18-2)

Copied to clipboard

Challenge: Existing sentiment classification approaches do not fully exploit sentiment linguistic knowledge.
Approach: They propose a Multi-sentiment-resource Enhanced Attention Network to integrate sentiment linguistic knowledge into the deep neural network via attention mechanisms.
Outcome: The proposed network captures sentiments from different representation sub-spaces, and is superior to strong competitors.
Effective Attention Modeling for Aspect-Level Sentiment Classification (C18-1)

Copied to clipboard

Challenge: Aspect-level sentiment classification aims to determine sentiment polarity of review sentence towards opinion target . main challenge is to separate different opinion contexts for different targets .
Approach: They propose a method that captures the semantic meaning of the opinion target and a model that incorporates syntactic information into the attention mechanism.
Outcome: The proposed method captures the semantic meaning of the opinion target and incorporates syntactic information into the attention mechanism.
Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis (P19-1)

Copied to clipboard

Challenge: Experimental results show that our proposed approach yields better attention mechanisms . dominant ASC models are mostly discriminative classifiers based on manual feature engineering .
Approach: They propose a self-supervised approach to aspect-level sentiment classification that mines useful attention supervision information from a training corpus to refine attention mechanisms.
Outcome: The proposed approach yields better attention mechanisms on multiple datasets.
Transformation Networks for Target-Oriented Sentiment Classification (P18-1)

Copied to clipboard

Challenge: a new model for sentiment classification uses attention instead of attention to classify sentiment polarities over individual opinion targets.
Approach: They propose a model that uses a CNN layer to extract salient features from transformed word representations from a bi-directional RNN layer.
Outcome: The proposed model achieves state-of-the-art on a few benchmarks.
Recurrent Attention Networks for Long-text Modeling (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to encoding long documents using self-attention have been limited by quadratic computational complexities and limited application in long text processing.
Approach: They propose a long-document encoding model that allows the recurrent operation of self-attention.
Outcome: The proposed model extracts global semantics in token-level and document-level representations, making it inherently compatible with both sequential and sequential tasks.
Context-aware Interactive Attention for Multi-modal Sentiment and Emotion Analysis (D19-1)

Copied to clipboard

Challenge: Multi-modal analysis is a field emerging in the fields of natural language processing, computer vision and speech processing . multimodal analysis uses a variety of information from multiple sources to build efficient systems . acoustic and visual information can provide better information for classification decisions .
Approach: They propose a recurrent neural network based approach for multi-modal sentiment and emotion analysis . they employ a context-aware attention module to exploit the correspondence among neighboring utterances .
Outcome: The proposed model learns inter-modal interaction among participating modalities through auto-encoder mechanism . it is compared with existing state-of-the-art models on five standard multi-modal affect analysis datasets .
Attention Transfer Network for Aspect-level Sentiment Classification (2020.coling-main)

Copied to clipboard

Challenge: Aspect-level sentiment classification aims to detect the sentiment polarity of a given opinion target in a sentence.
Approach: They propose a novel attention transfer network which can exploit attention from document-level sentiment datasets to improve the attention capability of the aspect-level classification task.
Outcome: The proposed method outperforms state-of-the-art methods on two ASC benchmark datasets.
Affection Driven Neural Networks for Sentiment Analysis (2020.lrec-1)

Copied to clipboard

Challenge: Existing deep neural network models lack mechanisms to highlight important sentiment terms.
Approach: They propose a method to incorporate affective knowledge into deep neural network models by mapping affective influence vectors to an affective impact value and integrating them into long-term memory models to highlight affective terms.
Outcome: The proposed approach improves on three large datasets by 1.0% to 1.5% on the benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations