Challenge: Gradient-based explanation methods are increasingly used to interpret neural models in natural language processing (NLP) however, in the context of Aspect-based Sentiment Analysis, only specific dimensions are pertinent.
Approach: They propose a Gradient-based explanation framework that leverages an information bottleneck to refine word embeddings into a concise intrinsic dimension, maintaining essential features and omitting unrelated information.
Outcome: The proposed framework improves both the models’ performance and explanations’ clarity by identifying sentiment-aware features.

Similar Papers

Discretized Integrated Gradients for Explaining Language Models (2021.emnlp-main)

Copied to clipboard

Challenge: Integrated Gradients (IG) is widely adopted due to its desirable explanation axioms and the ease of gradient computation.
Approach: They propose an attribution-based explanation algorithm that uses averaging the model's output gradient interpolated along a straight-line path in the input data space.
Outcome: The proposed method is compared with IG on multiple sentiment classification datasets.
Reducing Spurious Correlations in Aspect-based Sentiment Analysis with Explanation from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Aspect-based sentiment analysis models are susceptible to learning spurious correlations between words . a recent study shows that feature engineering is time-consuming and costly .
Approach: They propose to use a template to prompt LLMs to generate an appropriate explanation for the sentiment polarity of each aspect to reduce spurious correlations.
Outcome: The proposed methods improve ABSA models and their generalization ability.
Complementary Learning of Aspect Terms for Aspect-based Sentiment Analysis (2022.lrec-1)

Copied to clipboard

Challenge: Existing ABSA models do not pay attention to aspect terms and their contexts . a discriminator is introduced to improve ABSA, allowing for better understanding of aspect terms .
Approach: They propose to improve ABSA by complementary learning of aspect terms . they explicitly recover aspect terms from each input sentence to better understand aspects .
Outcome: The proposed approach improves ABSA on five widely used English benchmark datasets.
Aligning Black-Box LLMs for Aspect Sentiment Quad Prediction (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models lack task-specific alignment with ASQP . supervised small language models (SLMs) lack the extensive knowledge of LLMs.
Approach: They propose a framework that combines large language models and small language models to align LLM outputs with human preferences.
Outcome: The proposed framework improves Aspect Sentiment Quad Prediction performance by combining SLMs and LLMs.
Deep Context- and Relation-Aware Learning for Aspect-based Sentiment Analysis (2021.acl-short)

Copied to clipboard

Challenge: Existing methods for aspect-based sentiment analysis (ABSA) consider relationships implicitly among subtasks at the word level.
Approach: They propose a deep contextualized relation-aware network that allows interactive relations among subtasks . they propose self-supervised strategies that deal with multiple aspects .
Outcome: The proposed method outperforms state-of-the-art methods on three widely used benchmarks.
Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluation (2025.naacl-long)

Copied to clipboard

Challenge: Aspect-based sentiment analysis (ABSA) is a challenging task of extracting sentiments along with their corresponding aspects and opinion terms from text.
Approach: They propose a pipeline that expands existing evaluation sets by adding alternative valid terms for aspect and opinion.
Outcome: The proposed evaluation set uncovers the capabilities of large language models (LLMs) in ABSA tasks, which is concealed by the single-answer GT sets.
Towards Generative Aspect-Based Sentiment Analysis (2021.acl-short)

Copied to clipboard

Challenge: Existing work on Aspect-based sentiment analysis ignores the rich label semantics of ABSA.
Approach: They propose to tackle various ABSA tasks in a unified generative framework . they propose to use annotation-style and extraction-style modeling to enable training .
Outcome: The proposed framework achieves state-of-the-art on four ABSA tasks across multiple benchmark datasets.
A Unified Generative Framework for Aspect-based Sentiment Analysis (2021.acl-long)

Copied to clipboard

Challenge: Existing complicated ABSA models focus on subtasks, which leads to complicated solutions . et al., j. c. d. r., and j dr. s. v. present a unified approach to solve seven subtask tasks in one framework.
Approach: They redefine every subtask target as a sequence mixed by pointer indexes and sentiment class indexe . they exploit the pre-training sequence-to-sequence model BART to solve all ABSA subtasks in an end-to end framework.
Outcome: The proposed framework achieves substantial performance gain and provides a real unified solution for the whole ABSA subtasks.
An Instruction Tuning-Based Contrastive Learning Framework for Aspect Sentiment Quad Prediction with Implicit Aspects and Opinions (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for aspect-based sentiment analysis have not explored how to effectively leverage the knowledge of pre-trained language models to handle implicit aspects and opinions.
Approach: They propose a framework leveraging Instruction Tuning and Supervised Contrastive Learning to improve aspect sentiment quad prediction for implicit aspects and opinions.
Outcome: The proposed framework significantly outperforms existing methods on benchmark datasets.
Sequential Integrated Gradients: a simple but effective method for explaining language models (2023.findings-acl)

Copied to clipboard

Challenge: Existing explanation methods such as Integrated Gradients (IG) produce a path for each word of a sentence simultaneously, which can lead to sentences with no clear meaning or a significantly different meaning compared to the original one.
Approach: They propose to use a sequenced integrated gradient method to fix every word in a sentence and move it along a straight path to the word of interest.
Outcome: The proposed method improves on Integrated Gradients (IG) and DIG, but can produce sentences with different meanings than the original one.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations