Challenge: Existing concepts-based explainable approaches do not discover unseen concepts . a recent approach to solve this problem is concept-based explanations .
Approach: They propose a framework that extracts comprehensible concepts automatically with no annotations . ECO-Concept uses an object-centric architecture to extract task-specific semantic concepts .
Outcome: a new framework extracts comprehensible concepts with no concept annotations . the proposed framework outperforms existing methods in computability tests on diverse tasks .

Similar Papers

Data-Efficient Concept Extraction from Pre-trained Language Models for Commonsense Explanation Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to extract concepts from pre-trained language models are not suitable for commonsense explanation generation.
Approach: They propose a method to extract the key explanation concept from pre-trained language models by fine-tuning it with 20% training data and using a metric to evaluate the retrieved concepts.
Outcome: The proposed method improves evaluation metrics over pre-trained language models and the existing models.
Interactive Concept Learning for Uncovering Latent Themes in Large Text Collections (2023.findings-acl)

Copied to clipboard

Challenge: Topic modeling is a popular method for identifying emerging themes from text collections.
Approach: They propose a framework that receives and encodes expert feedback at different levels of abstraction.
Outcome: The proposed framework combines automation and manual coding, allowing experts to maintain control while reducing the manual effort required.
Explaining Language Model Predictions with High-Impact Concepts (2024.findings-eacl)

Copied to clipboard

Challenge: Existing methods to explain large language models (LLMs) are mostly correlational and lack causal features due to compositional nature of languages.
Approach: They propose a framework to provide impact-aware explanations for large language models that are robust to feature changes and influential to the model’s predictions.
Outcome: The proposed explanations improve on real and synthetic tasks and are robust to feature changes and influential to the model’s predictions.
Improving Unsupervised Commonsense Reasoning Using Knowledge-Enabled Natural Language Inference (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent methods based on pre-trained language models have shown strong supervised performance on commonsense reasoning.
Approach: They propose to use a common framework to solve commonsense reasoning tasks using a dataset from NLI.
Outcome: The proposed method achieves state-of-the-art unsupervised performance on two commonsense reasoning tasks.
Towards Intrinsic Interpretability of Large Language Models: A Survey of Design Principles and Architectures (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on explainable AI focus on post-hoc explanation methods that interpret trained models through external approximations.
Approach: They propose to categorize existing approaches into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction.
Outcome: The proposed approaches are categorized into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction.
On Sample Based Explanation Methods for NLP: Faithfulness, Efficiency and Semantic Evaluation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for explaining "black-box" models such as Influence Functions are becoming more popular.
Approach: They propose a semantic-based evaluation metric that can better align with humans’ judgment of explanations than the widely adopted diagnostic or re-training measures.
Outcome: The proposed method can better align with humans’ judgment of explanations than diagnostic or re-training measures.
Unsupervised Expressive Rules Provide Explainability and Assist Human Experts Grasping New Domains (2020.findings-emnlp)

Copied to clipboard

Challenge: Understanding unexplored data is a slow process, and there is no labeled data at hand.
Approach: They propose to use unsupervised methods to reveal rules which cluster unexplored corpus by its prominent categories to help domain experts understand their texts.
Outcome: The proposed rules can be bootstrapped to identify target categories and deepen understanding of the data.
Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales (2024.findings-naacl)

Copied to clipboard

Challenge: Saliency post-hoc explainability methods are important tools for understanding complex NLP models, but they may not align with human intuition, making the explanations not plausible.
Approach: They propose a method for incorporating rationales into text classification models by augmenting the standard cross-entropy loss with a novel loss function inspired by contrastive learning.
Outcome: The proposed approach enhances the plausibility of post-hoc explanations while preserving their faithfulness.
Rationalization through Concepts (2021.findings-acl)

Copied to clipboard

Challenge: Existing models that explain complex decisions are limited because of their lack of interpretability.
Approach: They propose a model that extracts text snippets as concepts and infers which ones are described in the document.
Outcome: The proposed model outperforms state-of-the-art methods trained on each aspect label independently.
A Diagnostic Study of Explainability Techniques for Text Classification (2020.emnlp-main)

Copied to clipboard

Challenge: Existing explainability techniques that can be produced post-hoc with already trained models are lacking a definitive guide on how to choose one given a particular task and model architecture.
Approach: They propose to use a list of diagnostic properties to evaluate existing explainability techniques to compare them with human annotations of salient input regions.
Outcome: The proposed list compares a set of explainability techniques on downstream text classification tasks and neural network architectures.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations