Challenge: Sparse Autoencoders (SAEs) can learn a decomposition of a model’s latent space by analyzing the input tokens that activate them.
Approach: They propose an unsupervised approach to learn a decomposition of a model’s latent space by analyzing the input tokens that activate them.
Outcome: The proposed approach matches the performance of existing supervised methods by identifying features with low output scores and identifying them with input and output scores.

Similar Papers

On the Versatility of Sparse Autoencoders for In-Context Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Sparse autoencoders (SAEs) are emerging as a key analytical tool in interpretability for large language models.
Approach: They propose to use SAEs to extract knowledge from billions of tokens for sparse reconstruction.
Outcome: The proposed model can extract knowledge from billions of tokens for sparse reconstruction.
Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders (2025.emnlp-main)

Copied to clipboard

Challenge: Sparse Autoencoders (SAEs) have recently emerged as powerful tools for interpreting and steering the internal representations of large language models (LLMs).
Approach: They propose a method that identifies the most influential latents by incorporating output-side gradient information.
Outcome: The proposed method identifies the most influential latents by incorporating output-side gradient information.
Features that Make a Difference: Leveraging Gradients for Improved Dictionary Learning (2025.findings-naacl)

Copied to clipboard

Challenge: Sparse Autoencoders (SAEs) are a promising approach for extracting neural network representations by learning a sparse and overcomplete decomposition of the network’s internal activations.
Approach: They propose a method that learns a sparse and overcomplete decomposition of the network's internal activations and a gradient approach to learn latents.
Outcome: The proposed algorithms improve the performance of the k-sparse autoencoder and the ability to learn latent features.
Evaluating the Impact of SAE-based Language Steering on LLM Performance (2026.eacl-srw)

Copied to clipboard

Challenge: Recent advances in Sparse Autoencoders (SAEs) have revealed interpretable features within large language models (LLMs) however, the impact of SAE-based language steering on output quality and task performance remains unclear.
Approach: They apply language-specific SAE feature steering to three LLMs from two model families and evaluate it on a translation task and a multilingual question-answering task.
Outcome: The proposed approach outperforms prompting and language neuron-based steering on translation and multilingual question-answering tasks.
AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoders (2026.eacl-long)

Copied to clipboard

Challenge: Feature steering reduces Whisper’s false speech detections by 70% with negligible WER increase, demonstrating real-world applicability.
Approach: They train Sparse Autoencoders across all encoder layers of Whisper and HuBERT and evaluate their stability, interpretability, and practical utility.
Outcome: The proposed models capture general acoustic and semantic information as well as specific events, including environmental noises and paralinguistic sounds, and disentangle them effectively.
Sparse Autoencoder Features for Classifications and Transferability (2025.emnlp-main)

Copied to clipboard

Challenge: Sparse Autoencoders (SAEs) provide potential for uncovering structured, human-interpretable representations in Large Language Models (LLMs).
Approach: They analyze SAEs for interpretable feature extraction from Large Language Models in safety-critical classification tasks.
Outcome: The proposed framework outperforms hidden-state and BoW models while demonstrating cross-lingual toxicity detection and visual classification tasks.
Toward Efficient Sparse Autoencoder-Guided Steering for Improved In-Context Learning in Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Sparse autoencoders (SAEs) have emerged as a powerful analytical tool in mechanistic interpretability for large language models (LLMs).
Approach: They propose a novel approach that leverages SAEs to enhance the general in-context learning performance of large language models (LLMs).
Outcome: The proposed method yields a 3.5% improvement across diverse text classification tasks and exhibits greater robustness to hyperparameter variations compared to standard steering approaches.
SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive capabilities in natural language understanding and generation, but controlling their behavior remains a challenge.
Approach: They propose a supervised steering approach that operates in sparse, interpretable representation spaces.
Outcome: The proposed approach achieves higher success rates with minimal degradation in generation quality compared to existing methods.
Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders (2025.findings-acl)

Copied to clipboard

Challenge: Existing algorithms for AI text detection lack interpretability, limiting their reliability in highstakes applications.
Approach: They extend existing ATD frameworks by using Sparse Autoencoders to extract features from Gemma-2-2b residual stream.
Outcome: The proposed algorithms can extract human-interpretable features from Gemma-2-2b model.
Unveiling Language-Specific Features in Large Language Models via Sparse Autoencoders (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) exhibit impressive abilities in various domains such as text generation, instruction following, and reasoning.
Approach: They propose a method to decompose the activations of Large Language Models into a sparse linear combination of SAE features.
Outcome: The proposed method shows that some features are strongly related to specific languages, while others are unaffected by ablating them.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations