Papers by Antonio Serino
Safe-Unsafe Concept Separation Emerges from a Single Direction in Language Models Activation Space (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to ensuring the safety of Large Language Models (LLMs) rely on invasive fine- tuning or external generation-based checks, which can be opaque and resource-inefficient. |
| Approach: | They propose a mechanistic method that identifies the layer where safe and unsafe concepts are maximally separable within a pretrained representation space. |
| Outcome: | The proposed method can be used across multiple domains, diverse tasks, and 16 non-English languages on encoder and decoder architectures. |
SFAL: Semantic-Functional Alignment Scores for Distributional Evaluation of Auto-Interpretability in Sparse Autoencoders (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Interpreting the internal representations of large language models (LLMs) is crucial for their deployment in real-world applications, impacting areas such as AI safety, debugging, and compliance. |
| Approach: | They propose an alternative evaluation strategy that assesses the alignment between the semantic neighbourhoods of features and their functional neighbourhoods by using co-occurrence statistics. |
| Outcome: | The proposed evaluation strategy reduces reliance on scoring on large-scale models and improves efficiency and cost-effectiveness. |