Proto-lm: A Prototypical Network-Based Framework for Built-in Interpretability in Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for interpreting LLMs are post hoc and focus on low-level features and lack of explainability at higher-level text units. |
| Approach: | They propose a prototypical network-based white-box framework that allows LLMs to learn immediately interpretable embeddings during the fine-tuning stage while maintaining competitive performance. |
| Outcome: | The proposed framework can learn interpretable embeddings during the fine-tuning stage while maintaining competitive performance. |
Similar Papers
Towards Intrinsic Interpretability of Large Language Models: A Survey of Design Principles and Architectures (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on explainable AI focus on post-hoc explanation methods that interpret trained models through external approximations. |
| Approach: | They propose to categorize existing approaches into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction. |
| Outcome: | The proposed approaches are categorized into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction. |
Revitalizing Black-Box Interpretability: Actionable Interpretability for LLMs via Proxy Models (2026.acl-long)
Copied to clipboard
| Challenge: | Applying model-agnostic explanations to Large Language Models is hindered by prohibitive computational costs rendering them dormant for real-world applications. |
| Approach: | They propose a budget-friendly proxy framework that leverages efficient models to approximate the decision boundaries of expensive Large Language Models. |
| Outcome: | The proposed framework achieves over 90% fidelity with only 9.5% of the oracle’s cost and is open-source to facilitate future research. |
Can LLMs Facilitate Interpretation of Pre-trained Language Models? (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to uncover knowledge encoded within pre-trained language models are limited in terms of scalability and scope of interpretation. |
| Approach: | They propose to use a large language model, ChatGPT, as an annotation tool . they demonstrate that ChatGPt produces accurate and semantically richer annotations . |
| Outcome: | The proposed method produces accurate and semantically richer annotations compared to human annotations. |
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)
Copied to clipboard
| Challenge: | introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance. |
| Approach: | They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them. |
| Outcome: | The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods. |
Neuro-Symbolic Natural Language Processing (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations in terms of safe and controlled reasoning, interpretability and adaptability . this tutorial aims to bridge the gap between the practical performance of LLMs and the principled modelling of language and inference of formal methods. |
| Approach: | This tutorial aims to bridge the gap between the practical performance of Large Language Models and the principled modelling of language and inference of formal methods. |
| Outcome: | This tutorial aims to bridge the gap between the performance of LLMs and the principled modelling of language and inference of formal methods. |
Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) contain billions of parameters and can perform a variety of downstream tasks. |
| Approach: | They propose an open-source framework for fine-tuning large language models (LLMs) they address key challenges facing LLMs fine- tuned for simultaneous translation . |
| Outcome: | The proposed framework validates classical SimulMT concepts and practices in the context of LLMs and explores adapting LLM fine-tuned for NMT to the task of Simul-LLM. |
Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approach (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt. |
| Approach: | They propose to refine a Large Language Model (LLM) with prompt-output pairs with equivalent semantics to achieve semantic consistency. |
| Outcome: | The proposed method improves the semantic consistency and task performance of LLMs. |
Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work (2022.aacl-tutorials)
Copied to clipboard
| Challenge: | Pre-trained language models are language models that are pre-taught on large-scaled corpora in a self-supervised fashion. |
| Approach: | This tutorial provides a broad and comprehensive introduction to pre-trained language models . it focuses on emerging methods that enable PLMs to perform diverse downstream tasks . |
| Outcome: | This tutorial focuses on the benefits of pre-trained language models and how to use them in NLP tasks. |
LLM Evaluate: An Industry-Focused Evaluation Tool for Large Language Models (2025.coling-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated impressive capability to solve a wide range of tasks in recent years. |
| Approach: | They propose to build an on-premise system for LLM evaluation to address the challenges in the evaluation of LLMs in real-world industrial settings. |
| Outcome: | The proposed evaluation system protects customer privacy and protects data integrity in real-world industrial environments. |
Adaptation of Large Language Models (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | a tutorial on adaptation of large language models addresses the growing demand for models that go beyond static capabilities. |
| Approach: | This tutorial will provide an overview of dynamic, domain-specific, and task-adaptive LLM adaptation techniques. |
| Outcome: | This tutorial will outline dynamic, domain-specific, and task-adaptive LLM adaptation techniques. |