Papers by Oren Elisha
Improving LLM Attributions with Randomized Path-Integration (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in AI research have impacted numerous application domains, fueling innovation and progress in user modeling and personalization. |
| Approach: | They propose a path-integration method for explaining language models via randomization of the integration path over the attention information in the model. |
| Outcome: | The proposed method outperforms state-of-the-art methods across 4 datasets and 5 evaluation metrics. |
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights. |
| Approach: | They compare unsupervised fine-tuning and retrieval-augmented generation approaches to learning new factual information. |
| Outcome: | The proposed models outperform unsupervised fine-tuning and retrieval-augmented generation (RAG) on knowledge-intensive tasks across different topics. |
LLM Explainability via Attributive Masking Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In this paper, we introduce Attributive Masking Learning (AML), a method designed for explaining language model predictions by learning input masks. |
| Approach: | They introduce a method for explaining language model predictions by learning input masks and ensuring a significant change in the model's explanation when applying the inverse mask to the input. |
| Outcome: | The proposed method outperforms state-of-the-art explanation methods on multiple benchmarks. |