Papers by Mehrdad Farahani
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Generative language models struggle with specialized knowledge that is discussed less frequently on the web. |
| Approach: | They propose to use a model which decides between parametric and non-parametric knowledge to investigate how it uses the information from the context. |
| Outcome: | The proposed model can choose between parametric and non-parametric information, but relies more on context than parametric knowledge. |