Papers by Christoforos Nalmpantis
Neurons in Large Language Models: Dead, N-gram, Positional (2024.findings-acl)
Copied to clipboard
| Challenge: | We analyze a family of large language models in such a lightweight manner that can be done on a single GPU. |
| Approach: | They analyze a family of large language models that rely on whether an FFN neuron is activated or not . they use a single GPU to analyze the OPT network and use it to analyze data . |
| Outcome: | The proposed model is lightweight and can be run on a single GPU. |