Papers by Joy Crosbie
Induction Heads as an Essential Mechanism for Pattern Matching in In-context Learning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models have shown a remarkable ability to learn and perform complex tasks through in-context learning (ICL). |
| Approach: | They analyse two state-of-the-art models, Llama-3-8B and InternLM2-20B on abstract pattern recognition and NLP tasks. |
| Outcome: | The proposed model can perform up to 32% better than previous models on abstract pattern recognition and NLP tasks. |