Papers by Dionysis Kalogerias
Learning Task Representations from In-Context Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generalizing tasks to modalities beyond text fail to generalize effectively to linguistic tasks. |
| Approach: | They propose a method for encoding task information in ICL prompts as a function of attention heads within the transformer architecture. |
| Outcome: | The proposed method extracts task-specific information from in-context demonstrations and excels in both text and regression tasks. |