Papers by Minsang Seok
SEAL: Scaling to Emphasize Attention for Long-Context Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that advanced LLMs suffer from degradation when processing longer context data. |
| Approach: | They propose a learning-based mechanism that leverages generated data to emphasize attention heads for long-context retrieval. |
| Outcome: | The proposed approach improves retrieval performance over long contexts while maintaining high reliability. |