Papers by Dennis Svirin
Detecting Overflow in Compressed Token Representations for Retrieval-Augmented Generation (2026.eacl-srw)
Copied to clipboard
| Challenge: | Efficient long-context processing remains a challenge for large language models (LLMs) however, the limits of compressibility remain underexplored. |
| Approach: | They propose a method to characterize and detect token overflow in xRAG soft-compression by mapping long contexts into dense vectors that can be directly consumed by the model. |
| Outcome: | The proposed method identifies token overflow with query-agnostic saturation statistics but lacks the capability to detect it. |