Papers by Masaaki Imaizumi
Why Mean Pooling Works: Quantifying Second-Order Collapse in Text Embeddings (2026.acl-long)
Copied to clipboard
| Challenge: | Text embeddings are used across a wide range of NLP tasks, including retrieval-augmented generation. |
| Approach: | They propose a metric to quantify the collapse induced by mean pooling and a simple metric for measuring how often it occurs in real models and texts. |
| Outcome: | The proposed metric measures how often the collapse occurs in real models and texts. |