Papers by Shubham Chatterjee
DyVo: Dynamic Vocabularies for Learned Sparse Retrieval with Entities (2024.emnlp-main)
Copied to clipboard
| Challenge: | Learned Sparse Retrieval (LSR) models use vocabularies from pre-trained transformers, which often split entities into nonsensical fragments. |
| Approach: | They propose to enhance the LSR vocabulary with Wikipedia concepts and entities, enabling the model to resolve ambiguities more effectively and stay current with evolving knowledge. |
| Outcome: | The proposed model outperforms state-of-the-art models across three entity-rich document ranking datasets. |