Papers by Tuan-Luc Huynh
MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to update model-based indexes with new documents are expensive and require expensive retraining. |
| Approach: | They propose a framework that combines an expandable mixture of Low-Rank Adaptation experts with a layer-wise out-of-distribution-driven expansion strategy. |
| Outcome: | Experiments on NQ320k and MS MARCO Passage show that the proposed framework outperforms full-model update baselines with minimal parameter overhead and substantially lower training costs. |