Papers with MoPo
Momentum Posterior Regularization for Multi-hop Dense Retrieval (2025.coling-main)
Copied to clipboard
| Challenge: | Current methods for knowledge distillation in one-time retrieval are ineffective for multi-hop QA . posterior information is often defined as the response, which may not connect to the query without intermediate retrieval . |
| Approach: | They propose to distill knowledge from a posterior retrieval into a prior retrieval for multi-hop QA . they propose to use momentum moving average method to update posterior information along with prior retrievals . |
| Outcome: | Experiments on HotpotQA and StrategyQA show that MoPo outperforms baselines in retrieval and downstream QA tasks. |