Papers by Wanhui Qian
PUNR: Pre-training with User Behavior Modeling for News Recommendation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing news recommendation methods use pre-trained language models to produce news vectors and user vectors. |
| Approach: | They propose an unsupervised pre-training paradigm with two tasks for user behavior modeling. |
| Outcome: | The proposed model improves on the real-world news benchmark. |
Query-as-context Pre-training for Dense Passage Retrieval (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve passage retrieval performance by using context-supervised pre-training are weakly correlated. |
| Approach: | They propose to use query-as-context pre-training to train passage-query pairs . they evaluate the pre-trained models on large-scale passage retrieval benchmarks . |
| Outcome: | The proposed technique improves performance on large-scale passage retrieval benchmarks and out-of-domain zero-shot benchmarks. |