Papers by Tom Drummond
Noisy Self-Training with Synthetic Queries for Dense Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural retrieval models require training on a sufficient number of human-labelled query-passage pairs to work well. |
| Approach: | They propose a noisy self-training framework with synthetic queries to improve retrieval methods. |
| Outcome: | The proposed method outperforms baselines on general-domain and out-of-domain retrieval benchmarks on low-resource settings and is data efficient and data efficient. |
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to enhance dense retrieval models are unwieldy, such as requiring explicit supervision, complex model architectures, or massive external models. |
| Approach: | They propose an unsupervised method to enhance passage retrieval in zero-shot settings by iterating a loop that a dense retriever learns from supervision signals provided by a reranker. |
| Outcome: | The proposed method outperforms leading supervised and unsupervised retrievers on the BEIR benchmark while showing strong adaptation abilities to tasks and domains that were unseen during training. |
Don’t Mess with Mister-in-Between: Improved Negative Search for Knowledge Graph Completion (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph completion use a dual-encoding framework with a bottleneck that allows for fast approximate search over a vast collection of candidates. |
| Approach: | They propose to use a dual-encoder framework to find more informative negatives by searching for candidates with high lexical overlaps. |
| Outcome: | The proposed methods improve on the large-scale Wikidata5M dataset and combine different kinds of strategies to achieve state-of-the-art performance. |
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Cross-lingual open domain question answering requires multiple models, requiring substantial annotated datasets and auxiliary resources to bridge between languages. |
| Approach: | They propose a selfsupervised method that exploits Wikipedia's cross-lingual link structure . they show that the method outperforms comparable methods on supervised and zero-shot settings . |
| Outcome: | The proposed method outperforms comparable methods on supervised and zero-shot language adaptation settings. |