Challenge: Existing approaches to find relevant passages using sparse keywords are not effective for open domain question answering.
Approach: They propose a new contrastive learning method for learning a dual-encoder model for question-passage matching using a large pool of negative samples.
Outcome: The proposed method maintains large pool of negative samples and optimizes question-to-passage and passage-to question matching tasks.

Similar Papers

Sentence-aware Contrastive Learning for Open-Domain Passage Retrieval (2022.acl-long)

Copied to clipboard

Challenge: Existing studies focus on improving negative sampling strategy or extra pretraining for dense passage representations, but these studies are not capturing passage with internal representation conflicts.
Approach: They propose a model with a smaller granularity to capture internal representation conflicts . they introduce a negative sampling strategy to encourage a diverse generation of sentence representations within the same passage.
Outcome: The proposed model can be trained on three benchmark datasets to alleviate internal representation conflicts.
Dense Passage Retrieval for Open-Domain Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Open-domain question answering relies on efficient passage retrieval to select candidate contexts.
Approach: They propose a dual-encoder framework that can be implemented to retrieve passages from a small number of questions and passages.
Outcome: The proposed system outperforms a strong Lucene-BM25 system in top-20 passage retrieval accuracy on multiple open-domain QA benchmarks.
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval Augmented Generation can be used to process long contexts in Open-Domain Question-Answering tasks.
Approach: They propose a method to cover longer contexts in Open-Domain Question-Answering tasks by using a small encoder language model and cross-attention with origin inputs.
Outcome: The proposed method can cover longer contexts while keeping the computing requirements close to the baseline.
M3: A Multi-Task Mixed-Objective Learning Framework for Open-Domain Multi-Hop Dense Sentence Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Recent research shows that contrastive learning can lead to suboptimal retrieval performance.
Approach: They propose an advanced recursive Multi-hop dense sentence retrieval system built upon a novel Multi-task Mixed-objective approach for dense text representation learning.
Outcome: The proposed approach yields state-of-the-art performance on a large-scale open-domain fact verification benchmark dataset, FEVER.
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering (2021.naacl-main)

Copied to clipboard

Challenge: Open-domain question answering uses dense passage retrieval to find answers . however, it is difficult to effectively train a dual-encoder due to discrepancy between training and inference .
Approach: They propose an optimized training approach to improve dense passage retrieval using RocketQA . they propose cross-batch negatives, denoised hard negatives and data augmentation .
Outcome: The proposed approach outperforms state-of-the-art models on both MSMARCO and Natural Questions.
Momentum Contrastive Pre-training for Question Answering (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for extractive Question Answering generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-trained models to simple keyword matching.
Approach: They propose a method to align the answer probability between cloze-like and natural query-passage sample pairs.
Outcome: The proposed method improves on three benchmarking QA datasets on supervised and zero-shot scenarios.
Crossing Variational Autoencoders for Answer Retrieval (2020.acl-main)

Copied to clipboard

Challenge: Existing methods learned semantic representations with dual encoders or dual variational auto-encoders failed to capture the aligned semantics between question and answer.
Approach: They propose to use two variational auto-encoders to generate questions with aligned answers and generating answers with align questions.
Outcome: The proposed method outperforms the state-of-the-art answer retrieval method on SQuAD.
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval (2023.acl-long)

Copied to clipboard

Challenge: Contrastive learning is the dominant paradigm for learning text representations from parallel text, but finding negative examples can be expensive in terms of compute or manual effort.
Approach: They propose a generative model for learning multilingual text embeddings which encourages source separation in multilingual contexts by an approximation.
Outcome: The proposed model outperforms both a strong contrastive and generative baseline on a suite of tasks including semantic similarity, bitext mining, and cross-lingual question retrieval.
Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to solve question answering (QA) problems are limited by the need for text generation and answer retrieval.
Approach: They propose to introduce QA interaction features in scoring function but at the cost of low efficiency in inference stage.
Outcome: The proposed framework significantly outperforms the state-of-the-art method on multiple answer retrieval datasets.
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering (2021.eacl-main)

Copied to clipboard

Challenge: Existing approaches to extracting answer from text are expensive to train and train.
Approach: They investigate how much models benefit from retrieving text passages . they obtain state-of-the-art results on the Natural Questions and TriviaQA open benchmarks ."
Outcome: The proposed model performs better when retrieving more passages than previously thought .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations