Challenge: Existing methods for dense retrieval are not effective, but there are still challenges.
Approach: They propose a retrieval oriented pre-training paradigm based on Masked Auto-Encoder (MAE) where the sentence embedding is generated from the encoder’s masked input and the original sentence is recovered based upon the sentence embedded and decoded input via mangled language modeling.
Outcome: The proposed model significantly improves the SOTA performance on a wide range of NLP benchmarks, like BEIR and MS MARCO.

Similar Papers

RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for retrieval-oriented language models focus on contextualized embedding of the [CLS] token, but recent study shows that ordinary tokens besides [CLL] may provide extra information, which help to produce a better representation effect.
Approach: They propose a method where all contextualized embeddings of pre-trained model can be jointly pre-trained for retrieval tasks.
Outcome: The proposed method improves the quality of representation where all contextualized embeddings of the pre-trained model can be leveraged.
Less is More: Pretrain a Strong Siamese Encoder for Dense Text Retrieval Using a Weak Decoder (2021.emnlp-main)

Copied to clipboard

Challenge: Dense retrieval requires high-quality text sequence embeddings to support effective search in the representation space.
Approach: They propose a self-learning method that pre-trains the autoencoder using a weak decoder to push the encoder to provide better sequence representations.
Outcome: The proposed model significantly boosts the effectiveness and few-shot ability of dense retrieval models on web search, news recommendation, and open domain question answering.
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study (2023.emnlp-main)

Copied to clipboard

Challenge: a recent study shows that retrieval-augmented LMs can improve text generation quality and accuracy.
Approach: They propose a model that reproduces RETRO parameters while retrieving a text corpus . they find RETRO outperforms GPT on text generation with less repetition .
Outcome: The proposed model outperforms standard retrieval-augmented GPT and retrieval augmented GTP on text generation and accuracy tasks.
Condenser: a Pre-training Architecture for Dense Retrieval (2021.emnlp-main)

Copied to clipboard

Challenge: Prior work fine-tunes deep LMs to encode text sequences into single dense vector representations, but dense encoders require a lot of data and sophisticated techniques to train and suffer in low data situations.
Approach: They propose to pre-train Transformer language models (LMs) with a novel Transformer architecture, Condenser, where LM prediction CONditions on DENSE Representation.
Outcome: The proposed model improves on various text retrieval and similarity tasks by large margins over standard LMs.
Conditioned Masked Language and Image Modeling for Image-Text Dense Retrieval (2022.findings-emnlp)

Copied to clipboard

Challenge: Large-scale two-stream pre-trained models like CLIP have achieved tremendous success in image-text retrieval.
Approach: They propose a cross-modal framework for image-text retrieval using two-stream pre-trained models . they embed images and texts into instance representations with two separate encoders . experimental results on MSCOCO and Flickr30k reveal the effectiveness of their framework .
Outcome: The proposed framework improves image-text retrieval performance on two popular cross-modal retrieval benchmarks.
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference (2022.findings-acl)

Copied to clipboard

Challenge: State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking.
Approach: They propose to fine tune a pretrained encoder-decoder model using document to query generation.
Outcome: The proposed model achieves comparable results to more expensive approaches while being 6.8X faster.
Cross-Thought for Sentence Encoder Pre-training (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models to pretrain sentence encoders with large unlabeled corpus are lacking in linguistic information retrieval.
Approach: They propose a novel approach to pre-training sequence encoder using transformers . they propose to train a Transformer-based sequence encoded over a large set of short sequences based on a set of masked words .
Outcome: The proposed approach outperforms state-of-the-art encoders on hotpotQA by improving intermediate information retrieval performance.
Lacuna Reconstruction: Self-Supervised Pre-Training for Low-Resource Historical Document Transcription (2022.findings-naacl)

Copied to clipboard

Challenge: Document transcription models are limited by extremely varied style and content across domains.
Approach: They propose a self-supervised approach for learning rich visual representations for both handwritten and printed historical document transcription using a heterogeneous set of handwritten Islamicate manuscript images and early modern English printed documents.
Outcome: The proposed model improves on a supervised model with as few as 30 line image transcriptions on two languages with a single line of image training.
Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: masked language models have been used for natural language processing tasks but few studies have adopted it in the sequence-to-sequence models.
Approach: They propose to combine encoder and decoder to train a masked sequence-to-sequence model . they propose to train the encoder more rigorously by masking the encoded input .
Outcome: The proposed model achieves 27.69/32.24 BLEU scores on English-German/German-English tasks with 5+ times speed up compared with an autoregressive model.
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods to model coarse-grained linguistic information do not integrate coarse-gram information into pre-training.
Approach: They propose an explicitly n-gram masking method to enhance integration of coarse-grained linguistic information into pre-training.
Outcome: The proposed method outperforms existing models on English and Chinese text corpora and fine-tunes on 19 downstream tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations