Challenge: a method to compare and visualise sentence encoders at scale is proposed . we map encoder LLMs using QRE-based feature vectors, which are then projected to 2D .
Approach: They propose a method to compare and visualise sentence encoders at scale by creating a map of encoder . they construct a QRE-based map of sentences covering 1101 publicly available sentence encoded sentences .
Outcome: The proposed method compares sentence encoders at scale by creating a map of encoder models . it shows that the map accurately reflects relationships between encoder and unit base encoder .

Similar Papers

Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models (2022.findings-acl)

Copied to clipboard

Challenge: Sentence embeddings are useful for language processing tasks, but it is unclear how to produce them from encoder-decoder models.
Approach: They investigate the effects of scaling up sentence encoders to 11B parameters on sentence embeddings from text-to-text transformers (T5) .
Outcome: The proposed models outperform the previous best models on both SentEval and SentGLUE transfer tasks.
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties (P18-1)

Copied to clipboard

Challenge: a lack of understanding of the properties of sentence embeddings is limiting the use of the techniques.
Approach: They propose 10 probing tasks designed to capture simple linguistic features of sentences . they use three different encoders to train embeddings in eight different ways .
Outcome: The proposed tasks capture key linguistic features of sentences, but they are difficult to infer from them.
Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations (2024.naacl-long)

Copied to clipboard

Challenge: Sentence embeddings are typically learned to recognize the semantic relation between two text inputs.
Approach: They introduce a contrastively-learned contextual embedding model for fine-grained semantic representation of text.
Outcome: The proposed model is able to produce contextual embeddings corresponding to different atomic propositions, i.e. semantic equivalence between propositions across different text sequences.
Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity (2020.acl-main)

Copied to clipboard

Challenge: Existing word embeddings combine complementary strengths of their components to achieve unsupervised semantic similarity (STS).
Approach: They propose to ensemble pre-trained sentence encoders into sentence meta-embeddings to achieve unsupervised Semantic Textual Similarity (STS) they adapt dimensionality reduction, generalized Canonical Correlation Analysis and cross-view auto-encoders to their work.
Outcome: The proposed method achieves 3.7% to 6.4% Pearson’s r over single-source word embeddings on the STS Benchmark and on the StS12-STS16 datasets.
Learning Visually Grounded Sentence Representations (N18-1)

Copied to clipboard

Challenge: Unsupervised sentence representation models suffer from the grounding problem because of lack of association between symbols and external information.
Approach: They train a sentence encoder to predict image features of a caption and use them as sentence representations.
Outcome: The proposed model improves on word embeddings and word representations on standard benchmarks.
Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning (P19-1)

Copied to clipboard

Challenge: Encoder-decoder models for unsupervised sentence representation learning discard decoder after training . decoded sentences are often used to make better predictions of words in a given sentence .
Approach: They propose two types of decoding functions whose inverse can be easily derived without expensive inverse calculation.
Outcome: The proposed models can learn good representations from encoders and decoders without expensive calculations.
On Measuring Social Biases in Sentence Encoders (N19-1)

Copied to clipboard

Challenge: Word embeddings such as word2vec and GloVe exhibit human-like implicit biases based on gender, race, and other social constructs.
Approach: They propose a simple generaliza test to measure bias in word embeddings by comparing two sets of target-concept words to two sets .
Outcome: The proposed test shows that word2vec and word2Ve exhibit human-like implicit biases based on gender, race, and other social constructs.
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference (2020.findings-emnlp)

Copied to clipboard

Challenge: Large pre-trained language models are currently used for many NLP tasks . however, inference for these models requires significant computational resources .
Approach: They propose to use a shared text encoder to amortize the computational cost of inference over multiple tasks.
Outcome: The proposed method reduces the size of the extracted representations by a factor of 16 to store them for later use.
A Simple Geometric Method for Cross-Lingual Linguistic Transformations with Pre-trained Autoencoders (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies have used probing tasks to verify the presence of linguistic properties in vector representations, but it is unclear whether they can be manipulated to indirectly steer them.
Approach: They validate a geometric mapping technique to transform linguistic properties without tuning . they use a pre-trained multilingual autoencoder to transform three linguistic property .
Outcome: The proposed method can be used without tuning of the pre-trained autoencoder . the results are validated in monolingual and cross-lingual settings .
CASE – Condition-Aware Sentence Embeddings for Conditional Semantic Textual Similarity Measurement (2026.eacl-long)

Copied to clipboard

Challenge: Recent approaches use semantic similarity to improve the quality of sentence embeddings, but it is difficult to measure the similarity between sentences.
Approach: They propose a condition-aware sentence embedding method that uses an LLM encoder to create an embeddable sentence under a given condition.
Outcome: The proposed method improves the performance of LLM-based embeddings and the isotropy of the embeddable space despite requiring a small number of dimensions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations