Challenge: Existing frameworks for analyzing text embedding models are limited.
Approach: They propose a framework that uses lightweight poolers to analyze STS, PI, and Triplet datasets.
Outcome: The proposed framework shows that the model captures semantic differences between sentences and is consistent across datasets.

Similar Papers

Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity (2020.acl-main)

Copied to clipboard

Challenge: Existing word embeddings combine complementary strengths of their components to achieve unsupervised semantic similarity (STS).
Approach: They propose to ensemble pre-trained sentence encoders into sentence meta-embeddings to achieve unsupervised Semantic Textual Similarity (STS) they adapt dimensionality reduction, generalized Canonical Correlation Analysis and cross-view auto-encoders to their work.
Outcome: The proposed method achieves 3.7% to 6.4% Pearson’s r over single-source word embeddings on the STS Benchmark and on the StS12-STS16 datasets.
Going Beyond Sentence Embeddings: A Token-Level Matching Algorithm for Calculating Semantic Textual Similarity (2023.acl-short)

Copied to clipboard

Challenge: Semantic Textual Similarity (STS) measures the degree to which the underlying semantics of paired sentences are equivalent.
Approach: They propose a token-level matching inference algorithm which can be applied on top of any language model to improve its performance on STS task.
Outcome: The proposed method improves the performance of almost all language models, with up to 12.7% gain in Spearman’s correlation.
Style is NOT a single variable: Case Studies for Cross-Stylistic Language Understanding (2021.acl-long)

Copied to clipboard

Challenge: a benchmark corpus of text in 15 different styles is used to study stylistic language . a similar benchmark is used for cross-style language understanding .
Approach: They propose a benchmark corpus that combines existing datasets and collects a new one for cross-style language understanding.
Outcome: The proposed benchmark corpus contains 15 different styles under four theoretical groupings: figurative, personal, affective, and interpersonal groups.
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for embedding text are limited by the imperfect nature of data acquired under such assumptions.
Approach: They propose a new approach to training stronger content-independent style embeddings using a synthetic dataset of near-exact paraphrases with controlled style variations.
Outcome: The proposed model outperforms existing methods in real-world benchmarks and outperformed leading style representations in downstream applications.
Interpretable Text Embeddings and Text Similarity Explanation: A Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Text embeddings are a fundamental component in many NLP tasks, but their interpretation and explanation remain challenging.
Approach: They propose a framework for interpretable text embeddings and text similarity explanation . they characterize the main ideas, approaches, and trade-offs and discuss lessons learned .
Outcome: The proposed methods are compared with existing models and compare them with existing ones.
Exploring Semantic Properties of Sentence Embeddings (P18-2)

Copied to clipboard

Challenge: Neural vector representations are ubiquitous throughout all subfields of natural language processing.
Approach: They propose a framework that generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect their similarity.
Outcome: The proposed framework generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect the similarities obtained between their embeddings.
MUSTS: MUltilingual Semantic Textual Similarity Benchmark (2025.acl-short)

Copied to clipboard

Challenge: Existing benchmarks for semantic textual similarity (STS) are limited to high-resource languages and do not include datasets annotated focusing on relatedness instead of similarity.
Approach: They propose to evaluate multilingual semantic textual similarity benchmarks which span 13 languages and annotated datasets to evaluate and compare them.
Outcome: The proposed method is the most comprehensive benchmark of multilingual STS methods.
Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity (2024.lrec-main)

Copied to clipboard

Challenge: Using labeled NLI datasets for learning sentence embeddings leads to improved performance for natural language understanding tasks.
Approach: They compare two data augmentation techniques for learning better sentence embeddings . they use a cross-lingual transfer technique that exploits English resources as training data to yield non-English sentence embeds as zero-shot inference .
Outcome: The proposed techniques yield better performance on Japanese and Korean sentences.
Embedding Style Beyond Topics: Analyzing Dispersion Effects Across Different Language Models (2025.coling-main)

Copied to clipboard

Challenge: Using a literary corpus that alternates between topics and styles, we compare language models across French and English.
Approach: They analyze how writing style affects embedding spaces across multiple language models . they use a literary corpus that alternates between topics and styles to compare their results .
Outcome: The proposed model is based on two established literary works in French and English.
Unsupervised Learning of Style-sensitive Word Vectors (P18-2)

Copied to clipboard

Challenge: Existing studies on what is said and how it is said focus on stylistic variations . lack of objective definitions is a major difficulty in studying style .
Approach: They propose to extend the continuous bag of words embedding model to learn style-sensitive word vectors using a wider context window.
Outcome: The proposed extensions contribute to the acquisition of style-sensitive word embeddings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations