From Semantics to Style: A Cross-Dataset Comparative Framework for Sentence Similarity Predictions (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing frameworks for analyzing text embedding models are limited. |
| Approach: | They propose a framework that uses lightweight poolers to analyze STS, PI, and Triplet datasets. |
| Outcome: | The proposed framework shows that the model captures semantic differences between sentences and is consistent across datasets. |
Similar Papers
Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity (2020.acl-main)
Copied to clipboard
| Challenge: | Existing word embeddings combine complementary strengths of their components to achieve unsupervised semantic similarity (STS). |
| Approach: | They propose to ensemble pre-trained sentence encoders into sentence meta-embeddings to achieve unsupervised Semantic Textual Similarity (STS) they adapt dimensionality reduction, generalized Canonical Correlation Analysis and cross-view auto-encoders to their work. |
| Outcome: | The proposed method achieves 3.7% to 6.4% Pearson’s r over single-source word embeddings on the STS Benchmark and on the StS12-STS16 datasets. |
Going Beyond Sentence Embeddings: A Token-Level Matching Algorithm for Calculating Semantic Textual Similarity (2023.acl-short)
Copied to clipboard
| Challenge: | Semantic Textual Similarity (STS) measures the degree to which the underlying semantics of paired sentences are equivalent. |
| Approach: | They propose a token-level matching inference algorithm which can be applied on top of any language model to improve its performance on STS task. |
| Outcome: | The proposed method improves the performance of almost all language models, with up to 12.7% gain in Spearman’s correlation. |
Style is NOT a single variable: Case Studies for Cross-Stylistic Language Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | a benchmark corpus of text in 15 different styles is used to study stylistic language . a similar benchmark is used for cross-style language understanding . |
| Approach: | They propose a benchmark corpus that combines existing datasets and collects a new one for cross-style language understanding. |
| Outcome: | The proposed benchmark corpus contains 15 different styles under four theoretical groupings: figurative, personal, affective, and interpersonal groups. |
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples (2025.naacl-long)
Copied to clipboard
Ajay Patel, Jiacheng Zhu, Justin Qiu, Zachary Horvitz, Marianna Apidianaki, Kathleen McKeown, Chris Callison-Burch
| Challenge: | Existing methods for embedding text are limited by the imperfect nature of data acquired under such assumptions. |
| Approach: | They propose a new approach to training stronger content-independent style embeddings using a synthetic dataset of near-exact paraphrases with controlled style variations. |
| Outcome: | The proposed model outperforms existing methods in real-world benchmarks and outperformed leading style representations in downstream applications. |
Interpretable Text Embeddings and Text Similarity Explanation: A Survey (2025.emnlp-main)
Copied to clipboard
| Challenge: | Text embeddings are a fundamental component in many NLP tasks, but their interpretation and explanation remain challenging. |
| Approach: | They propose a framework for interpretable text embeddings and text similarity explanation . they characterize the main ideas, approaches, and trade-offs and discuss lessons learned . |
| Outcome: | The proposed methods are compared with existing models and compare them with existing ones. |
Exploring Semantic Properties of Sentence Embeddings (P18-2)
Copied to clipboard
| Challenge: | Neural vector representations are ubiquitous throughout all subfields of natural language processing. |
| Approach: | They propose a framework that generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect their similarity. |
| Outcome: | The proposed framework generates triplets of sentences to explore how changes in the syntactic structure or semantics of a given sentence affect the similarities obtained between their embeddings. |
MUSTS: MUltilingual Semantic Textual Similarity Benchmark (2025.acl-short)
Copied to clipboard
| Challenge: | Existing benchmarks for semantic textual similarity (STS) are limited to high-resource languages and do not include datasets annotated focusing on relatedness instead of similarity. |
| Approach: | They propose to evaluate multilingual semantic textual similarity benchmarks which span 13 languages and annotated datasets to evaluate and compare them. |
| Outcome: | The proposed method is the most comprehensive benchmark of multilingual STS methods. |
Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity (2024.lrec-main)
Copied to clipboard
| Challenge: | Using labeled NLI datasets for learning sentence embeddings leads to improved performance for natural language understanding tasks. |
| Approach: | They compare two data augmentation techniques for learning better sentence embeddings . they use a cross-lingual transfer technique that exploits English resources as training data to yield non-English sentence embeds as zero-shot inference . |
| Outcome: | The proposed techniques yield better performance on Japanese and Korean sentences. |
Embedding Style Beyond Topics: Analyzing Dispersion Effects Across Different Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Using a literary corpus that alternates between topics and styles, we compare language models across French and English. |
| Approach: | They analyze how writing style affects embedding spaces across multiple language models . they use a literary corpus that alternates between topics and styles to compare their results . |
| Outcome: | The proposed model is based on two established literary works in French and English. |
Unsupervised Learning of Style-sensitive Word Vectors (P18-2)
Copied to clipboard
| Challenge: | Existing studies on what is said and how it is said focus on stylistic variations . lack of objective definitions is a major difficulty in studying style . |
| Approach: | They propose to extend the continuous bag of words embedding model to learn style-sensitive word vectors using a wider context window. |
| Outcome: | The proposed extensions contribute to the acquisition of style-sensitive word embeddings. |