mStyleDistance: Multilingual Style Embeddings and their Evaluation (2025.findings-acl)
Copied to clipboard
| Challenge: | Multilingual StyleDistance embeddings are useful for stylistic analysis and style transfer, but they only exist for English. |
| Approach: | They propose a method that can generate style embeddings in new languages using synthetic data and a contrastive loss. |
| Outcome: | The proposed method outperforms existing style embeddings on these benchmarks and generalizes well to unseen features and languages. |
Similar Papers
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples (2025.naacl-long)
Copied to clipboard
Ajay Patel, Jiacheng Zhu, Justin Qiu, Zachary Horvitz, Marianna Apidianaki, Kathleen McKeown, Chris Callison-Burch
| Challenge: | Existing methods for embedding text are limited by the imperfect nature of data acquired under such assumptions. |
| Approach: | They propose a new approach to training stronger content-independent style embeddings using a synthetic dataset of near-exact paraphrases with controlled style variations. |
| Outcome: | The proposed model outperforms existing methods in real-world benchmarks and outperformed leading style representations in downstream applications. |
MTEB-NL and E5-NL: Embedding Benchmark and Models for Dutch (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in embedding resources have led to a lack of representation of the Dutch language in multilingual resources. |
| Approach: | They introduce Massive Text Embedding Benchmark for Dutch (MTEB-NL) which includes existing Dutch datasets and newly created ones, covering a wide range of tasks. |
| Outcome: | The proposed models demonstrate strong performance across multiple tasks. |
Embedding Style Beyond Topics: Analyzing Dispersion Effects Across Different Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Using a literary corpus that alternates between topics and styles, we compare language models across French and English. |
| Approach: | They analyze how writing style affects embedding spaces across multiple language models . they use a literary corpus that alternates between topics and styles to compare their results . |
| Outcome: | The proposed model is based on two established literary works in French and English. |
Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | a lack of standardized and reliable methods for automatic evaluation hinders ST . prior work has employed as many as nine different automatic systems to rate formality alone . |
| Approach: | They evaluate automatic metrics on the oft-researched task of formality style transfer . they outline best practices for automatic evaluation in (formality) style transfer and identify models that correlate well with human judgments. |
| Outcome: | The proposed models correlate well with human judgments and are robust across languages. |
MGAD: Multilingual Generation of Analogy Datasets (L18-1)
Copied to clipboard
| Challenge: | Existing methods for word embedding evaluation are computationally expensive and task-specific. |
| Approach: | They propose a minimally supervised method for generating word embedding evaluation datasets for a large number of languages using existing dependency treebanks and parsers. |
| Outcome: | The proposed method evaluates three popular word embedding algorithms against these datasets and shows that their performance varies between syntactic categories. |
Language Agnostic Code Embeddings (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies show that code language models have strong cross-lingual traits, but their multilingual representations can be dissected into a language-specific syntax component and a semantic component. |
| Approach: | They propose to isolate and eliminate language-specific components from multilingual code embeddings to improve downstream code retrieval tasks. |
| Outcome: | The proposed model improves retrieval tasks by removing language-specific components . the proposed model can be used to perform a variety of code generation tasks . |
Style is NOT a single variable: Case Studies for Cross-Stylistic Language Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | a benchmark corpus of text in 15 different styles is used to study stylistic language . a similar benchmark is used for cross-style language understanding . |
| Approach: | They propose a benchmark corpus that combines existing datasets and collects a new one for cross-style language understanding. |
| Outcome: | The proposed benchmark corpus contains 15 different styles under four theoretical groupings: figurative, personal, affective, and interpersonal groups. |
Learning Interpretable Style Embeddings via Prompting LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has treated the style of a text as separable from the content. |
| Approach: | They use prompting to perform stylometry on a large number of texts to generate a synthetic stylometric dataset. |
| Outcome: | The proposed model trains human-interpretable representations on a large stylometric dataset and a linguistic model for style representation learning. |
Comparing Pretrained Multilingual Word Embeddings on an Ontology Alignment Task (L18-1)
Copied to clipboard
| Challenge: | Existing word embeddings capture a string's semantics and can be trained for multiple languages. |
| Approach: | They propose to compare three different multilingual pretrained word embedding repositories with a string-matching baseline and use it to compute semantic similarities of strings in different languages. |
| Outcome: | The proposed method produces correct alignments on a non-standard dataset on all four languages. |
Multilingual Culture-Independent Word Analogy Datasets (2020.lrec-1)
Copied to clipboard
| Challenge: | In text processing, deep neural networks use word embeddings as an input. |
| Approach: | They propose to use benchmark datasets to compare the quality of word embeddings in text processing . they use a word analogy task in Croatian, English, Estonian, Finnish, Latvian, Lithuanian, Russian, Slovenian, and Swedish . |
| Outcome: | The proposed datasets are culturally independent and cross-lingual for the languages used. |