| Challenge: | Anatomy-synonymy discrimination (ASD) is a crucial problem in lexical semantics and is difficult to distinguish between antonyms and synonyms. |
| Approach: | They propose a divide-and-conquer strategy where localized experts focus on their own domains to learn their specialties. |
| Outcome: | The proposed method achieves state-of-the-art performance on the Antonymy-synonymy discrimination task. |
Similar Papers
Combining Discourse Markers and Cross-lingual Embeddings for Synonym–Antonym Classification (N19-1)
Copied to clipboard
| Challenge: | Recent work shows that distributional semantic approaches have difficulty distinguishing between synonyms and antonyms. |
| Approach: | They propose to use monolingual distributional information available in a target language to transfer supervision to other languages using cross-lingual word embeddings. |
| Outcome: | The proposed method improves the transfer of monolingual distributional information to other languages using co-occurrences with discourse markers indicative of antonymy. |
A Mixture-of-Experts Model for Learning Multi-Facet Entity Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for learning entity embeddings from text descriptions leave it to downstream applications to identify these different facets and to select the most relevant ones. |
| Approach: | They propose a model that instead learns several vectors for each entity, each of which captures a different aspect of the considered domain. |
| Outcome: | The proposed model learns several vectors for each entity, each of which intuitively captures a different aspect of the considered domain. |
Eliciting and Understanding Cross-task Skills with Task-level Mixture-of-Experts (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained transformer models are capable of multitasking on diverse NLP tasks, but little is known about how multitaskability and cross-task generalization is achieved. |
| Approach: | They propose to use a transformer-based mixture-of-expert model with a router component to choose among experts dynamically and flexibly. |
| Outcome: | The proposed models improve the average performance gain (ARG) metric by 2.6% when adapting to unseen tasks, and by 5.6% in zero-shot generalization settings. |
Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model (N18-2)
Copied to clipboard
| Challenge: | Existing methods to specialize distributional vectors to better reflect a particular relation are lacking in modern natural language processing. |
| Approach: | They propose a feed-forward neural architecture for discriminating between lexico-semantic relations . they propose to train relation classifiers using lexical relations from external resources . |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and exhibits stable performance across languages. |
Specialization through Collaboration: Understanding Expert Interaction in Mixture-of-Expert Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Mixture-of-Experts (MoE) based large language models are popular for multitasking . however, whether each expert can specialize to a task remains unclear . |
| Approach: | They propose to use a dictionary learning approach to analyze expert collaboration mechanisms in MoE LLMs. |
| Outcome: | The proposed model outperforms existing methods by 2.5% while enabling 50% expert reduction. |
A Closer Look into Mixture-of-Experts in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Mixture-of-experts (MoE) architectures are gaining increasing attention for their unique properties and remarkable performance. |
| Approach: | They propose a mixture-of-experts architecture that allows for model scaling without sacrificing computational efficiency. |
| Outcome: | The proposed model increases model size without sacrificing computational efficiency . the proposed model is modular and can be used by a broad spectrum of practitioners . |
Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources (2020.acl-srw)
Copied to clipboard
| Challenge: | In this paper, we present an effective method for semantic specialization of word vector representations. |
| Approach: | They propose a method for semantic specialization of word vector representations using BabelNet. |
| Outcome: | The proposed method improves on word similarity and dialog state tracking tasks. |
LM-Lexicon: Improving Definition Modeling via Harmonizing Semantic Experts (2026.eacl-long)
Copied to clipboard
| Challenge: | LM-LEXICON is a definition modeling approach that integrates data clustering, semantic expert learning, and model merging. |
| Approach: | They propose a definition modeling approach that integrates data clustering, semantic expert learning, and model merging using a sparse mixture-of-experts architecture. |
| Outcome: | The proposed model outperforms existing methods on five widely used benchmarks and achieves a BLEU score of 7%. |
Leveraging Meta-Embeddings for Bilingual Lexicon Extraction from Specialized Comparable Corpora (C18-1)
Copied to clipboard
| Challenge: | Recent studies on bilingual lexicon extraction from specialized comparable corpora show differences in performance . lack of large specialized corporan to build efficient representations can be partially explained . |
| Approach: | They propose to use character-based embedding models to combine different embeddable models . they emphasize how character-driven embeddance models outperform other models on quality . |
| Outcome: | The proposed model outperforms other models on quality of extracted bilingual lexicons . comparable corpora are an interesting and practical alternative to parallel corporation . |
Multi-Source Domain Adaptation with Mixture of Experts (D18-1)
Copied to clipboard
| Challenge: | Existing methods for domain adaptation from multiple sources are designed to transfer supervision from a single source domain. |
| Approach: | They propose to capture the relationship between a target example and different source domains by a point-to-set metric. |
| Outcome: | The proposed method outperforms baselines and can handle negative transfer. |