Similarity Measures for the Detection of Clinical Conditions with Verbal Fluency Tasks (N18-2)
Copied to clipboard
| Challenge: | Semantic Verbal Fluency tests have been used in the diagnosis of certain clinical conditions, like Dementia. |
| Approach: | They investigate three similarity measures for automatically identifying switches in semantic chains: semantic similarity from a manually constructed resource, word association strength and semantic relatedness, both calculated from corpora. |
| Outcome: | The proposed classifiers outperform those that use a gold standard taxonomy for clinical conditions. |
Similar Papers
Mapping semantic networks to Dutch word embeddings as a diagnostic tool for cognitive decline (2025.emnlp-main)
Copied to clipboard
| Challenge: | Semantic networks are abstract representations of the semantic memory system and can be used to estimate networks . |
| Approach: | They used Dutch verbal fluency data to explore the relationship between semantic networks and cognitive health. |
| Outcome: | The proposed measures predict cognitive health scores on the Mini-Mental State Examination (MMSE) while the traditional number-of-words measure was not significant, the results suggest that semantic network metrics may provide a more sensitive measure of cognitive health than traditional scoring. |
Exploring Semantic Spaces for Detecting Clustering and Switching in Verbal Fluency (2022.coling-1)
Copied to clipboard
| Challenge: | Existing evaluations of word/concept representations on verbal fluency tasks rely on human annotations of clusters and switches between sub-categories. |
| Approach: | They analyze word/concept representations in an experimental verbal fluency dataset . they find that ConceptNet embeddings outperforms other semantic representations . |
| Outcome: | The proposed method outperforms other semantic representations by a large margin. |
SemR-11: A Multi-Lingual Gold-Standard for Semantic Similarity and Relatedness for Eleven Languages (L18-1)
Copied to clipboard
| Challenge: | SemR-11 is a multi-lingual dataset for evaluating semantic similarity and relatedness for 11 languages. |
| Approach: | This paper describes a multi-lingual dataset for evaluating semantic similarity and relatedness for 11 languages. |
| Outcome: | The dataset is a multi-lingual dataset for evaluating semantic similarity and relatedness for 11 languages. |
Writing habits and telltale neighbors: analyzing clinical concept usage patterns with sublanguage embeddings (D19-62)
Copied to clipboard
| Challenge: | Existing biomedical concepts may have multiple, often non-compositional surface forms, making them difficult to analyze using lexical occurrence alone. |
| Approach: | They propose a method for characterizing usage patterns of clinical concepts among different document types by embedding concepts on clinical documents of different types and measuring their nearest neighborhood structures. |
| Outcome: | Experiments on the MIMIC-III corpus show that the proposed method captures clinically relevant differences in concept usage while correcting for noise in embedding learning. |
Similarity Analysis of Contextual Word Representation Models (2020.acl-main)
Copied to clipboard
| Challenge: | Existing and novel similarity measures are used to analyze contextual word representations . different architectures have rather similar representations, but different individual neurons. |
| Approach: | They propose a method to analyze contextual word representation models using similarity analysis. |
| Outcome: | The proposed approach can be used to analyze model similarity without external annotations. |
Towards Explainable Evaluation of Language Models on the Semantic Similarity of Visual Concepts (2022.coling-1)
Copied to clipboard
Maria Lymperaiou, George Manoliadis, Orfeas Menis Mastromichalakis, Edmund G. Dervakos, Giorgos Stamou
| Challenge: | Recent advances in NLP research have focused on robustness and explainability issues of their evaluation strategies. |
| Approach: | They propose to use pre-trained transformers to evaluate semantic similarity for visual vocabularies . they propose to provide explainable metrics for understanding the quality of retrieved instances . |
| Outcome: | The proposed metrics highlight inabilities of widely used evaluation methods and highlight weaknesses in learned linguistic representations. |
TextEssence: A Tool for Interactive Analysis of Semantic Shifts Between Corpora (2021.naacl-demos)
Copied to clipboard
| Challenge: | Existing studies using distributional embeddings to study language use have focused on quantitative measurement of change, rather than inter-corpus analysis. |
| Approach: | They propose a system that allows comparative analysis of corpora using embeddings. |
| Outcome: | The proposed system can be used for categorical and comparative analysis of text corpora. |
When Shallow is Good Enough: Automatic Assessment of Conceptual Text Complexity using Shallow Semantic Features (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to automatic assessment of text complexity focus on syntactic and lexical complexity. |
| Approach: | They propose to use graph-based deep semantic features to automatically assess conceptual text complexity by using DBpedia as a proxy to human knowledge. |
| Outcome: | The proposed features outperform the state-of-the-art features on pairwise comparison of two versions of the same text and five-level classification task. |
Rethinking Word Similarity: Semantic Similarity through Classification Confusion (2025.naacl-long)
Copied to clipboard
| Challenge: | Word similarity measures cannot capture context-dependent, asymmetrical, polysemous nature of semantic similarity. |
| Approach: | They propose a new measure of similarity that reframes semantic similarity in terms of feature-based classification confusion. |
| Outcome: | The proposed model is comparable to cosine similarity in matching human similarity judgments across several datasets and can measure similarity using predetermined features of interest. |
Exploring Semantic Capacity of Terms (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that measure semantic capacity of terms are not all considered equal . a good command of semantic capacity will give us more insight into the granularity of terms . |
| Approach: | They propose a model that evaluates semantic capacity of terms if text corpus can provide enough co-occurrence information of terms. |
| Outcome: | The proposed model can evaluate semantic capacity of terms if the corpus can provide enough co-occurrence information of terms. |