GPT-D: Inducing Dementia-related Linguistic Anomalies by Deliberate Degradation of Artificial Neural Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large numbers of model parameters have shown impressive performance on the task of discriminating between language produced by cognitively healthy individuals and those with Alzheimer’s disease (AD). |
| Approach: | They propose to use a Transformer DL model pre-trained on general English text to combine an artificially degraded version of itself with a model that generalizes well to spontaneous conversations. |
| Outcome: | The proposed method generalizes well to spontaneous conversations and generates text with characteristics associated with AD, demonstrating the induction of dementia-related linguistic anomalies. |
Similar Papers
Too Big to Fail: Larger Language Models are Disproportionately Resilient to Induction of Dementia-Related Linguistic Anomalies (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that the attention mechanism in transformer-based NLMs may present an analogue to the notions of cognitive and brain reserve. |
| Approach: | They propose a bidirectional ablation method that masks attention heads to display degradation of similar magnitude to masking in smaller models. |
| Outcome: | The proposed method exhibits properties attributed to the concepts of cognitive and brain reserve in human brain studies. |
Enriching Neural Models with Targeted Features for Dementia Detection (P19-2)
Copied to clipboard
| Challenge: | In the United States, adults over 65 are expected to comprise one-fifth of the population by 2030, and a larger proportion of the . population than those under 18 by 2035. |
| Approach: | They propose a neural model that takes into account both long language samples and hand-crafted linguistic features to distinguish between dementia affected and healthy patients. |
| Outcome: | The proposed model achieves an F1 score of 0.929 on the DementiaBank dataset and the state-of-the-art on the dataset. |
A Tale of Two Perplexities: Sensitivity of Neural Language Models to Lexical Retrieval Deficits in Dementia of the Alzheimer’s Type (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies show that cognitive manifestations of future dementia may appear as early as 18 years prior to clinical diagnosis . lack of clear diagnosis and prognosis, possibly for an Alzheimer's type, is a major limitation of current methods for identifying dementia-specific cognitive markers. |
| Approach: | They propose to interrogate neural LMs trained on participants with and without dementia by manipulating lexical frequency. |
| Outcome: | The proposed model improves upon the current state-of-the-art for models trained on transcripts of speech produced by healthy participants and those with dementia. |
Detecting Linguistic Characteristics of Alzheimer’s Dementia by Interpreting Neural Models (N18-2)
Copied to clipboard
| Challenge: | Current diagnoses often involve lengthy medical evaluations. |
| Approach: | They apply neural models based on CNNs, LSTM-RNNs, and their combination to classify AD and control language samples. |
| Outcome: | The proposed model achieves independent benchmark accuracy for the AD classification task. |
Linguistic Features Extracted by GPT-4 Improve Alzheimer’s Disease Detection based on Spontaneous Speech (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have enabled powerful new possibilities for semantic text analysis. |
| Approach: | They leverage GPT-4 to extract five semantic features from transcripts of spontaneous patient speech. |
| Outcome: | The proposed model significantly improves detection of AD in manually transcribed and automatically generated transcripts. |
CDA: A Contrastive Data Augmentation Method for Alzheimer’s Disease Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting AD are challenging and time-consuming due to lack of data and generalizability of the models. |
| Approach: | They propose a contrastive data augmentation method which simulates the cognitive impairment of a patient by randomly deleting a proportion of text from the transcript to create negative samples. |
| Outcome: | The proposed method achieves the best performance among language-based models on the benchmark ADReSS Challenge dataset. |
LoSST-AD: A Longitudinal Corpus for Tracking Alzheimer’s Disease Related Changes in Spontaneous Speech (2024.lrec-main)
Copied to clipboard
| Challenge: | Language-based biomarkers have shown promising results in differentiating those with Alzheimer’s disease (AD) diagnosis from healthy individuals, but the earliest changes in language are thought to start years or even decades before the diagnosis. |
| Approach: | They propose to use transcripts of public interviews with 20 famous figures to track language change over several decades to validate their corpus. |
| Outcome: | The proposed corpus can provide a valuable starting point for the development of early detection tools and enhance our understanding of how AD affects language over time. |
Transforming Brainwaves into Language: EEG Microstates Meet Text Embedding Models for Dementia Detection (2025.acl-srw)
Copied to clipboard
| Challenge: | Dementia is recognised as the seventh leading cause of mortality globally and plays a major role in increasing disability and dependence among older adults. |
| Approach: | They propose to represent electroencephalography microstates as symbolic, language-like sequences and use text embedding and time-series deep learning models for classification. |
| Outcome: | The proposed method achieves a high accuracy of 94.31% on 1001 EEG data from multiple countries and eliminates fixed configurations and costly/invasive modalities. |
Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia. (2023.emnlp-main)
Copied to clipboard
| Challenge: | Dementia is associated with language disorders which impede communication. |
| Approach: | They propose to use a pre-trained language model to automatically learn linguistic disorder patterns by forcing it to focus on reformulated natural language processing (NLP) tasks and associated linguistic patterns. |
| Outcome: | The proposed communication marker outperforms existing linguistic approaches and shows external validity via significant correlation with clinical markers of behaviour. |
Mitigating Confounding in Speech-Based Dementia Detection through Weight Masking (2025.acl-long)
Copied to clipboard
| Challenge: | Pre-trained neural language models fine-tuned on AD transcripts perform well, but little research has explored the effects of the gender of the speakers represented by these transcripts. |
| Approach: | They propose to use the Extended Confounding Filter and the Dual Filter to isolate and ablate weights associated with gender in dementia datasets. |
| Outcome: | The proposed methods overfit to training data distributions and disrupt gender-related weights, with the trade-off of slightly reduced dementia detection performance. |