Towards Domain-Agnostic and Domain-Adaptive Dementia Detection from Spoken Language (2023.acl-long)
Copied to clipboard
| Challenge: | Domain adaptation (DA) techniques have been used to improve performance of NLP systems for healthcare tasks due to numerous complexities of data. |
| Approach: | They propose to use domain adaptation techniques to improve generalizability across diverse datasets for dementia detection. |
| Outcome: | The proposed model achieves a 22% increase in accuracy adapting from a conversational to task-oriented dataset compared to a jointly trained baseline. |
Similar Papers
Multilingual prediction of Alzheimer’s disease through domain adaptation and concept-based language modelling (N19-1)
Copied to clipboard
Kathleen C. Fraser, Nicklas Linz, Bai Li, Kristina Lundholm Fors, Frank Rudzicz, Alexandra König, Jan Alexandersson, Philippe Robert, Dimitrios Kokkinakis
| Challenge: | Existing work on speech and language models has been limited by the size of available datasets. |
| Approach: | They propose to augment a small French dataset with a much larger English dataset to augment the language model to model the order in which information units are produced by dementia patients and controls. |
| Outcome: | The proposed model improves classification performance in English and French separately. |
Domain Adaptation via Prompt Learning for Alzheimer’s Detection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to fine-tune pre-trained language models for AD detection are limited by the small and disparate corpora of spoken language. |
| Approach: | They propose to use domain-adaptive prompt fine-tuning to optimize for AD detection by using AD classification loss as the training objective and spoken language corpora from a variety of language tasks. |
| Outcome: | The proposed approach achieves the highest detection rate with the highest-performing prompting paradigm and the domain-adaptive prompt fine-tuning paradigm. |
Augmenting word2vec with latent Dirichlet allocation within a clinical application (N19-1)
Copied to clipboard
| Challenge: | Existing models that combine latent Dirichlet allocation and word embedding for distinguishing between speakers with and without Alzheimer’s disease from transcripts of picture descriptions are not suitable for clinical binary text classification tasks. |
| Approach: | They propose three models that combine latent Dirichlet allocation and word embedding for distinguishing between speakers with and without Alzheimer’s disease from transcripts of picture descriptions. |
| Outcome: | The proposed models outperform word2vec and LDA models on a clinical binary text classification task. |
Locale-agnostic Universal Domain Classification Model in Spoken Language Understanding (N19-2)
Copied to clipboard
| Challenge: | Existing approaches to leveraging data across locales to improve domain classification accuracy are ineffective. |
| Approach: | They propose a locale-agnostic universal domain classification model that leverages available data across locales sharing the same language to improve domain classification accuracy. |
| Outcome: | The proposed model outperforms baseline models especially when classifying locale-specific domains and low-resourced domains. |
Detecting dementia in Mandarin Chinese using transfer learning from a parallel corpus (N19-1)
Copied to clipboard
| Challenge: | Existing methods for automatic detection of Alzheimer's disease (AD) are limited by a lack of data. |
| Approach: | They propose a method to learn a correspondence between independently engineered lexicosyntactic features in two languages, using a large parallel corpus of out-of-domain movie dialogue data. |
| Outcome: | The proposed method outperforms both unilingual and machine translation-based baselines in Mandarin Chinese and is the first to transfer feature domains in detecting cognitive decline. |
Adapting Event Extractors to Medical Data: Bridging the Covariate Shift (2021.eacl-main)
Copied to clipboard
| Challenge: | a new study examines the performance of event extractors to new domains without labeled data . event extraction is a key sub-task of interest for text understanding pipelines in multiple domains . |
| Approach: | They propose to align marginal distributions of source and target domains to adapt event extractors to new domains . they use clinical notes and doctor-patient conversations as a testbed . |
| Outcome: | The proposed models reach F1 scores of 70.0 and 72.9 on notes and conversations respectively. |
Unsupervised Domain Adaptation for Event Detection using Domain-specific Adapters (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to ED are limited due to complexity of textual data and domain shift problem. |
| Approach: | They propose to use domain adapter-based Adaptation framework to improve event detection across domains. |
| Outcome: | The proposed framework significantly boosts the performance on target domains. |
Tracing Multilingual Knowledge Acquisition Dynamics in Domain Adaptation: A Case Study of Biomedical Adaptation (2026.eacl-long)
Copied to clipboard
| Challenge: | Multilingual domain adaptation (ML-DA) enables large language models to acquire domain knowledge across languages. |
| Approach: | They propose an adaptive evaluation method that constructs multiple-choice QA datasets from the same bilingual domain corpus used for training. |
| Outcome: | The proposed method constructs multiple-choice QA datasets from the same bilingual domain corpus used for training, thereby enabling direct analysis of multilingual knowledge acquisition. |
Text Classification by Contrastive Learning and Cross-lingual Data Augmentation for Alzheimer’s Disease Detection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for AD detection are too expensive and time-consuming to cover all potential patients. |
| Approach: | They propose a contrastive learning method to obtain effective text representations based on monolingual embeddings of BERT and a cross-lingual data augmentation method by building autoencoders to learn the text representation shared by both languages. |
| Outcome: | The proposed method outperforms other methods on a Mandarin AD corpus and achieves 81.6% detection accuracy. |
Elderly Conversational Speech Corpus with Cognitive Impairment Test and Pilot Dementia Detection Experiment Using Acoustic Characteristics of Speech in Japanese Dialects (2022.lrec-1)
Copied to clipboard
| Challenge: | Several studies have explored using only the acoustic and linguistic information of conversational speech as diagnostic material, with some success. |
| Approach: | They propose to use acoustic features of conversational speech to detect dementia even when dialects are present. |
| Outcome: | The proposed method detects dementia using acoustic features even when dialects are present even when spoken from two regions. |