CASE: Efficient Curricular Data Pre-training for Building Assistive Psychology Expert Models (2024.findings-emnlp)
Copied to clipboard
Sarthak Harne, Monjoy Choudhury, Madhav Rao, T Srikanth, Seema Mehrotra, Apoorva Vashisht, Aarushi Basu, Manjit Sodhi
| Challenge: | Existing methods to identify mental health disorders rely on limited availability of psychologists. |
| Approach: | They propose to use forum posts to analyze text data to identify mental health issues . they propose to utilize readily available curricular texts for pre-training pipelines . |
| Outcome: | The proposed pipelines achieve an f1 score of 0.91 for Depression and 0.88 for Anxiety compared to existing pipelines. |
Similar Papers
MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing pretrained language models for mental health detection are inadequate . one in four people worldwide suffers from mental disorders . |
| Approach: | They train and release two pretrained masked language models to benefit machine learning for mental healthcare research . they demonstrate that language representations pretrained in the target domain improve the performance of mental health detection tasks. |
| Outcome: | The proposed models improve mental health detection tasks on several benchmarks and are available for free. |
MentalHelp: A Multi-Task Dataset for Mental Health in Social Media (2024.lrec-main)
Copied to clipboard
Nishat Raihan, Sadiya Sayara Chowdhury Puspo, Shafkat Farabi, Ana-Maria Bucur, Tharindu Ranasinghe, Marcos Zampieri
| Challenge: | Annotating social media data for mental health disorders is expensive and time-consuming, limiting their size and scope. |
| Approach: | They present a large-scale semi-supervised mental disorder detection dataset containing 14 million instances from Reddit and an ensemble of three separate models. |
| Outcome: | The proposed dataset contains 14 million instances of mental disorders . it was collected from reddit and labeled in a semi-supervised way . |
Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for language analysis are inadequate for specialized domains like psychology. |
| Approach: | They have enriched a Chinese social media database with psychological lexicons to enhance its applicability to psychological text analysis. |
| Outcome: | The proposed model performed better on six public datasets and provided relevant predictions given the masked sentences. |
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that domain-specific BERT models can be improved when in-domain data is used for pretraining. |
| Approach: | They propose to use Twitter and forum text as pretraining sources for two BERT models and use similarity measures to nominate in-domain data for pretraining. |
| Outcome: | The proposed method can be used to improve performance on downstream tasks by using in-domain data. |
SMHD-GER: A Large-Scale Benchmark Dataset for Automatic Mental Health Detection from Social Media in German (2023.findings-eacl)
Copied to clipboard
| Challenge: | Mental health problems are a challenge to our modern society, and their prevalence is predicted to increase worldwide. |
| Approach: | They propose a large-scale, carefully constructed dataset for MHC detection built on high-precision patterns and the approach proposed for English. |
| Outcome: | The proposed model leverages engineered (psycho-)linguistic features as well as BERT-German to facilitate further research and conduct extensive experiments. |
DeepWell-Adol: A Scalable Expert-Based Dialogue Corpus for Adolescent Positive Mental Health and Wellbeing Promotion (2025.emnlp-main)
Copied to clipboard
| Challenge: | Promoting positive mental health and well-being is a critical yet underexplored area in natural language processing. |
| Approach: | They propose a Chinese dialogue corpus grounded in positive psychology and coaching that integrates human expert-written seed data with automated data augmentation to ensure high quality and scalability. |
| Outcome: | The proposed corpus meets general standards for psychological dialogue and emotional support while also showing superior performance across multiple models in promoting positive psychological processes, character strengths, interpersonal relationships, and healthy behaviors. |
Classifying Social Media Users before and after Depression Diagnosis via Their Language Usage: A Dataset and Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Mental illness can negatively impact individuals’ quality of life as it is considered one of the causes of years lived with disability and it is related to high suicide rates. |
| Approach: | They collect first dataset of textual posts by same users before and after being diagnosed with depression and build multiple predictive models based on Transformers and BERT. |
| Outcome: | The proposed model can be used to detect depression and suicidal thoughts in users who are not diagnosed with depression or suicide. |
INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models (2023.findings-emnlp)
Copied to clipboard
H S V N S Kowndinya Renduchintala, Krishnateja Killamsetty, Sumit Bhatia, Milan Aggarwal, Ganesh Ramakrishnan, Rishabh Iyer, Balaji Krishnamurthy
| Challenge: | Pre-trained language models have a remarkable improvement in generalization capability . however, this leads to prohibitively long training times and a detrimental environmental impact . |
| Approach: | They propose to use submodular optimization to select highly informative subsets of training data to train multiple PTLMs using only fractions of data. |
| Outcome: | The proposed framework achieves 99% of the performance of fully-trained models using only fraction of training data. |
MentalRiskES: A New Corpus for Early Detection of Mental Disorders in Spanish (2024.lrec-main)
Copied to clipboard
Alba M. Mármol Romero, Adrián Moreno Muñoz, Flor Miriam Plaza-del-Arco, M. Dolores Molina González, María Teresa Martín Valdivia, L. Alfonso Ureña-López, Arturo Montejo Ráez
| Challenge: | Existing studies on the prevalence of mental disorders on the Web are limited to the English language. |
| Approach: | They propose to use user messages posted on Telegram groups to annotate the corpus for natural language processing and to conduct experiments on text classification and regression. |
| Outcome: | The proposed corpus contains over 1,300 subjects with more than 45,000 messages posted in different public Telegram groups. |
SMHD: a Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditions (C18-1)
Copied to clipboard
| Challenge: | Existing methods to label mental health conditions are based on high-precision diagnosis patterns and carefully selected control users. |
| Approach: | They propose to use high-precision diagnosis patterns to identify self-reported diagnoses of nine different mental health conditions and obtain high-quality labeled data without manual labelling. |
| Outcome: | The proposed dataset is two orders of magnitude larger than the largest published similar resource. |