Automatic Extraction of Language-Specific Biomarkers of Healthy Aging in Icelandic (2024.lrec-main)
Copied to clipboard
| Challenge: | Multiple studies have shown that individuals suffering from AD exhibit difficulties with word retrieval, produce fewer information units and content words, and use more pronouns than healthy age-matched controls. |
| Approach: | They administered three language tasks to participants aged 60–80 to examine the effects of task type and healthy aging on various automatically extracted part-of-speech features in Icelandic. |
| Outcome: | The results show that task type and healthy aging influence language production in Icelandic. |
Similar Papers
LoSST-AD: A Longitudinal Corpus for Tracking Alzheimer’s Disease Related Changes in Spontaneous Speech (2024.lrec-main)
Copied to clipboard
| Challenge: | Language-based biomarkers have shown promising results in differentiating those with Alzheimer’s disease (AD) diagnosis from healthy individuals, but the earliest changes in language are thought to start years or even decades before the diagnosis. |
| Approach: | They propose to use transcripts of public interviews with 20 famous figures to track language change over several decades to validate their corpus. |
| Outcome: | The proposed corpus can provide a valuable starting point for the development of early detection tools and enhance our understanding of how AD affects language over time. |
Pre-training and Evaluating Transformer-based Language Models for Icelandic (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained models obtain state-of-the-art performance on a wide variety of NLP tasks, including Question Answering (QA), Named Entity Recognition (NER), Part-of Speech (POS) tagging and Automatic Text Summarization (ATS). |
| Approach: | They pre-train four types of monolingual ELECTRA and ConvBERT models and compare them to a previously trained monolingual RoBERTa model and multilingual mBERT model. |
| Outcome: | The models outperform a multilingual model on four downstream tasks. |
Audio-Based Linguistic Feature Extraction for Enhancing Multi-lingual and Low-Resource Text-to-Speech (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to synthesize speech for low-resource languages require a substantial amount of source language corpora to generate the linguistic knowledge that can be reused for speech synthesis. |
| Approach: | They propose a method that extracts linguistic features from audio input while effectively filtering out miscellaneous acoustic information including speaker-specific attributes like timbre. |
| Outcome: | The proposed method extracts linguistic features from audio input while effectively filtering out miscellaneous acoustic information including speaker-specific attributes like timbre. |
Language-specific Effects on Automatic Speech Recognition Errors for World Englishes (2022.coling-1)
Copied to clipboard
| Challenge: | Existing systems are not able to meet the needs of speakers of different demographic groups. |
| Approach: | They propose to analyze the performance of Otter’s automatic captioning system on native and non-native English speakers of different language background through a linguistic analysis of segment-level errors. |
| Outcome: | The proposed system predicts certain errors from the phonological structure of a speaker’s native language. |
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties (P18-1)
Copied to clipboard
| Challenge: | a lack of understanding of the properties of sentence embeddings is limiting the use of the techniques. |
| Approach: | They propose 10 probing tasks designed to capture simple linguistic features of sentences . they use three different encoders to train embeddings in eight different ways . |
| Outcome: | The proposed tasks capture key linguistic features of sentences, but they are difficult to infer from them. |
The Automatic Extraction of Linguistic Biomarkers as a Viable Solution for the Early Diagnosis of Mental Disorders (2022.lrec-1)
Copied to clipboard
| Challenge: | Digital Linguistic Biomarkers extracted from spontaneous language productions proved to be very useful for the early detection of various mental disorders. |
| Approach: | They propose a computational pipeline for the automatic extraction of DLBs from speech samples and written texts. |
| Outcome: | The proposed pipeline is designed to extract DLBs from speech samples and written texts. |
A Warm Start and a Clean Crawled Corpus - A Recipe for Good Language Models (2022.lrec-1)
Copied to clipboard
Vésteinn Snæbjarnarson, Haukur Barri Símonarson, Pétur Orri Ragnarsson, Svanhvít Lilja Ingólfsdóttir, Haukur Jónsson, Vilhjalmur Thorsteinsson, Hafsteinn Einarsson
| Challenge: | Pre-trained neural language models have shown impressive results when adapted for a variety of classification and text generation tasks. |
| Approach: | They propose to use Icelandic's Icelandic Common Crawl Corpus to train language models that achieve state-of-the-art performance in downstream tasks. |
| Outcome: | The proposed models achieve state-of-the-art in a variety of downstream tasks including part-of speech tagging, named entity recognition and constituency parsing. |
Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Neural relation extraction models capture linguistic and semantic properties of the input, a recent study shows. |
| Approach: | They introduce 14 probing tasks targeting linguistic properties relevant to RE . they add contextualized word representations to enhance probing performance . |
| Outcome: | The proposed models achieve state-of-the-art on two datasets, TACRED and SemEval 2010 Task 8 . they show that the models capture linguistic and semantic properties relevant to the downstream task . |
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture (D19-57)
Copied to clipboard
| Challenge: | Using a pre-trained BERT-Base model, we learn domain-specific language representations using biomedical text. |
| Approach: | They propose a system that extends BERT, a state-of-the-art language model, which learns contextual language representations from a large unlabelled corpus. |
| Outcome: | The proposed model outperforms a baseline model while relying on an extremely simple setup with no specially engineered features. |
Discriminating Form and Meaning in Multilingual Models with Minimal-Pair ABX Tasks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that multilingual models encode languagespecific information and language-agnostic features, but the nature and interaction of these representations is not fully understood. |
| Approach: | They propose a set of training-free ABX-style discrimination tasks to evaluate how multilingual language models represent language identity (form) and semantic content (meaning). |
| Outcome: | The proposed tasks show that language discrimination declines over training and strengthens over time and stabilizes in deeper layers. |