CoLoSS: Cognitive Load Corpus with Speech and Performance Data from a Symbol-Digit Dual-Task (L18-1)
Copied to clipboard
| Challenge: | Existing corpus of speech recordings under cognitive load is available for research purposes . |
| Approach: | They propose to use a corpus of speech under cognitive load recorded in a learning task scenario to obtain a reference for cognitive load. |
| Outcome: | The proposed corpus is available to the scientific community for use in cognitive load-based cognitive load recognition. |
Similar Papers
ART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation (2024.lrec-main)
Copied to clipboard
Zheng Byron Yuan, Dorina de Jong, Ruitao Feng, Štefan Beňuš, Noël Nguyen, Róbert Sabo, Luciano Fadiga, Alessandro D’Ausilio
| Challenge: | The Alternating Reading Task (ART) Corpus is a collection of dyadic sentence readings for studying the entrainment and imitation behaviour in speech communication. |
| Approach: | They propose to use dyadic sentence reading to study entrainment and imitation in speech communication. |
| Outcome: | The proposed study includes three conditions and three subcorpora encompassing French-, Italian-, and Slovak-accented English. |
Benchmarking Contextual and Paralinguistic Reasoning in Speech-LLMs: A Case Study with In-the-Wild Data (2025.findings-emnlp)
Copied to clipboard
Qiongqiong Wang, Hardik Bhupendra Sailor, Tianchi Liu, Wenyu Zhang, Muhammad Huzaifah, Nattadaporn Lertcheva, Shuo Sun, Nancy F. Chen, Jinyang Wu, AiTi Aw
| Challenge: | Recent speech-LLMs have shown impressive performance in tasks like transcription and translation, yet they remain limited in understanding the paralinguistic aspects of speech crucial for social and emotional intelligence. |
| Approach: | They propose a benchmark for evaluating speech-LLMs on contextual paralinguistic reasoning . the benchmark includes curated question answering datasets requiring both linguistic and empathetic understanding . |
| Outcome: | The proposed benchmark reveals a key gap in existing evaluations and offers insights into building more context-aware and emotionally intelligent LLMs. |
Compilation of Corpora for the Study of the Information Structure–Prosody Interface (L18-1)
Copied to clipboard
| Challenge: | empirical studies on the Information Structure-prosody interface are scarce . thematicity defines how content is packaged in terms of "what is being talked about" a different view on thematicality is advocated by I. Mel'uk in the context of the MTT. |
| Approach: | They propose a method for the compilation of annotated corpora to study the correspondence between Information Structure and prosody. |
| Outcome: | The proposed method is applied to a corpus of read speech in English annotated with hierarchical thematicity and automatically extracted prosodic parameters. |
Growing Trees on Sounds: Assessing Strategies for End-to-End Dependency Parsing of Speech (2024.acl-short)
Copied to clipboard
| Challenge: | Direct dependency parsing of the speech signal is proposed as a way of incorporating prosodic information into the parser and bypassing the limitations of a pipeline approach. |
| Approach: | They propose to use graph-based parsing and sequence labeling based parses to integrate prosodic information into the parser and bypass limitations of pipeline approaches. |
| Outcome: | The proposed graph based approach outperforms a pipeline approach on a large treebank of spoken french, despite having 30% fewer parameters. |
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties (P18-1)
Copied to clipboard
| Challenge: | a lack of understanding of the properties of sentence embeddings is limiting the use of the techniques. |
| Approach: | They propose 10 probing tasks designed to capture simple linguistic features of sentences . they use three different encoders to train embeddings in eight different ways . |
| Outcome: | The proposed tasks capture key linguistic features of sentences, but they are difficult to infer from them. |
Generalizable Cross-Lingual Cognitive Distortion Detection with Standardized Annotations and Multi-Task Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on cognitive distortion have limited generalizability and performance of models in large-scale and cross-linguistic contexts. |
| Approach: | They propose a multi-task learning model based on teacher student architecture solution which improves generalization performance. |
| Outcome: | The proposed model improves generalizability and interpretability of the proposed model. |
CDT: A Comprehensive Capability Framework for Large Language Models Across Cognition, Domain, and Task (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks focus on isolated abilities, lacking a holistic framework for assessing LLM capabilities. |
| Approach: | They propose a Cognition-Domain-Task framework which measures a model’s capabilities across three dimensions. |
| Outcome: | The proposed framework improves performance on dataset evaluation and data selection, while achieving higher scores on general and specific benchmarks. |
Dynamic Task-Oriented Dialogue: A Comparative Study of Llama-2 and Bert in Slot Value Generation (2024.eacl-srw)
Copied to clipboard
| Challenge: | Recent advances in instruction-based language models have demonstrated exceptional performance across various natural language processing tasks. |
| Approach: | They propose to use BERT and Llama-2 to generate dynamic task-oriented dialogues using a multi-dimensional dataset. |
| Outcome: | The proposed models generate predictions for masked slot values within text and are reproducible in open-source environments. |
Quantifying the redundancy between prosody and text (2023.emnlp-main)
Copied to clipboard
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan Wilcox, Tamar Regev
| Challenge: | Existing studies suggest partial redundancy between prosody and linguistic information. |
| Approach: | They use large language models to estimate how much information is redundant between prosody and the words themselves. |
| Outcome: | The proposed model can predict prosodic features across prosodic features, including intensity, duration, pauses, and pitch contours. |
SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks (2023.acl-long)
Copied to clipboard
Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
| Challenge: | Spoken language understanding (SLU) tasks have received little attention and resources compared to lower-level tasks like speech and speaker recognition. |
| Approach: | They propose annotated SLU benchmark tasks based on freely available speech data to complement existing benchmarks and address gaps in the evaluation landscape. |
| Outcome: | The proposed benchmarks complement existing benchmarks and address gaps in the evaluation landscape. |