Papers with f1-score
Concreteness vs. Abstractness: A Selectional Preference Perspective (2022.aacl-srw)
Copied to clipboard
| Challenge: | Using a collection of 5,438 nouns and 1,275 verbs, we exploit selectional preferences as a salient characteristic in classifying abstract vs. concrete words. |
| Approach: | They propose to use selectional preferences as a criterion to distinguish between concrete and abstract concepts and words. |
| Outcome: | The proposed method achieves an f1-score of 0.84 for nouns and 0.71 for verbs in classification and Spearman’s correlation of 0.86 for nonoms and 0.59% for verb. |
Data Augmentation by Data Noising for Open-vocabulary Slots in Spoken Language Understanding (N19-3)
Copied to clipboard
| Challenge: | Neural networks are used to understand spoken language understanding (SLU) but it is difficult to recognize the slots of unknown words or ‘open-vocabulary’ slots because of the high cost of creating a manually tagged SLU dataset. |
| Approach: | They propose to use a recurrent neural network to nois slots for data augmentation by using an attention-based bi-directional recurrence neural network. |
| Outcome: | The proposed method achieves performance improvements of up to 0.57% and 3.25 in intent prediction (accuracy) and slot filling (f1-score) and 0.53% accuracy. |
Exploring BERT-Based Classification Models for Detecting Phobia Subtypes: A Novel Tweet Dataset and Comparative Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Phobias are characterized by an intense and irrational fear of specific objects, situations, or activities despite there being no real risk or only a minor threat involved. |
| Approach: | They propose to use a dataset of 811,569 English tweets from user timelines spanning 102 phobia subtypes over six months to classify users into 65 specific phobias. |
| Outcome: | The proposed dataset includes 47,614 self-diagnosed phobia users and a high f1 score for binary classification and multi-class classification. |