Papers by Kevin Cohen
Learning Personalized Alignment for Evaluating Open-ended Text Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences. |
| Approach: | They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring. |
| Outcome: | The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers. |
Reviewing Natural Language Processing Research (2021.eacl-tutorials)
Copied to clipboard
| Challenge: | a tutorial on reviewing is a useful tool for researchers who are new to the field of NLP. |
| Approach: | this tutorial provides an opportunity to learn the basics of reviewing . more experienced researchers might find this tutorial interesting to revise their reviewing procedure. |
| Outcome: | This tutorial teaches researchers how to revise their reviewing procedure . |
Improving Classification of Infrequent Cognitive Distortions: Domain-Specific Model vs. Data Augmentation (2022.naacl-srw)
Copied to clipboard
| Challenge: | Cognitive distortions are one of the targets of cognitive behavioral therapy (CBT). |
| Approach: | They propose to use Easy Data Augmentation, back translation, and mixup techniques to detect distortions in text-based therapy messages. |
| Outcome: | The proposed methods improve performance with optimized parameter settings for rare classes with an augmented model, MentalBERT. |
Reviewing Natural Language Processing Research (2020.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial on reviewing research in natural language processing will cover the theory and practice of reviewing research. |
| Approach: | tutorial covers the theory and practice of reviewing research in natural language processing . authors say reviewers should be more aware of "false negatives" |
| Outcome: | tutorial covers the theory and practice of reviewing research in natural language processing . authors say their reviews leave something to be desired . |