Papers with reminder
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog (N19-1)
Copied to clipboard
| Challenge: | a lack of multilingual training data has hindered development of conversational AI models for task-oriented tasks . a new data set of 57k annotated utterances in english, spanish, and Thai is used to evaluate cross-lingual methods . |
| Approach: | They present a data set of 57k annotated utterances in English, Spanish and Thai . they evaluate three different cross-lingual transfer methods to identify user intents and slots . |
| Outcome: | The proposed model outperforms existing methods in English, Spanish and Thai . the proposed model is based on training data from three languages . |
Don’t Go To Extremes: Revealing the Excessive Sensitivity and Calibration Limitations of LLMs in Implicit Hate Speech Detection (2024.acl-long)
Copied to clipboard
| Challenge: | Several studies have examined whether large language models exhibit bias or discrimination against individuals or groups in terms of protected attributes like race, gender, or religion. |
| Approach: | They evaluate LLMs' ability to detect implicit hate speech and express confidence in their responses by considering prompt patterns and mainstream uncertainty estimation methods. |
| Outcome: | The proposed models exhibit two extremes: (1) excessive sensitivity towards groups or topics that may cause fairness issues, resulting in misclassifying benign statements as hate speech; (2) confidence scores for each method excessively concentrate on a fixed range, remaining unchanged regardless of the dataset’s complexity. |