Papers by Iftitahu Nimah
ProtoInfoMax: Prototypical Networks with Mutual Information Maximization for Out-of-Domain Detection (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to detect out-of-domain (OOD) inputs are limited and lack data. |
| Approach: | They propose a new architecture that extends Prototypical Networks to process in-domain and OOD sentences via Mutual Information Maximization objective. |
| Outcome: | The proposed method significantly improves performance up to 20% for OOD detection in low resource settings of text classification. |
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist (2023.acl-long)
Copied to clipboard
| Challenge: | a systematic review of automatic evaluation metrics for Natural Language Generation (NLG) shows that task-agnostic metrics have a weak correlation with human . |
| Approach: | They propose a framework to assess the effectiveness of automatic metrics in three NLG tasks . they propose task-agnostic and human-aligned metrics to be used for evaluation . |
| Outcome: | The proposed framework provides access to the evaluation tools for three NLG tasks. |