Papers by Jason Krone
Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on robustness of pretrained multilingual models are limited to the English language. |
| Approach: | They propose to use data augmentation and contrastive loss term to boost robustness of multilingual models in cross-lingual settings. |
| Outcome: | The proposed model outperforms existing models on clean and noisy data in the cross-lingual setting. |
Multi-Domain Goal-Oriented Dialogues (MultiDoGO): Strategies toward Curating and Annotating Large Scale Dialogue Data (D19-1)
Copied to clipboard
| Challenge: | a large number of goal-oriented dialogue datasets are limited in their size, linguistic diversity, domain coverage, or annotation granularity. |
| Approach: | They propose a multi-domain goal-oriented dialogue dataset that uses a crowd-sourced worker and a trained annotator to curate and annotate large scale data. |
| Outcome: | The proposed dataset is 8 times the size of the largest comparable dialogue dataset available to the public. |
Augmented Natural Language for Generative Sequence Labeling (2020.emnlp-main)
Copied to clipboard
| Challenge: | generative framework for joint sequence labeling and sentence-level classification is general purpose, performing well on few-shot learning, low resource, and high resource tasks. |
| Approach: | They propose a generative framework for joint sequence labeling and sentence-level classification . their framework incorporates label semantics and shares knowledge across tasks . |
| Outcome: | The proposed model performs on few-shot learning, slot labeling, and intent classification benchmarks. |
Label Semantic Aware Pre-training for Few-shot Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for text classification use label semantics but few studies have attempted to give models access to informative representations of labels. |
| Approach: | They propose to use label semantics to train generative models by performing secondary pre-training on labeled sentences from a variety of domains. |
| Outcome: | The proposed approach improves generalization and data efficiency of text classification systems while maintaining comparable performance to state-of-the-art models. |