Papers by Shuning Jin
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling (P19-1)
Copied to clipboard
Alex Wang, Jan Hula, Patrick Xia, Raghavendra Pappagari, R. Thomas McCoy, Roma Patel, Najoung Kim, Ian Tenney, Yinghui Huang, Katherin Yu, Shuning Jin, Berlin Chen, Benjamin Van Durme, Edouard Grave, Ellie Pavlick, Samuel R. Bowman
| Challenge: | State-of-the-art models in natural language processing (NLP) often incorporate sentence encoder functions which generate a sequence of vectors intended to represent the in-context meaning of each word in an input text. |
| Approach: | They conduct the first large-scale systematic study of candidate pretraining tasks, comparing 19 different tasks as alternatives and complements to language modeling. |
| Outcome: | The proposed model can be used to train sentences on language modeling tasks. |
Discrete Latent Variable Representations for Low-Resource Text Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Several approaches to learning discrete latent variable models for text are available. |
| Approach: | They compare several approaches to learning discrete latent variable models for text in the case where exact marginalization over these variables is intractable. |
| Outcome: | The learned models outperform the previous best models in low-resource settings while learning significantly more compressed representations. |