Papers with Liang
Controllable Natural Language Generation with Contrastive Prefixes (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing work on controllable natural language generation has focused on fine-tuning existing models or using attribute discriminators. |
| Approach: | They propose a lightweight framework for controllable GPT2 generation that utilizes attribute-specific vectors to steer natural language generation. |
| Outcome: | The proposed framework can guide generation towards desired attributes while keeping high linguistic quality. |
An information theoretic view on selecting linguistic probes (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in NLP tasks require a question of how much linguistic knowledge is encoded in neural networks. |
| Approach: | They propose to use diagnostic classifiers to perform supervised classification from internal representations. |
| Outcome: | Empirically, the two proposed criteria lead to results that agree with each other. |