Papers by Prafull Prakash
Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings (2020.findings-emnlp)
Copied to clipboard
Prafull Prakash, Saurabh Kumar Shashidhar, Wenlong Zhao, Subendhu Rongali, Haidar Khan, Michael Kayser
| Challenge: | Existing task-oriented semantic parsing models use BERT or RoBERTa as pretrained encoders. |
| Approach: | They propose to learn compositional code embeddings to greatly reduce the sizes of BERT and RoBERTa encoders. |
| Outcome: | The proposed model reduces the size of BERT and RoBERTa encoders while maintaining performance. |