Papers by Vera Gor
Discourse-Aware Soft Prompting for Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in pre-trained langauge models (PLMs) have made great impact on text generation research. |
| Approach: | They propose to use hierarchical blocking to simulate a higher-level discourse structure of human written text and attention sparsity to learn sparse transformations on the softmax-function. |
| Outcome: | The proposed methods perform better on some generation tasks but don't generalize across all generation tasks. |