Papers with StructAdapt
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent approaches to text generation from Abstract Meaning Representation (AMR) have been based on neural-centered encoderdecoder architectures. |
| Approach: | They propose a structure-aware adapter which injects the input graph connectivity within PLMs using Graph Neural Networks. |
| Outcome: | The proposed adapter is robust to a variety of approaches and can be used to generate Graph-to-Text representations. |
Structural Adapters in Pretrained Language Models for AMR-to-Text Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models (PLMs) have advanced graph-to-text generation, but efficient encoding of graph structure is challenging because of the nature of the data. |
| Approach: | They propose a method to encode graph structure into pretrained language models by training only graph structure-aware adapter parameters. |
| Outcome: | The proposed method outperforms the state-of-the-art on two AMR-to-text datasets, training only 5.1% of the adapter parameters. |