Promoting Graph Awareness in Linearized Graph-to-Text Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent applications of pretrained transformers to linearizations of graph inputs yield stateof-the-art results on graph-to-text tasks. |
| Approach: | They propose to use pretrained transformers to encode local graph structures . they find they can improve the quality of models' implicit graph encodings . |
| Outcome: | The proposed models can encode local graph structures and reconstruct corrupted inputs. |
Similar Papers
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation. |
| Approach: | They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model. |
| Outcome: | Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training . |
GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent improvements in KG-to-text generation are due to additional pre-training tasks . these tasks require extensive computational resources while only suggesting marginal improvements. |
| Approach: | They propose a mask structure to capture neighborhood information and a type encoder that adds a bias to the graph-attention weights depending on the connection type. |
| Outcome: | The proposed model outperforms state-of-the-art models while requiring no additional pre-training tasks. |
ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate relevant Knowledge Bases from text and graph data are gaining popularity. |
| Approach: | They propose a bidirectional generation of text and graph leveraging Reinforcement Learning. |
| Outcome: | The proposed system improves on WebNLG+ 2020 and TekGen datasets. |
Bridging the Structural Gap Between Encoding and Decoding for Data-To-Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Current sequence-to-sequence models require serialized input, resulting in loss of structural information. |
| Approach: | They propose a dual encoding model that incorporates the graph structure and caters to the linear structure of the output text. |
| Outcome: | Empirical results show that dual encoding can improve the quality of natural language descriptions. |
Graph Pre-training for AMR Parsing and Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Abstract meaning representation (AMR) highlights the core semantic information of text in a graph structure. |
| Approach: | They propose two graph auto-encoding strategies for graph-to-graph pre-training and four tasks to integrate text and graph information during pre-tuning to improve structure awareness. |
| Outcome: | The proposed model is superior to pre-trained language models on AMR parsing and AMR-to-text generation tasks. |
Self-supervised Graph Masking Pre-training for Graph-to-Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models (PLMs) have advanced Graph-to-Text generation by processing the linearised version of a graph. |
| Approach: | They propose to mask pre-training tasks that neither require supervision signals nor adjust the architecture of the underlying pre-trained encoder-decoder model. |
| Outcome: | The proposed method achieves state-of-the-art results on WebNLG+2020 and EventNarrative datasets and is very efficient in the low-resource setting. |
Structural Neural Encoders for AMR-to-text Generation (N19-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) graphs are graphs, rather than trees, because they contain reentrant nodes with multiple parents. |
| Approach: | They propose to use sequence-to-sequence models that encode AMR graphs into vector representations to generate sentences from AMRs. |
| Outcome: | The proposed model outperforms tree encoders in the AMR-to-text generation task by 24.40 points. |
A Graph-to-Sequence Model for AMR-to-Text Generation (P18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic formalism that encodes the meaning of a sentence as a rooted, directed graph. |
| Approach: | They propose a neural graph-to-sequence model that leverages LSTM to encode a linearized AMR structure. |
| Outcome: | The proposed model outperforms existing methods on a benchmark. |
Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphs (2020.tacl-1)
Copied to clipboard
| Challenge: | Recent graph-to-text models generate text from graph data using global or local aggregation . global node encoding allows explicit communication between two distant nodes, but fails to capture long-range relationships. |
| Approach: | They propose to combine global and local aggregation to learn node representations . they propose to use global and locally encoding to learn contextualized node embeddings based on graph data . |
| Outcome: | The proposed models outperform state-of-the-art models on two graph-to-text datasets by 18.01 and 63.69 points. |
Graph-to-Text Generation with Dynamic Structure Pruning (2022.coling-1)
Copied to clipboard
| Challenge: | Recent studies show that explicitly modeling the input graph structure can significantly improve the performance. |
| Approach: | They propose a structure-aware cross-attention mechanism to re-encode the graph representation conditioning on the newly generated context at each decoding step. |
| Outcome: | The proposed model improves performance on two graph-to-text datasets with only minor increase on computational cost. |