Modeling Graph Structure in Transformer for Better AMR-to-Text Generation (D19-1)
Copied to clipboard
| Challenge: | Recent studies on AMR-to-text generation formalize the task as a sequence-tosequence learning problem . previous approaches only consider the relations between directly connected concepts while ignoring the rich structure in AMR graphs. |
| Approach: | They propose a structure-aware self-attention approach to model the relations between indirectly connected concepts in the seq2seq model. |
| Outcome: | The proposed approach outperforms the state-of-the-art on English AMR benchmarks . it significantly outperformed the state of the art on the benchmarks, with 29.66 and 31.82 BLEU scores . |
Similar Papers
AMR-To-Text Generation with Graph Transformer (2020.tacl-1)
Copied to clipboard
| Challenge: | Abstract meaning representation (AMR)-to-text generation is challenging task for natural language processing. |
| Approach: | They propose a graph-to-sequence model that directly encodes AMR graphs and learns node representations. |
| Outcome: | The proposed model outperforms the current state-of-the-art neural approach by 1.5 BLEU points on LDC2015E86 and 4.8 BLUE points on the LDC2017T10 and achieves new state- of-the art performance. |
Heterogeneous Graph Transformer for Graph-to-Sequence Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies ignore the indirect relations between distance nodes, or treat indirect relations and direct relations in the same way. |
| Approach: | They propose a graph-to-sequence (Graph2Seq) encoder which models graph structure to model different relations in individual subgraphs of the original graph. |
| Outcome: | The proposed model outperforms the state-of-the-art on all four benchmarks of AMR-to-text generation and syntax-based neural machine translation. |
Leveraging AMR Graph Structure for Better Sequence-to-Sequence AMR Parsing (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies on AMR parsing often regard this task as a seq2seq translation problem. |
| Approach: | They propose to translate AMR graphs into AMR token sequences in pre-processing and recover AMR from sequences after decoding. |
| Outcome: | The proposed approach outperforms baseline and achieves 85.5 0.1 and 84.2 0.2 Smatch scores on AMR 2.0 and AMR 3.0. |
Graph Pre-training for AMR Parsing and Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Abstract meaning representation (AMR) highlights the core semantic information of text in a graph structure. |
| Approach: | They propose two graph auto-encoding strategies for graph-to-graph pre-training and four tasks to integrate text and graph information during pre-tuning to improve structure awareness. |
| Outcome: | The proposed model is superior to pre-trained language models on AMR parsing and AMR-to-text generation tasks. |
Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows that pre-trained sequence-to-sequence Transformer models are effective in predicting linearized Abstract Meaning Representation graphs. |
| Approach: | They propose a structure-aware transition-based approach to AMR parsing that integrates general pre-trained sequence-to-sequence language models with a structured transition set. |
| Outcome: | The proposed approach retains the desirable properties of previous approaches while reaching the new parsing state of the art for AMR 2.0. |
Structural Neural Encoders for AMR-to-text Generation (N19-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) graphs are graphs, rather than trees, because they contain reentrant nodes with multiple parents. |
| Approach: | They propose to use sequence-to-sequence models that encode AMR graphs into vector representations to generate sentences from AMRs. |
| Outcome: | The proposed model outperforms tree encoders in the AMR-to-text generation task by 24.40 points. |
Incorporating Graph Information in Transformer-based AMR Parsing (2023.findings-acl)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic graph abstraction for text representations. |
| Approach: | They propose a model and method that incorporates graph information into the learned representations of AMR by word-to-node alignment. |
| Outcome: | The proposed model improves AMR parsing performance by embedding graph information into the encoder at training time. |
A Graph-to-Sequence Model for AMR-to-Text Generation (P18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic formalism that encodes the meaning of a sentence as a rooted, directed graph. |
| Approach: | They propose a neural graph-to-sequence model that leverages LSTM to encode a linearized AMR structure. |
| Outcome: | The proposed model outperforms existing methods on a benchmark. |
Sequence-to-sequence AMR Parsing with Ancestor Information (2022.acl-short)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a graph that encodes the semantic meaning of a sentence. |
| Approach: | They propose several strategies to add important ancestor information into a Transformer Decoder. |
| Outcome: | The proposed methods improve performance for both AMR 2.0 and AMR 3.0 datasets and achieve new state-of-the-art results. |
Line Graph Enhanced AMR-to-Text Generation with Mix-Order Graph Attention Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing graph-to-sequence approaches use graph neural networks as encoders, but they lack the structure information needed to translate AMR into the graph-based data. |
| Approach: | They propose a graph-to-sequence task which aims to recover natural language from Abstract Meaning Representations (AMR) they adopt graph attention networks with higher-order neighborhood information to explore the edge relations in AMR graphs. |
| Outcome: | The proposed framework achieves state-of-the-art performance on English AMR benchmark datasets and is able to translate the AMR semantics into the natural language. |