Linguistically-Informed Self-Attention for Semantic Role Labeling (D18-1)

Copied to clipboard

Challenge: Existing models of semantic role labeling use no explicit linguistic features. prior work has shown that syntax trees can dramatically improve SRL decoding.
Approach: They propose a neural network model that incorporates syntax using only raw tokens . they show that LISA out-performs the state-of-the-art with contextually-encoded word representations a 1.0 F1 on newswire and 2.0 F1 in out-of domain text .
Outcome: The proposed model outperforms the state-of-the-art model with word embeddings and predicted predicates.

Similar Papers

Syntax-Enhanced Self-Attention-Based Semantic Role Labeling (D19-1)

Copied to clipboard

Challenge: Abstract: Syntax is the bridge to semantics, but recent studies have discussed the necessity of syntax in the context of SRL.
Approach: They propose a syntax-enhanced self-attention model that incorporates syntactic knowledge into the SRL task effectively.
Outcome: The proposed model achieves state-of-the-art for the Chinese SRL task on the CoNLL-2009 dataset.
Rethinking Self-Attention: Towards Interpretability in Neural Parsing (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent work shows that attention mechanisms provide arguably explainable attention distributions that can help to interpret predictions.
Approach: They propose a new self-attention layer where attention heads represent labels.
Outcome: The proposed model obtains state-of-the-art results on the Penn Treebank and Chinese Treebank.
A Unified Syntax-aware Framework for Semantic Role Labeling (D18-1)

Copied to clipboard

Challenge: Syntactic information has been paid a great attention over the role of enhancing SRL . but the gap between syntax-aware and syntax-gnostic SRL is smaller . a new framework proposes syntax-based SRL for a wide range of NLP tasks .
Approach: They propose to extend existing models to investigate more effective ways of incorporating syntax into sequential neural networks.
Outcome: The proposed framework outperforms existing models on CoNLL-2009 benchmarks in English and Chinese.
A Full End-to-End Semantic Role Labeler, Syntactic-agnostic Over Syntactic-aware? (C18-1)

Copied to clipboard

Challenge: Existing models for semantic role labeling are syntax-agnostic, but outperform them on benchmarks.
Approach: They propose an end-to-end neural model which tackles the SRL problem in one shot . they augment the encoder with a non-linear transformation to distinguish the predicate and the argument .
Outcome: The proposed model outperforms state-of-the-art syntax-aware SRL systems on CoNLL-2008 and 2009 benchmarks for English and Chinese.
LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Semantic role labeling (SRL) is a crucial task of natural language processing (NLP).
Approach: They propose to equip LLMs with retrieval-augmented generation and self-correction mechanisms to enable SRL to perform better in Chinese and English.
Outcome: The proposed method achieves state-of-the-art in Chinese and English on three widely-used benchmarks.
Syntax-aware Neural Semantic Role Labeling with Supertags (N19-1)

Copied to clipboard

Challenge: a new syntax-aware model for dependency-based semantic role labeling outperforms syntax-based models for English and Spanish.
Approach: They propose a syntax-aware model for dependency-based semantic role labeling that outperforms syntax-based models for English and Spanish.
Outcome: The proposed model outperforms syntax-agnostic models for English and Spanish.
Syntax for Semantic Role Labeling, To Be, Or Not To Be (P18-1)

Copied to clipboard

Challenge: Existing neural SRL models lack syntactic backbone for performance, limiting its use in deep learning.
Approach: They propose an enhanced argument labeling model with extended korder argument pruning algorithm for effectively exploiting syntactic information.
Outcome: The proposed model achieves state-of-the-art on the CoNLL-2008 and 2009 benchmarks in English and Chinese.
Syntax-driven Approach for Semantic Role Labeling (2022.lrec-1)

Copied to clipboard

Challenge: Existing studies focus on auto-generated syntactic knowledge to enhance semantic role labeling . experimental results show that map memories can enhance SRL .
Approach: They propose to map memories to enhance semantic role labeling by encoding auto-generated syntactic knowledge from off-the-shelf toolkits.
Outcome: The proposed model outperforms baselines and achieves state-of-the-art results on two English benchmark datasets.
Enhancing Opinion Role Labeling with Semantic-Aware Word Representations from Semantic Role Labeling (N19-1)

Copied to clipboard

Challenge: Existing work on opinion role labeling (ORL) is highly correlative with semantic role labeled (SRL) SRL is used to identify opinion holders and holder expressions for a given predicate.
Approach: They propose a method to enhance opinion role labeling by presenting semantic-aware word representations which are learned from SRL.
Outcome: The proposed method outperforms two other methods on a benchmark MPQA corpus and achieves higher F scores.
How to Best Use Syntax in Semantic Role Labelling (P19-1)

Copied to clipboard

Challenge: Existing studies on integrating external information into NLP tasks focus on word-level shallow features such as POS or chunk tags.
Approach: They propose to integrate syntactic information into a neural ELMo-based SRL sequence labelling model by using a constituency representation as input features.
Outcome: The proposed approach improves performance on the in-domain CoNLL’05 and CoNll’12 benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations