Paul Roit, Ayal Klein, Daniela Stepanov, Jonathan Mamou, Julian Michael, Gabriel Stanovsky, Luke Zettlemoyer, Ido Dagan
| Challenge: | Question-answer driven Semantic Role Labeling (QA-SRL) is an open and natural flavour of SRL, potentially attainable from laymen. |
| Approach: | They propose a question-answer driven semantic role labeling approach that uses question-announced questions to label predicate-argument relationships. |
| Outcome: | The proposed method yields high-quality annotation with dramatically higher coverage, enabling future replicable research of natural semantic annotations. |
Similar Papers
Large-Scale QA-SRL Parsing (P18-1)
Copied to clipboard
| Challenge: | a crowd-sourced approach to learning semantic parsers to predict predicateargument structures is open to many researchers. |
| Approach: | They propose a large-scale corpus of Question-Answer driven Semantic Role Labeling annotations . they also propose QA-SRL Bank 2.0, a crowd-sourcing scheme that can be used to train high quality parsers . |
| Outcome: | The proposed QA-SRL parser can generate high-quality questions at low cost and is intuitive to non-experts. |
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training Corpus (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to semantic role labeling (SRL) are focusing on the English language. |
| Approach: | They propose a method for semantic role labeling that uses corpus translation to build training datasets from SRL annotations. |
| Outcome: | The proposed method is highly effective and can improve the target-language performance significantly. |
Effective QA-Driven Annotation of Predicate–Argument Relations Across Languages (2026.eacl-long)
Copied to clipboard
| Challenge: | Explicit representations of predicate-argument relations are a cornerstone of natural language understanding. |
| Approach: | They propose a cross-linguistic projection approach that reuses an English QA-SRL parser within a constrained translation and word-alignment pipeline to automatically generate question-answer annotations aligned with target-language predicates. |
| Outcome: | The proposed approach outperforms strong multilingual LLMs in Hebrew, Russian, and French. |
A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Prior attempts to develop crowdsourcing methods have either had low accuracy or required substantial expert annotation. |
| Approach: | They propose a multi-stage crowd workflow that reduces expert involvement without sacrificing accuracy. |
| Outcome: | The proposed method reduces expert effort by 4x, from 56% to 14% of cases. |
Design Choices in Crowdsourcing Discourse Relation Annotations: The Effect of Worker Selection and Training (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent methods have obtained promising results by extracting relation labels from participants . obtaining linguistic annotations from novice crowdworkers is difficult . crowdsourcing allows for fast and cost-effective collection of labelled data, but because tasks need to be intuitive, crowdworker cannot be asked to perform them. |
| Approach: | They propose to use a selection-only approach to obtain linguistic annotations from novices . current study shows that the method is cost- and time-intensive . |
| Outcome: | The current study shows that selection and training improves the agreement between workers and gold labels, but the method is cost- and time-intensive. |
Inducing Semantic Roles Without Syntax (2021.findings-acl)
Copied to clipboard
| Challenge: | Semantic roles are a key component of linguistic predicate-argument structure, but syntax can be difficult to define, annotate, and predict. |
| Approach: | They propose to use QA-SRL to automatically induce semantic roles from ontologies that use question-answer pairs to represent predicate-argument structure. |
| Outcome: | The proposed method outperforms existing models and a state-of-the-art model over gold syntax. |
QANom: Question-Answer driven SRL for Nominalizations (2020.coling-main)
Copied to clipboard
Ayal Klein, Jonathan Mamou, Valentina Pyatkin, Daniela Stepanov, Hangfeng He, Dan Roth, Luke Zettlemoyer, Ido Dagan
| Challenge: | Traditionally, SRL annotations focus on verbal predicates, but other types of predicate are frequent in natural language. |
| Approach: | They propose a semantic scheme for capturing predicate-argument relations for nominalizations, termed QANom, using crowdsourcing and QA-driven annotations. |
| Outcome: | The proposed scheme outperforms existing annotations and is useful for downstream tasks. |
A Unified Syntax-aware Framework for Semantic Role Labeling (D18-1)
Copied to clipboard
| Challenge: | Syntactic information has been paid a great attention over the role of enhancing SRL . but the gap between syntax-aware and syntax-gnostic SRL is smaller . a new framework proposes syntax-based SRL for a wide range of NLP tasks . |
| Approach: | They propose to extend existing models to investigate more effective ways of incorporating syntax into sequential neural networks. |
| Outcome: | The proposed framework outperforms existing models on CoNLL-2009 benchmarks in English and Chinese. |
Syntax-Enhanced Self-Attention-Based Semantic Role Labeling (D19-1)
Copied to clipboard
| Challenge: | Abstract: Syntax is the bridge to semantics, but recent studies have discussed the necessity of syntax in the context of SRL. |
| Approach: | They propose a syntax-enhanced self-attention model that incorporates syntactic knowledge into the SRL task effectively. |
| Outcome: | The proposed model achieves state-of-the-art for the Chinese SRL task on the CoNLL-2009 dataset. |
Syntax-driven Approach for Semantic Role Labeling (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies focus on auto-generated syntactic knowledge to enhance semantic role labeling . experimental results show that map memories can enhance SRL . |
| Approach: | They propose to map memories to enhance semantic role labeling by encoding auto-generated syntactic knowledge from off-the-shelf toolkits. |
| Outcome: | The proposed model outperforms baselines and achieves state-of-the-art results on two English benchmark datasets. |