Probing Structural Knowledge from Pre-trained Language Model for Argumentation Relation Classification (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Argumentation relation classification (ARC) is the most challenging subtask of argumentation mining. |
| Approach: | They propose a dual prior graph neural network to explore probing knowledge and syntactical information for comprehensively modeling the relationship between AC pairs. |
| Outcome: | The proposed model outperforms the state-of-the-art models on three public datasets. |
Similar Papers
Probing for Constituency Structure in Neural Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Using standard probing techniques, we examine whether contextual neural language models implicitly learn syntactic structure. |
| Approach: | They investigate to which extent contextual neural language models implicitly learn syntactic structure. |
| Outcome: | The proposed model is able to represent constituents of different categories within the neuron activations of a LM such as RoBERTa with high performance even on manipulated data. |
Probing for Predicate Argument Structures in Pretrained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Recent proposed approaches have achieved impressive results in dependency- and span-based, multilingual and cross-lingual Semantic Role Labeling (SRL) |
| Approach: | They propose to probe for predicate argument structures in pretrained language models . they show that PLMs encode semantic structures directly into contextualized representations . |
| Outcome: | The proposed models have achieved impressive results in dependency- and span-based, multilingual and cross-lingual Semantic Role Labeling (SRL) |
Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining (2023.emnlp-main)
Copied to clipboard
Jingcong Liang, Rong Ye, Meng Han, Qi Zhang, Ruofei Lai, Xinyu Zhang, Zhao Cao, Xuanjing Huang, Zhongyu Wei
| Challenge: | Recent studies have discussed its capability to assist language models for various applications. |
| Approach: | They propose a structure to organize arguments using the **Hi**erarchical **Ar**gumentation **G**raph (Hi-ArG) and propose two approaches to exploit Hi-AarG, including a text-graph multi-modal model GreaseArR and a framework augmented with graph information. |
| Outcome: | The proposed structure supersedes existing language models on two argumentation tasks while incorporating graph information during further training improves vanilla language models. |
Leveraging Argumentation Knowledge Graph for Interactive Argument Pair Identification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing researches focus on sentence matching but the interaction of opinions requires reasoning of knowledge, which is beyond textual information. |
| Approach: | They propose to leverage external knowledge to enhance the identification of interactive argument pairs by analyzing the discussion thread of the target topic in an online forum. |
| Outcome: | The proposed model achieves state-of-the-art in the benchmark dataset. |
Incorporating Contextual and Syntactic Structures Improves Semantic Similarity Modeling (D19-1)
Copied to clipboard
| Challenge: | Semantic similarity modeling is central to many NLP problems such as question answering. |
| Approach: | They propose a pairwise word interaction model with syntactic structure priors to explore their effectiveness. |
| Outcome: | Extensive evaluations on eight benchmark datasets show that incorporating structural information improves over strong baselines. |
External Knowledge-Driven Argument Mining: Leveraging Attention-Enhanced Multi-Network Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Argument mining involves the identification of argument relations (AR) between Argumentative Discourse Units (ADUs). |
| Approach: | They propose to leverage external resources to identify semantic paths linking ADUs . they propose to use WordNet, ConceptNet, and Wikipedia to identify these paths . |
| Outcome: | The proposed architecture achieves F-scores of 0.85, 0.84, 0.70, and 0.87 on four datasets. |
Probing Relational Knowledge in Language Models via Word Analogies (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on probing relational knowledge by filling the blanks in pre-defined prompts such as “The capital of France is —” but these are affected by the co-occurrence of target relation words and entities in the pre-training corpus. |
| Approach: | They extend probing methodologies by using analogical proportions as a proxy to probe relational knowledge in transformer-based PLMs without directly presenting the desired relation. |
| Outcome: | The proposed methods are extremely accurate at (1) and (2), but have room for improvement for (3). |
Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling (P18-2)
Copied to clipboard
| Challenge: | Recent models that use gold predicates only use a single predicate at a time. |
| Approach: | They propose an end-to-end approach for jointly predicting all predicates, arguments spans, and the relations between them. |
| Outcome: | The proposed model can model overlapping spans across different predicates in the same output structure without gold predicate predications. |
Argument Relation Classification through Discourse Markers and Adversarial Training (2024.emnlp-main)
Copied to clipboard
| Challenge: | Argument relation classification (ARC) identifies supportive, contrasting and neutral relations between argumentative units. |
| Approach: | They propose an argument relation classifier that integrates knowledge of discourse markers into a pre-trained RoBERTa model. |
| Outcome: | The proposed model outperforms existing methods and learns discriminative sentence embeddings supporting the task. |
Using active learning to expand training data for implicit discourse relation recognition (D18-1)
Copied to clipboard
| Challenge: | Existing methods to determine semantic relations between text spans are limited in the field of discourse-level relation recognition. |
| Approach: | They propose to expand the training data set using the corpus of explicitly-related arguments by arbitrarily dropping the overtly presented discourse connectives. |
| Outcome: | The proposed model expands the training data set using the corpus of explicitly-related arguments, by arbitrarily dropping the overtly presented discourse connectives. |