Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining (2023.emnlp-main)
Copied to clipboard
Jingcong Liang, Rong Ye, Meng Han, Qi Zhang, Ruofei Lai, Xinyu Zhang, Zhao Cao, Xuanjing Huang, Zhongyu Wei
| Challenge: | Recent studies have discussed its capability to assist language models for various applications. |
| Approach: | They propose a structure to organize arguments using the **Hi**erarchical **Ar**gumentation **G**raph (Hi-ArG) and propose two approaches to exploit Hi-AarG, including a text-graph multi-modal model GreaseArR and a framework augmented with graph information. |
| Outcome: | The proposed structure supersedes existing language models on two argumentation tasks while incorporating graph information during further training improves vanilla language models. |
Similar Papers
Leveraging Argumentation Knowledge Graph for Interactive Argument Pair Identification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing researches focus on sentence matching but the interaction of opinions requires reasoning of knowledge, which is beyond textual information. |
| Approach: | They propose to leverage external knowledge to enhance the identification of interactive argument pairs by analyzing the discussion thread of the target topic in an online forum. |
| Outcome: | The proposed model achieves state-of-the-art in the benchmark dataset. |
Enhancing Chinese Pre-trained Language Model via Heterogeneous Linguistics Graph (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that pre-trained Chinese language models ignore linguistics knowledge to learn representations. |
| Approach: | They propose a task-free enhancement module to integrate linguistics knowledge into Chinese pre-trained language models. |
| Outcome: | The proposed model improves Chinese pre-trained language models on 6 tasks with 10 benchmark datasets. |
What Has Been Enhanced in my Knowledge-Enhanced Language Model? (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge integration methods such as linear probes and prompts have key limitations in answering these questions. |
| Approach: | They propose a new probe model which integrates external knowledge from knowledge graphs into pretrained language models (LMs) ERNIE and K-Adapter are proposed as KI methods . |
| Outcome: | The proposed model interprets two well-known KELMs using graph attention on the corresponding knowledge graph for interpretation. |
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are criticized for lack of expertise and knowledge conflict . KG-Adapter is a parameter-level KG integration method for decoder-only LLMs . |
| Approach: | They propose a parameter-level KG integration method based on parameter-efficient fine-tuning . they use KG-Adapter to integrate knowledge graphs with LLMs and perform joint reasoning . |
| Outcome: | The proposed method outperforms the current state-of-the-art method on four datasets for two different tasks. |
Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have performed impressively in various NLP tasks, but their inherent hallucination phenomena severely challenge their credibility in complex reasoning. |
| Approach: | They propose to integrate explainable Knowledge Graphs (KGs) with LLMs to alleviate hallucinations . they construct subgraphs to enhance the retrieval capabilities of KGs via CoT reasoning. |
| Outcome: | Extensive experiments on two KGQA datasets show that the proposed model achieves convincing performance compared to strong baselines. |
ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph (2023.emnlp-main)
Copied to clipboard
| Challenge: | Question Answering over Knowledge Graph (KGQA) aims to find answer entities for natural language questions based on knowledge graphs. |
| Approach: | They propose a subgraph-aware self-attention mechanism to imitate the graph neural network (GNN) based module to perform multi-hop reasoning on KG. |
| Outcome: | The proposed method surpasses state-of-the-art models by a large margin even with fewer updated parameters and less training data. |
Judge and Improve: Towards a Better Reasoning of Knowledge Graphs with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to integrating graph and language models face two key limitations: achieving robust semantic alignment and ensuring interpretability in outputs. |
| Approach: | They propose a framework to integrate graph and language modalities while enhancing transparency. |
| Outcome: | Extensive experiments on three benchmark datasets show that the proposed framework surpasses existing methods in efficiency and generates outputs that are significantly more interpretable. |
Tree-KG: An Expandable Knowledge Graph Construction Framework for Knowledge-intensive Domains (2025.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs are a useful tool for organizing complex data in knowledge-intensive domains. |
| Approach: | They propose an expandable framework that combines structured domain texts with advanced semantic techniques to create a tree-like graph from textbooks. |
| Outcome: | The proposed framework surpasses competing methods in the text-Annotated dataset with high scores on the Text-Annalytated data. |
ClaimPKG: Enhancing Claim Verification via Pseudo-Subgraph Generation with Lightweight Specialized LLM (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing verification methods rely on unstructured text corpora to break down claims . despite strong reasoning abilities, modern LLMs struggle with modular pipelines . |
| Approach: | They propose a framework that integrates knowledge graphs with LLM reasoning . they propose KGs provide structured, semantically rich representations . |
| Outcome: | The proposed framework outperforms baselines on the FactKG dataset by 9%-12% accuracy points across multiple categories. |
HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding (2025.coling-main)
Copied to clipboard
| Challenge: | Object categories are typically organized into a multi-granularity taxonomic hierarchy . traditional uni-modal approaches focus primarily on image features, revealing limitations in complex scenarios. |
| Approach: | They propose a framework that combines vision-language models with a deeper exploitation of the hierarchy. |
| Outcome: | The proposed framework shows significant improvements on 11 diverse visual recognition benchmarks. |