Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have limited capacity to model complex graph-structured relationships. |
| Approach: | They propose a low-coupling method synergizing multimodal temporal Knowledge Graphs and Large Language Models for social relation reasoning. |
| Outcome: | The proposed method exhibits state-of-the-art performance in social relation recognition . it bridges the gap between KGs and LLMs and will be released after acceptance . |
Similar Papers
Multimodal Reasoning with Multimodal Knowledge Graph (2024.acl-long)
Copied to clipboard
| Challenge: | Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. |
| Approach: | They propose a multimodal reasoning method that leverages multimodal knowledge graphs to learn rich and semantic knowledge across modalities. |
| Outcome: | The proposed method outperforms state-of-the-art models on multimodal question answering and multimodal analogy reasoning tasks while training on only a small fraction of parameters. |
SRM-LLM: Semantic Relationship Mining with LLMs for Temporal Knowledge Graph Extrapolation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph extrapolation neglect the complex semantic relationships between relations when modeling their dynamic evolution. |
| Approach: | They propose a method for extracting semantic relationships to achieve TKG extrapolation . they use large language models to analyze the types of relations in TKGs . |
| Outcome: | The proposed method improves on five TKG datasets and shows performance gains. |
RECIPE-TKG: From Sparse History to Structured Reasoning for LLM-based Temporal Knowledge Graph Completion (2026.eacl-long)
Copied to clipboard
| Challenge: | Temporal Knowledge Graphs (TKGs) represent dynamic facts as timestamped relations between entities. Large Language Models (LLMs) have sparked interest in using pretrained generative models for TKG completion. |
| Approach: | They propose a framework that allows for rule-based multi-hop sampling and contrastive fine-tuning to shape relational compatibility. |
| Outcome: | Experiments show that RECIPE-TKG outperforms prior LLM-based methods across input regimes. |
MSG-LLM: A Multi-scale Interactive Framework for Graph-enhanced Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing graph-enhanced large language models (LLMs) focus on matching subgraphs between subgraph and candidate subgraph at the same scale, neglecting that subgraph with different scales may also share similar semantics or structures. |
| Approach: | They propose to use graph kernel search to discover subgraphs from the entire graph to bridge the graph and LLMs, helping with graph retrieval and LRM generation. |
| Outcome: | The proposed method achieves state-of-the-art on two graph-based tasks and the results are published in the journal Nature. |
Consistent Discourse-level Temporal Relation Extraction Using Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have spurred research on temporal relation extraction tasks. |
| Approach: | They propose a framework to improve LLMs’ temporal relation extraction capabilities using context selection, prompts inspired by Allen’s interval algebra and reflection-based consistency learning. |
| Outcome: | The proposed framework improves LLMs’ extraction capabilities by focusing on context selection, prompts inspired by Allen’s interval algebra and reflection-based consistency learning. |
MTGER: Multi-view Temporal Graph Enhanced Temporal Reasoning over Time-Involved Document (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work models time implicitly, making it difficult to handle complex relationships . a novel temporal reasoning framework explicitly models the temporal relationships among facts by multi-view temporal graphs . |
| Approach: | They propose a multi-view temporal graph-based temporal reasoning framework that explicitly models the temporal relationships among facts by multi-visit temporal charts. |
| Outcome: | The proposed framework gives more consistent answers under question perturbations. |
LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for understanding intents from multimodal signals exhibit limitations in their modality-level reliance, constraining relational reasoning over fine-grained semantics for complex intent understanding. |
| Approach: | They propose a method that harnesses the expansive knowledge of large language models to establish semantic foundations that boost smaller models’ relational reasoning performance. |
| Outcome: | The proposed method outperforms state-of-the-art methods on multimodal intent and dialogue act recognition tasks and shows consistent performance gains across diverse semantic understanding scenarios. |
zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to forecast links on temporal knowledge graphs are embedding-based . but they face a strong challenge in modeling the unseen zero-shot relations . |
| Approach: | They propose to embed knowledge graphs (TKGF) entities and relations based on observed contexts into embedding-based methods to model unseen zero-shot relations. |
| Outcome: | The proposed methods show strong performance on traditional TKG forecasting benchmarks, but they face a strong challenge in modeling unseen zero-shot relations that have no prior graph context. |
LLM Meets Scene Graph: Can Large Language Models Understand and Generate Scene Graphs? A Benchmark and Empirical Study (2025.acl-long)
Copied to clipboard
Dongil Yang, Minjin Kim, Sunghwan Kim, Beong-woo Kwak, Minjun Park, Jinseok Hong, Woontack Woo, Jinyoung Yeo
| Challenge: | Large language models (LLMs) have demonstrated impressive progress in various text-based tasks, such as question-answering and content generation. |
| Approach: | They propose a benchmark to evaluate Large Language Models’ ability to understand scene graphs and generate them from textual narratives. |
| Outcome: | The proposed model performs well on scene graph understanding but struggles with scene graph generation, particularly for complex narratives. |
Large Language Models Can Learn Temporal Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Temporal reasoning (TR) is a fundamental ability of large language models (LLMs) however, there is neo-standard methods to perform TR, which are not suitable for large language model applications. |
| Approach: | They propose a framework to enhance temporal reasoning by using a latent representation, temporal graph (TG) instead of reasoning over the original context, they adopt a temporal representation that enhances TR learning. |
| Outcome: | The proposed framework improves the learning of language-based TR by incorporating a latent representation, temporal graph (TG) a synthetic dataset is constructed for fine-tuning LLMs on text-to-TG translation tasks and benchmarks. |