Acquisition and Application of Novel Knowledge in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for constructing new datasets rely on timestamps or simple templates that do not accurately reflect the real world. |
| Approach: | They propose a knowledge dataset construction approach that simulates biological evolution using knowledge graphs to generate synthetic entities with diverse attributes. |
| Outcome: | The proposed framework outperforms knowledge augmentation methods by 3.3%-38%. |
Similar Papers
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
| Challenge: | specialized LLMs are often limited in domain-specific applications that require specialized knowledge. |
| Approach: | They provide a comprehensive overview of four key methods to enhance large language models by integrating domain-specific knowledge. |
| Outcome: | The proposed methods are categorized into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization. |
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
Revisiting the Knowledge Injection Frameworks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Injecting unaligned knowledge tuple into large language models achieves comparable (and sometimes better) results than aligned knowledge. |
| Approach: | They propose a technique to inject random knowledge into large language models to improve performance. |
| Outcome: | The proposed technique overcomes the sanity problem and pushes the performance limit. |
Knowledge Graph-Enhanced Large Language Models via Path Selection (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown unprecedented performance in various real-world applications, but they are known to generate factually inaccurate outputs. |
| Approach: | They propose a framework to integrate external knowledge extracted from Knowledge Graphs (KGs) they propose to generate scores for knowledge paths with input texts via latent semantic matching. |
| Outcome: | Experiments on real-world datasets validate the effectiveness of a framework to extract knowledge from Knowledge Graphs (KGs) incorporating external knowledge has become a promising strategy to improve the factual accuracy of LLM-generated outputs. |
Enhancing LLM Capabilities Beyond Scaling Up (2024.emnlp-tutorials)
Copied to clipboard
| Challenge: | general-purpose large language models (LLMs) are expanding in scale and access to unpublic training data. |
| Approach: | This tutorial aims to examine the capabilities of general-purpose large language models . authors discuss adaptation of LLMs to address conflicts, defense against attacks . |
| Outcome: | This tutorial aims to examine the evolution of general-purpose large language models (LLMs) the authors argue that the evolution is dependent on the availability of training data and the scale of the models. |
How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have exceptional capabilities in knowledge-intensive tasks . however, they struggle with knowledge updates due to dynamic nature of world knowledge . |
| Approach: | They propose to identify computational subgraphs that facilitate knowledge storage and processing . they also identify a phase shift from formation to optimization in LLMs . |
| Outcome: | The proposed model can capture factual knowledge from pre-training corpus and encapsulate it as extensive parametric knowledge. |
Fact Finder - Enhancing Domain Expertise of Large Language Models by Incorporating Knowledge Graphs (2026.eacl-demo)
Copied to clipboard
Daniel Steinigen, Roman Teucher, Timm Heine Ruland, Max Rudat, Nicolas Flores-Herr, Peter Fischer, Nikola Milosevic, Christopher Schymura, Angelo Ziletti
| Challenge: | Recent advances in Large Language Models have demonstrated their proficiency in answering natural language queries. |
| Approach: | They propose a system that augments Large Language Models with domain-specific knowledge graphs . they evaluate a medical KG and use a KG-based retrieval approach to enhance factual correctness . |
| Outcome: | The proposed system surpasses a standalone LLM in accuracy and completeness on a medical KG dataset. |
Empowering Large Language Models for Textual Data Augmentation (2024.findings-acl)
Copied to clipboard
| Challenge: | True. True. False |
| Approach: | False slants are proposed to generate a large pool of augmentation instructions and select the most suitable task-informed instructions. |
| Outcome: | False omissions: the proposed approach consistently generates augmented data with better quality compared to non-LLM and LLM-based data augmentation methods. |
Embedding Domain Knowledge for Large Language Models via Reinforcement Learning from Augmented Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to embed knowledge into large language models have some limitations . static nature of training data and lack of knowledge in domains create knowledge gaps . |
| Approach: | They propose a method that iteratively cycles between sampling generations and optimizing the model through calculated rewards. |
| Outcome: | The proposed method outperforms baseline approaches on medical, legal, astronomy, and current events datasets. |
Synthetic Data in the Era of Large Language Models (2025.acl-tutorials)
Copied to clipboard
| Challenge: | 'synthetic data' is a data generated with the assistance of large language models to make dataset construction faster and cheaper. |
| Approach: | This tutorial seeks to build a shared understanding of recent progress in synthetic data generation from NLP and related fields by grouping and describing major methods, applications, and open problems. |
| Outcome: | This tutorial will describe methods, applications, and open problems that have been developed and are being used to improve the quality and efficiency of synthetic data generation. |