AutoKB: Automated Creation of Structured Knowledge Bases for Domain-Specific Support (2025.naacl-industry)
Copied to clipboard
| Challenge: | Effective customer support requires domain-specific solutions tailored to users’ issues. |
| Approach: | They propose an automated pipeline for building a domain-specific KB with a hierarchical tree structure that maps user issues to precise and domain-compliant solutions. |
| Outcome: | Experiments in troubleshooting and medical domains show that the proposed pipeline outperforms LLMs and unstructured knowledge bases and is 75 times more cost-effective than manual methods. |
Similar Papers
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |
TKGT: Redefinition and A New Way of Text-to-Table Tasks Based on Real World Demands and Knowledge Graphs Augmented LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on text-to-table tasks that ignore domain structures and use simple datasets to extract structured information from unstructured text. |
| Approach: | They propose a new text-to-table task that generates domain knowledge graphs from raw text using a mixed-IE method and a hybrid retrieval augmented generation method. |
| Outcome: | The proposed dataset improves compatibility with long text-processing tasks by incorporating domain knowledge graphs (KGs) classes into tables. |
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)
Copied to clipboard
Xinke Jiang, Yue Fang, Rihong Qiu, Haoyu Zhang, Yongxin Xu, Hao Chen, Wentao Zhang, Ruizhe Zhang, Yuchen Fang, Xinyu Ma, Xu Chu, Junfeng Zhao, Yasha Wang
| Challenge: | Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation. |
| Approach: | They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting. |
| Outcome: | The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods. |
IntKB: A Verifiable Interactive Framework for Knowledge Base Completion (2020.coling-main)
Copied to clipboard
| Challenge: | Knowledge bases (KBs) present databases that store information about entities and relations among them. |
| Approach: | They propose a question-based interactive framework for KB completion from text . their framework generates facts that are aligned with text snippets and is immediately verifiable by humans . |
| Outcome: | The proposed framework achieves a hit@1 ratio of 29.7% for initial unseen relations, and gradually improves to 46.2%. |
ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases (2024.eacl-long)
Copied to clipboard
| Challenge: | Reasoning over Commonsense Knowledge Bases (CSKBs) is a way to acquire new commonsense knowledge based on reference knowledge in original CSKB and external prior knowledge. |
| Approach: | They propose a plugin to provide and check explicit relational constraints over prompting techniques. |
| Outcome: | The proposed method improves on existing prompting techniques and CSKB reasoning. |
KMatrix: A Flexible Heterogeneous Knowledge Enhancement Toolkit for Large Language Model (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing Knowledge-Enhanced Large Language Models (K-LLMs) toolkits focus on free-textual knowledge and lack robust datasets, models, and user-friendly experience. |
| Approach: | They propose a flexible heterogeneous knowledge enhancement toolkit to enhance Large Language Models (LLMs) using external knowledge. |
| Outcome: | KMatrix: a flexible heterogeneous knowledge enhancement toolkit for LLMs includes verbalizing-retrieval and parsing-query methods. |
Tree-KG: An Expandable Knowledge Graph Construction Framework for Knowledge-intensive Domains (2025.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs are a useful tool for organizing complex data in knowledge-intensive domains. |
| Approach: | They propose an expandable framework that combines structured domain texts with advanced semantic techniques to create a tree-like graph from textbooks. |
| Outcome: | The proposed framework surpasses competing methods in the text-Annotated dataset with high scores on the Text-Annalytated data. |
RAGthoven: A Configurable Toolkit for RAG-enabled LLM Experimentation (2025.coling-demos)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have significantly altered the landscape of Natural Language Processing (NLP), but their use as a baseline method has not been extensive. |
| Approach: | They propose a tool for automatic evaluation of RAG-based pipelines that provides a simple yet powerful abstraction. |
| Outcome: | The proposed tool provides an automatic evaluation of RAG-based pipelines. |
SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graph (2024.acl-long)
Copied to clipboard
| Challenge: | Existing KG construction methods rely on human intervention to attain qualified KGs, which severely hinders the practical application of domain KG. |
| Approach: | They propose a general KG construction framework that uses large language models as "S**killed" A**utomatic C**onstructors for domain knowledge (G**raph) |
| Outcome: | The proposed framework generates specialized multi-level knowledge graphs at the scale of over one million nodes and achieves 89.32% precision rate compared to state-of-the-art methods. |
FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for retrieval-augmented generation struggle with a trade-off between flexibility and retrieval quality. |
| Approach: | They propose a flexible modular KG-RAG framework that uses query text instead of KGs . they propose to use query text to infer the structural information of reasoning paths . |
| Outcome: | The proposed method achieves state-of-the-art performance with high efficiency and low resource consumption. |