CypherSmith: Transforming Text-to-Cypher Generation for LLMs with Synthetic Data (2026.acl-long)
Copied to clipboard
| Challenge: | Existing datasets are small, domain-limited, and lack diversity, constraining LLM progress. |
| Approach: | They propose a knowledge Graph retrieval tool that can translate natural language questions into structured queries. |
| Outcome: | Extensive experiments show that CypherSmith achieves state-of-the-art performance. |
Similar Papers
Auto-Cypher: Improving LLMs on Cypher generation via LLM-supervised generation-verification framework (2025.naacl-short)
Copied to clipboard
| Challenge: | Graph databases like Neo4j are gaining popularity for handling complex, interconnected data, over traditional relational databases. |
| Approach: | They propose an automated pipeline to generate Cypher queries for Neo4j using LLM-As-Database-Filler, a novel strategy for ensuring Cyphere query correctness. |
| Outcome: | The proposed pipeline generates high quality Cypher data containing 29.8k instances across various domains and queries with varying complexities. |
CypherBench: Towards Precise Retrieval over Full-scale Modern Knowledge Graphs in the LLM Era (2025.acl-long)
Copied to clipboard
| Challenge: | Graphs are used for storing open-domain knowledge and domain-specific enterprise data. |
| Approach: | They propose to use property graph views on top of the underlying RDF graph to efficiently query LLMs. |
| Outcome: | The proposed graph views can be efficiently queried by LLMs using Cypher . the proposed graphs have a large schema, overlapping and ambiguous relation types and lack of normalization. |
SyntheT2C: Generating Synthetic Data for Fine-Tuning Large Language Models on the Text2Cypher Task (2025.coling-main)
Copied to clipboard
| Challenge: | Existing efforts to bolster LLMs’ proficiency in Cypher generation are hindered by the lack of annotated datasets of Query-Cypher pairs. |
| Approach: | They propose a method for constructing a synthetic Query-Cypher pair dataset using LLM prompting and template-filling. |
| Outcome: | The proposed method enhances the performance of LLMs on Text2Cypher task via SFT. |
Fact Finder - Enhancing Domain Expertise of Large Language Models by Incorporating Knowledge Graphs (2026.eacl-demo)
Copied to clipboard
Daniel Steinigen, Roman Teucher, Timm Heine Ruland, Max Rudat, Nicolas Flores-Herr, Peter Fischer, Nikola Milosevic, Christopher Schymura, Angelo Ziletti
| Challenge: | Recent advances in Large Language Models have demonstrated their proficiency in answering natural language queries. |
| Approach: | They propose a system that augments Large Language Models with domain-specific knowledge graphs . they evaluate a medical KG and use a KG-based retrieval approach to enhance factual correctness . |
| Outcome: | The proposed system surpasses a standalone LLM in accuracy and completeness on a medical KG dataset. |
Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion (2025.coling-main)
Copied to clipboard
| Challenge: | Empirical evidence suggests that LLMs perform worse than conventional KGC approaches. |
| Approach: | They propose a filter-then-generate paradigm and a multiple-choice question format to harness the capability of LLMs while mitigating the issue casused by hallucinations. |
| Outcome: | The proposed method achieves substantial performance gain compared to existing state-of-the-art methods. |
KMatrix: A Flexible Heterogeneous Knowledge Enhancement Toolkit for Large Language Model (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing Knowledge-Enhanced Large Language Models (K-LLMs) toolkits focus on free-textual knowledge and lack robust datasets, models, and user-friendly experience. |
| Approach: | They propose a flexible heterogeneous knowledge enhancement toolkit to enhance Large Language Models (LLMs) using external knowledge. |
| Outcome: | KMatrix: a flexible heterogeneous knowledge enhancement toolkit for LLMs includes verbalizing-retrieval and parsing-query methods. |
Mind the Query: A Benchmark Dataset towards Text2Cypher Task (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Graph databases store data in nodes and relationships, enabling more natural modeling of complex, interconnected data. |
| Approach: | They present a high-quality dataset for the Text2Cypher task . it is enabling the translation of natural language (NL) questions into executable Cypher queries over graph databases. |
| Outcome: | The proposed dataset includes 27,529 NL queries and corresponding Cyphers spanning across 11 real-world graph datasets. |
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a data-centric solution to alleviate limitations of real-world data with synthetic data generation. |
| Approach: | They propose a generic workflow for LLM-driven synthetic data generation. |
| Outcome: | The proposed workflows highlight gaps in existing research and outline avenues for future studies. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |
Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs. |
| Approach: | They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model . |
| Outcome: | The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning. |