Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing QA performance of Large Language Models (LLMs) have limitations, including duplicated entities or relations, reduced evidence density, and failure to highlight crucial evidence. |
| Approach: | They propose an Evidence-focused Fact Summarization framework for enhanced QA with knowledge-augmented Large Language Models (LLMs) that incorporates external knowledge into LLMs to improve QA performance. |
| Outcome: | The proposed framework improves LLM’s zero-shot QA performance especially when noisy facts are retrieved. |
Similar Papers
Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods employ resource-intensive, non-scalable workflows reasoning on vanilla KGs, but overlook this gap. |
| Approach: | They propose a flexible framework that leverages LLMs’ prior knowledge to enrich KGs and bridge the semantic gap between queries and graphs. |
| Outcome: | The proposed framework bridges the semantic gap between structured knowledge graphs and unstructured queries while ensuring low computational costs, scalability, and adaptability across different methods. |
SKGSum: Structured Knowledge-Guided Document Summarization (2024.findings-acl)
Copied to clipboard
Qiqi Wang, Ruofan Wang, Kaiqi Zhao, Robert Amor, Benjamin Liu, Jiamou Liu, Xianda Zheng, Zijian Huang
| Challenge: | Existing summarization methods ignore the importance of summary structure, resulting in summaries that emphasize the most prominent information while omitting essential details from other sections. |
| Approach: | They propose a method that uses automatically extracted summary points to generate summaries. |
| Outcome: | The proposed methods improve quality and BERTScore of summaries and broaden the types of documents that can be effectively summarized. |
Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method (2023.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that automatic summarization generates concise summaries that contain key ideas of source documents. |
| Approach: | They propose to use Element-aware test sets to annotate news-related reference summaries to focus on more fine-grained news elements objectively and comprehensively. |
| Outcome: | The proposed method outperforms state-of-the-art fine-tuned PLMs and zero-shot LLMs by +4.33/+4.77 on the two datasets, respectively. |
Fact Finder - Enhancing Domain Expertise of Large Language Models by Incorporating Knowledge Graphs (2026.eacl-demo)
Copied to clipboard
Daniel Steinigen, Roman Teucher, Timm Heine Ruland, Max Rudat, Nicolas Flores-Herr, Peter Fischer, Nikola Milosevic, Christopher Schymura, Angelo Ziletti
| Challenge: | Recent advances in Large Language Models have demonstrated their proficiency in answering natural language queries. |
| Approach: | They propose a system that augments Large Language Models with domain-specific knowledge graphs . they evaluate a medical KG and use a KG-based retrieval approach to enhance factual correctness . |
| Outcome: | The proposed system surpasses a standalone LLM in accuracy and completeness on a medical KG dataset. |
Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering (2024.findings-emnlp)
Copied to clipboard
Yuhang Tian, Dandan Song, Zhijing Wu, Changzhi Zhou, Hao Wang, Jun Yang, Jing Xu, Ruanmin Cao, HaoYu Wang
| Challenge: | Recent work uses Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering tasks. |
| Approach: | They propose a framework that augments reasoning capabilities of LLMs with Graph Structures in Knowledge Base Question Answering to retrieve question-related graph structures. |
| Outcome: | The proposed framework outperforms existing methods on GrailQA and WebQSP under the few-shot setting. |
HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to answer multi-hop questions are query-agnostic and the extracted facts are ambiguous as they lack context. |
| Approach: | They propose to use a knowledge graph to extract query-relevant information from unstructured text. |
| Outcome: | The proposed method achieves performance improvements on two popular datasets. |
Empowering Small-Scale Knowledge Graphs: A Strategy of Leveraging General-Purpose Knowledge Graphs for Enriched Embeddings (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to augment LLMs with Knowledge Graphs (KGs) Knowledge-intensive tasks are prone to errors and require a large amount of knowledge to be understood. |
| Approach: | They propose a framework for augmenting LLMs through Knowledge Graphs (KGs) they propose KGs can be used to enhance performance in knowledge-intensive tasks . |
| Outcome: | Experimental results show that a small domain-specific KG can benefit from a performance boost in downstream tasks when linked to a substantial general-purpose KG. |
Biomedical Question Answering via Multi-Level Summarization on a Local Knowledge Graph (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work on how to effectively capture multi-document relationships remains an open question . Existing techniques to mitigate this problem include hierarchical summarization of semantically related chunks or integrating Knowledge Graphs (KGs). |
| Approach: | They propose a method which constructs a local knowledge graph from retrieved documents . they use propositional claims to construct a knowledge graph and contextualize a small language model . |
| Outcome: | The proposed method outperforms RAG on biomedical benchmarks and is generalizable and effective. |
ExplainMeetSum: A Dataset for Explainable Meeting Summarization Aligned with Human Intent (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for meeting summarization use extract-thengenerate method to select "salient" contents . extract-thangenerates method typically selects "selected" content in a distantly supervised manner . |
| Approach: | They propose a novel extractor-guided method to generate a summary from evidence sentences that "explain" a meeting summary. |
| Outcome: | The proposed method outperforms existing methods with gains of up to 3.13 in the ROUGE-1 score. |
Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have demonstrated effectiveness in zero-shot retrieval tasks using large language models. |
| Approach: | They challenge this assumption by analyzing whether knowledge leakage in benchmarks contributes to performance gains. |
| Outcome: | The proposed methods have demonstrated significant performance gains across multiple benchmarks. |